Child Care Under the Big Sky (CCUBS) system modernization and security : Department of Public Health and Human Services

2021·1.8 MB·English

by  Montana. Legislature. Legislative Audit Division

A R
epoRt

to the
M
ontAnA
L
egisLAtuRe
i s A
nfoRMAtion ysteMs udit
Child Care Under the
Big Sky (CCUBS) System
Modernization and Security
Department of Public Health and
Human Services
J 2021
AnuARy
L A
egisLAtive udit
d
ivision
19DP-04
Information Systems Audits
Legislative Audit
Information Systems (IS) audits conducted by the Legislative
Committee
Audit Division are designed to assess controls in an IS
Representatives environment. IS controls provide assurance over the accuracy,
Kim Abbott reliability, and integrity of the information processed. From
[email protected] the audit work, a determination is made as to whether controls
Dan Bartel exist and are operating as designed. We conducted this IS audit
[email protected] in accordance with generally accepted government auditing
Denise Hayman, Chair standards. Those standards require that we plan and perform
[email protected] the audit to obtain sufficient, appropriate evidence to provide a
Emma Kerr-Carpenter reasonable basis for our findings and conclusions based on our
[email protected] audit objectives. We believe that the evidence obtained provides
Terry Moore a reasonable basis for our finding and conclusions based on our
[email protected] audit objectives. Members of the IS audit staff hold degrees in
Matt Regier disciplines appropriate to the audit process.
[email protected]
Senators IS audits are performed as stand-alone audits of IS controls or
Jason Ellsworth, Vice Chair in conjunction with financial-compliance and/or performance
[email protected] audits conducted by the office. These audits are done under
John Esp the oversight of the Legislative Audit Committee, which is a
[email protected] bicameral and bipartisan standing committee of the Montana
Pat Flowers Legislature. The committee consists of six members of the
[email protected] Senate and six members of the House of Representatives.
Tom Jacobson
[email protected]
Tom McGillvray
[email protected]
Mary McNally
[email protected]
Members serve until a member’s
legislative term of office
ends or until a successor is
appointed, whichever occurs Audit Staff
first. Miki Cestnik Hunter McClure
T. Shane Somerville
§5-13-202(2), MCA
Fraud Hotline
Reports can be found in electronic format at:
(Statewide)
https://leg.mt.gov/lad/audit-reports
1-800-222-4446
(in Helena)
444-4446
[email protected].
www.montanafraud.gov
LEGISLATIVE AUDIT DIVISION

Angus Maciver, Legislative Auditor Deputy Legislative Auditors:
Deborah F. Butler, Legal Counsel Cindy Jorgenson
William Soller
January 2021
The Legislative Audit Committee
of the Montana State Legislature:
This is our information systems audit of the Child Care Under the Big Sky (CCUBS)
system managed by the Early Childhood and Family Support Division of the
Department of Public Health and Human Services (DPHHS).
This report provides the Legislature information about managing return on investment
and security concerns as CCUBS ages. This report includes recommendations to
enhance risk identification and remediation procedures to protect CCUBS data. Our
findings also address the need for DPPHS to develop a modernization strategy that
includes consistent review of metrics that identify public value. A written response
from DPPHS is included at the end of the report.
We wish to express our appreciation to Department of Public Health and Human
Services personnel for their cooperation and assistance during the audit.
Respectfully submitted,
/s/ Angus Maciver
Angus Maciver
Legislative Auditor
Room 160 • State Capitol Building • PO Box 201705 • Helena, MT • 59620-1705
Phone [phone] • FAX [phone] • E-Mail [email protected]

i
Table of Contents
Figures and Tables .....................................................................................................................ii
Appointed and Administrative Officials ..................................................................................iii
Report Summary ...................................................................................................................S-1
CHAPTER I – INTRODUCTION AND BACKGROUND ����������������������������������������������������������������������1
Introduction ..............................................................................................................................1
CCUBS Main Users .................................................................................................................2
CCUBS Management and Support ..........................................................................................3
Audit Scope and Objectives ......................................................................................................3
Audit Methodologies .................................................................................................................4
Report Contents ........................................................................................................................5
CHAPTER II – CCUBS REQUIRES A COMPREHENSIVE MODERNIZATION STRATEGY ���������7
Introduction ..............................................................................................................................7
CCUBS Uses Obsolete Technology ..........................................................................................7
State Policy Requires Annual Evaluation of Information Systems ............................................8
ROI Analysis Best Practices Allow Variability Depending on the Situation .............................9
Replacing Traditional Revenue Calculation With Quantifying the Value of a System ...........10
Calculating ROI With Public Value .......................................................................................11
Using Procedural Costs to Determine Public Value ........................................................11
Public Value Factors ................................................................................................................12
Cost Avoidance ...............................................................................................................13
Cost Reduction & Public Value ......................................................................................13
Overall Public Value Determination for CCUBS ...........................................................15
Identifying Costs Associated With CCUBS ...........................................................................17
Contract Costs ................................................................................................................17
System Training Costs ....................................................................................................17
System Support Costs .....................................................................................................17
Negative Returns Are the Results of Obsolete Technology .....................................................18
Costs and Structures Vary Across States .................................................................................20
Obsolete Technology and Need for Continual Modernization ...............................................22
Modernization Needs to Be a Proactive Process ..............................................................23
CHAPTER III – CCUBS SECURITY RISK ASSESSMENT AND MANAGEMENT ��������������������������25
Introduction ............................................................................................................................25
Security Documentation Notes Key System Risk Decisions ...................................................25
DPHHS Has Established Security Roles and Responsibilities ................................................26
CCUBS’s Security Program Controls User Access but Lacks Monitoring Activity.................27
DPHHS Has Taken Steps to Address Security Risks at the Organizational Level .................28
Final Risk Assessment Procedures Need Action Plans and Timelines.....................................28
Authorization to Operate and Risk Mitigation Plan Procedures Need Accountability and
Follow-Through ......................................................................................................................29
DEPARTMENT RESPONSE
Department of Public Health and Human Services..............................................................A-1
19DP-04
ii Montana Legislative Audit Division
Figures and Tables
Figures
Figure 1 CCR&R Map ........................................................................................................................2
Figure 2 Three-Tier System Architecture ..............................................................................................7
Figure 3 Public Value Generated ........................................................................................................10
Figure 4 CCUBS Cost and Public Value Comparison by Year ..........................................................19
Figure 5 Other States .........................................................................................................................20
Figure 6 Modernization Strategy Graphic ..........................................................................................22
Figure 7 Risk Assessment Process .......................................................................................................25
Tables
Table 1 ROI Factors Table ................................................................................................................12
Table 2 Calculation for Average Cost Per System Managed Process .................................................14
Table 3 Public Value Estimations by Factor and Year .......................................................................16
Table 4 ROI Cost Table ....................................................................................................................18
iii
Appointed and Administrative Officials
Department of Public David Crowson, Chief Information Officer, Operation Services Bureau
Health and Human
Services Erica Johnston, Operation Services Branch Manager, Director’s Office
Jamie Palagi, Administrator, Early Childhood and Family Support Division
Patty Butler, Bureau Chief, Early Childhood Services Bureau
Chad Hultin, Internal Audit Bureau Chief, Operation Services Bureau
19DP-04

RepoRt SummaRy S-1
InfoRmatIon SyStemS audIt 19dp-04 decembeR 2020
Montana LegisLative audit division
Child Care Under the Big Sky (CCUBS)
System Modernization and Security
d p H H S
epaRtment of ublIc ealtH and uman eRvIceS

Background The Child Care Under the Big Sky (CCUBS) went live in
2002. As CCUBS technology ages and becomes obsolete,
risks to security increase and the system may not be a
In fiscal year 2019, the
cost-effective solution. By developing a modernization plan
Department of Public
for CCUBS and continually reviewing it, the agency can
Health and Human Services
understand if the value of CCUBS is maintained or if larger
(DPHHS) distributed over
replacement plans need to be engaged. This also needs
$25 million in childcare to coincide with ensuring that the final steps of security
scholarships to 5,700 risk assessment are completed to make sure maintenance
Montana families. The decisions coordinate with security needs. Improving these
final steps will ensure high risks within CCUBS are
Child Care Under the Big
addressed in a timely manner.
Sky system (CCUBS) helps
DPHHS determine and
KEY FINDINGS:
distribute childcare funds
The technologies used by CCUBS are becoming obsolete� However
and track and evaluate
DPHHS continues to use the system and update it as technologies become
childcare providers within unsupported� There is no annual review of consistent metrics to identify when
Montana. large-scale replacements are needed because CCUBS is no longer providing an
acceptable business value. Our analysis shows a recent transition into negative
return on investment as DPHHS pays for technologies to be updated.
Agency: While risk assessments and security plans are updated annually for
CCUBS, DPHHS does not have formal procedures in place to ensure
Department of Public Health
high risks are eliminated or reduced� We identified a high-risk security
and Human Services
concern within CCUBS in recurring risk assessments. There were no formal
remediation plans with timelines and milestones developed when the risk was
Administrator: initially identified. Therefore, the risk went unaddressed and was re-identified
Adam Meier in the next risk assessment.
RECOMMENDATIONS:
Division:
In this report, we issued the following recommendations:
Early Childhood and Family
To the department: 2
Support Division To the legislature: 0
(continued on back)
S-2
For the full report or more recommendation #1 (page 23):
Modernization Strategy Guidance
information, contact the
Develop a modernization strategy that plans around obsolete
Legislative Audit Division.
technologies, develops metrics for continual measurement of return
on investment, and tracks metrics on a yearly basis according to state
leg.mt.gov/lad policy.
Department response: Concur
Room 160, State Capitol
PO Box 201705
recommendation #2 (page 30):
Helena, Montana 59620
Risk Mitigation Policy
[phone] Develop and implement authorization to operate procedures and
establish quarterly review of timelines and processes for addressing
risks.
The mission of the
Legislative Audit Division
Department response: Concur
is to increase public trust
in state government by
reporting timely and accurate
information about agency
operations, technology, and
finances to the Legislature
and the citizens of Montana.
To report fraud, waste, or
abuse:
Online
www.Montanafraud.gov
Email
[email protected]
Call
(Statewide)
(800)-222-4446 or
(Helena)
(406)-444-4446
Text
[phone]