Angarai IVV Report September Summary

Maryland Health Benefit Exchange:
Independent Verification and Validation (IV&V) Services
Public Summary
Angarai International
Monthly IV&V Report
Report Month: September 2014
Delivery Date: October 15, 2014
A service of Maryland Health Benefit Exchange
Summary of September Findings
Immovable
Deadline
17%
System
Changes
1.
2.
3.
Transfer
System
The timelines are compressed and the
deadlines are fixed, as they are
mandated by 2015 Open Enrollment.
The system functions in Production
today. Only a small percentage of the
system (Deloitte Reports 17%) is being
modified for changes required by the
state of Maryland.
Program deliverables (CMS and
system), training materials, marketing
materials (website), project schedules,
timelines, and task lists, and test cases /
plans have been transferred from
Connecticut to Maryland and serve as
the basis for the system
implementation documentation.
September Reporting Activities
and Findings
 Because of the unique nature of the project –
a transfer system only a small percentage of
which is being modified for Open Enrollment
2015 .
 Angarai placed its attention to detail on the
Project Management structures and
oversight methodologies /techniques that the
Maryland Health Benefit Exchange (MHBE)
PMO had put into place.
 Angarai evaluated vendor management, and
vendor performance.
2
IV&V Findings – September 2014
September 2014 – Digging Deeper
For the September IV&V report, the objective was to continue to monitor the Project Management
Controls, vendor progress, and testing. Angarai had one new recommendation in the area of
communication.
Control
In
Place
In
Use
Effective
Adhering to
Best
Practices
IV&V
Recommendation
Vendor Management / Program Governance
Clear Lines of Authority
Project Management Monitoring Controls
Program-wide Risk and Issue Management
Standard Communication and Meetings
Management of Development / SDLC
Organizational Change Management / Training
Management of Critical Path Activities and Milestone Tracking
Management of the Integrated Program Schedule
Control and Oversight of Agreed-Upon Program Scope
Test Planning and Defect Management
3
IV&V Findings – September 2014
IV&V Finds:

NEW: MHBE is actively performing performance testing.

NEW: Xerox delivers Exceptional value and support.

NEW: MHBE has Robust Incident Management, helpdesk and Go-Live Planning

Monitoring: The MHBE PMO continues to be mature organization. The PMO has controls in place
and is utilizing them fully. Vendor oversight and performance and contract management is
continuous and thorough.

Monitoring: MHBE PMO continues to operates in recognized Industry Standards

Monitoring: Organizational and Business Process Change Management activities are key
contributors to project success. The MHBE PMO has dedicated considerable resources to OCM to
support the system so workers are trained and new processes are instituted to make their work
more efficient.

Monitoring: Deloitte health plan Carrier Management continues to be on track.

Monitoring: Xerox plan for the Production data center is robust and comprehensive .

Monitoring: CMS and MHBE communicate well and have good relations. CMS is supportive of
MHBE and the project.

Monitoring: Critical project milestones are constantly evaluated for dependencies and cross-team/
vendor impacts

Monitoring: Project Status communications are Frequent, thorough and timely.
4
IV&V Recommends – September 2014

Deloitte and Xerox need a RACI chart – Updated. IVV Recommended - MHBE PMO
formalize the roles and responsibilities of the two vendors in a RACI (responsible, accountable,
consulted, informed) matrix. As of the September report, the MHBE PMO staff has created a
draft RACI matrix.

MHBE would benefit from a Portfolio Management tool. - Updated. IV&V
Recommended the MHBE PMO’s may benefit from investment in a Portfolio Management
(PPM) tool. MHBE is considering tools, but has determined any implementation would occur
post go-live.

Deloitte does not always coordinate effectively with other vendors and MHBE.
IVV Recommends - Angarai recommends that Deloitte Executive Management bring the
right resources from across the firm and be receptive to expertise from other Vendors and
MHBE.

Deloitte Staffing fluctuates and changes are not always communicated timely. IVV
Recommends - Deloitte provide suggested staffing roll-offs to MHBE in writing no less than
15 days in advance for MHBE approval.

Deloitte Staffing fluctuates and changes are not always communicated timely. IVV
Recommends Deloitte provide suggested staffing roll-offs to MHBE in writing no less than 15
days in advance for MHBE approval.
5
Thank you!

Download Report