PS-2 Verify that open pathways of communication exist among all project stakeholders. PS-3 Verify that agency sponsor has bought-in to all changes that impact project cost, schedule or performance. Management Assessment MA-1 Verify that lines of reporting and responsibility provide adequate technical, financial and managerial oversight of the project. MA-2 Evaluate project progress, resources, budget, schedules, and reporting. MA-3 Assess coordination, communication and management, to verify agencies and departments are not working independently of one another. Project Management PM-1 Verify that a project management plan exists and that the plan is followed. PM-2 Evaluate the project management plan maintenance procedures to verify that they are developed, communicated, implemented, monitored and complete. PM-3 Evaluate project reporting processes, procedures, and actual project reports to verify that project status is being accurately traced using project metrics. PM-4 Verify that milestones and completion dates are planned, monitored, and met. PM-5 Verify the existence and institutionalization of an appropriate project issue tracking mechanism that documents issues as they arise, enables communication of issues to proper stakeholders, documents a mitigation strategy as appropriate, and tracks the issue to closure. PM-6 Evaluate the status of the schedule being reported for the project on the Commonwealth IT Project Schedule. PM-7 Verify that the Critical Path Milestones described for the project on the Commonwealth IT Project Charter are those approved by Agency Management, including the date when the Critical Path Milestones received approval from Agency Management. PM-8 Evaluate the system’s planned life-cycle development methodology or methodologies (waterfall, evolutionary spiral, rapid prototyping, incremental, etc.) to see if they are appropriate for the system being developed. PM-9 Evaluate the status of each Measure of Success being reported for the project on the Commonwealth IT Project Status Report. PM-10 Verify that the Measures of Success for the project incorporate input from the system’s users and customers. PM-11 Verify that the Internal Agency Oversight Committee (IAOC) has approved the Measures of Success, including the date when the Measures of Success received approval from the IAOC. PM-12 Determine if the project has remained within its approved scope. PM-13 For each change in the approved scope of the project verify the date the change was approved and by whom.
Training Review Area IV&V Task # Task Description Applicable (X) UTD-1 Review and make recommendations on the training provided to product users. Verify that sufficient knowledge transfer occurs for the maintenance and operation of the new product. UTD-2 Verify that training for users is instructor-led and hands-on and is directly related to the business process and required job skills. UTD-3 Verify that user-friendly training materials and help desk services are easily available to all users. UTD-4 Verify that all necessary policies, processes, and documentation are easily available to UTD-5 Verify that all training is given on time and is evaluated and monitored for effectiveness, with additional training provided as needed. Developer Training and Documentation DTD-1 Review and make recommendations on the training provided to system developers. DTD-2 Verify that developer training is technically adequate, appropriate for the development phase, and available at appropriate times. DTD-3 Verify that all necessary policies, processes and standards documentation are easily available to developers. DTD-4 Verify that all training is given on time and is evaluated and monitored for effectiveness, with additional training provided as needed. Requirements Management Review Area IV&V Task # Task Description Applicable (X) REQ-1 Evaluate and make recommendations on the project’s process and procedures for managing requirements. REQ-2 Verify that system requirements are well defined, understood and documented. REQ-3 Evaluate the allocation of system requirements to hardware and software requirements. REQ-4 Validate that software requirements can be traced through design, code and test phases to verify that the system performs as intended and contains no unnecessary software elements. REQ-5 Validate that the relationships between each software requirement and its system requirement are correct. REQ-6 Verify that requirements are under formal configuration control. Security and Privacy Requirements SPR-1 Evaluate and make recommendations on project policies and procedures for ensuring that the system is secure and that the privacy of client data is maintained. SPR-2 Evaluate the project’s restrictions on system and data access. SPR-3 Evaluate the project’s security and privacy risk analyses.
Data Management Review Area IV&V Task # Task Description Applicable (X) DC-1 Evaluate the agency’s existing and proposed procedures and software for data conversion. DC-2 Verify that procedures are in and are being followed to review the converted data for completeness and accuracy and to perform data cleanup as required. DC-3 Determine conversion rates and if the error rates are manageable. DC-4 Make recommendations on making the conversion process more efficient and on maintaining the integrity of data during the conversion. Database Design DBD-1 Evaluate new and existing database designs to determine if they meet existing and proposed system requirements. DBD-2 Recommend improvements to existing designs to improve data integrity and system performance. DBD-3 Evaluate the design for maintainability, scalability, concurrence, normalization appropriate) and any other factors affecting performance and data integrity. DBD-4 Evaluate the project’s process for administering the database, including backup, recovery, performance analysis and control of data item creation. Operating Environment Review Area IV&V Task # Task Description Applicable (X) SH-1 Evaluate new and existing system hardware configurations to determine if their performance is adequate to meet existing and proposed system requirements. SH-2 Determine if hardware is compatible with the agency’s existing processing environment, if it is maintainable, and if it is easily upgradeable. This evaluation should include, but is not limited to CPUs and other processors, memory, network connections and bandwidth, communication controllers, telecommunications systems (LAN/WAN), terminals, printers and storage devices. SH-3 Evaluate current and projected vendor support of the hardware, as well as the agency’s hardware configuration management plans and procedures. System Software SS-1 Evaluate new and existing system software to determine if its capabilities are adequate to meet existing and proposed system requirements. SS-2 Determine if the software is compatible with the agency’s existing hardware and software environment, if it is maintainable, and if it is easily upgradeable. This evaluation should include, but is not limited to, operating systems, middleware, and network software including communications, file-sharing protocols, etc.