Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Leader: Radovic
PM EVM ACUMEN Validation & SurveillancePM EVM ACUMEN Validation & Surveillance
CENTER OF EXCELLENCECENTER ...
BUSINESSGROUP1DevelopedBUSINESSGROUP1Developed
Sub-Processes&ToolsSub-Processes&Tools
InheritedorInheritedor
PotentialTool...
  Process Process Lead Key Members
1 Schedule Health Assessment Manager 1 Consultant 1
2 Database to IMS Integration Consu...
Schedule
Health
Assessment
1 (ME-1)
Database to IMS
Integration
2 (ME+2)
EVMS
Validation –
CPR Metrics
4 (ME+4)
ACWP
Recon...
Purpose
 Establish standard processes, desktop procedures and technical
guides/manuals for BUSINESS GROUP 1/Company Progr...
Results to Date
 NASA Program X as a PAV demo program has implemented all
validation 6 processes
 Results of validation ...
Reference to PAV WBS Dictionary
1.1.4.2.6 Analysis Desk-Top Procedures:
 Assess requirements and develop detailed desk-to...
Reference to PAV WBS Dictionary
1.1.5.7 System (Tool) Documentation (6-Processes) to Document
and deliver the Commercial O...
1.1.5.7.1 Schedule Health Assessment
─ Critical Path Analysis
─ DCMA 14-pt Assessment
─ Other Mandated Analysis for SCM an...
1.1.5.7.2 Database to IMS integration
assessment
– PMT techniques
– % Complete
– Estimated and Baseline Start and Finish D...
Filter Column Named To get the following Results
Criteria (Select from
Filter list)
"Validation for All
Conditions for All...
IMS EVMS Validation Application for
Integration Created by Radovic
1.1.5.7.3 SOX ACWP Reconciliation
─ “SOX” CostPoint-to-Database Reconciliation
─ Implementation & Utilization of BUSINESS ...
SOX Reconciliation
1.1.5.7.4 EVMS Validation – CPR (Contract
Performance Reports)
─ MCS EVMS Compliance Criteria to include analysis and vali...
Orbital CA Level) Status Status Interpretation
Safety [CM: P=0,A>0][CM: S=0,A>0]
Actuals accumulate but no scheduled work ...
1.1.5.7.5 Analysis and Data Revision
─ Variance Analysis and Data Revision As Necessary (Repeat
Steps 2-5 if Correct)
─ To...
1.1.5.7.6 CPR DID/CDRL Compliance
─ Compliance To CDRL Data Item Description Requirements
─ Implementation & Utilization o...
Reference to PAV WBS Dictionary
1.4.1 Data Integration Validation
 In preparation for the Validation Review, an internal ...
To-Get to Do for PAV review
1. Desk-top instructions Standard Template
2. Technical Process Guide - Standard Template
3. O...
Upcoming SlideShare
Loading in …5
×

PM EVM ACUMEN CENTER OF EXCELLENCE Validation & Surveillance Jan 2010

PM Acumen EVM Center of Excellence - Validation & Surveillance - Jan 2010

PM Acumen EVM Center of Excellence - DCAA DCMA Validation & Surveillance
OrbitalATK Leader: Lana Radovic
Date: January 2010

Schedule Health and Risk Assessment
Database to IMS Integration
Sarbanes Oxley Reconciliation (SOX)
EVMS Earned Value Management Systems Validation – CPR Metrics
Analysis & Data Revision
CPR DID / CDRL Compliance

  • Login to see the comments

PM EVM ACUMEN CENTER OF EXCELLENCE Validation & Surveillance Jan 2010

  1. 1. Leader: Radovic PM EVM ACUMEN Validation & SurveillancePM EVM ACUMEN Validation & Surveillance CENTER OF EXCELLENCECENTER OF EXCELLENCE Jan 2010
  2. 2. BUSINESSGROUP1DevelopedBUSINESSGROUP1Developed Sub-Processes&ToolsSub-Processes&Tools InheritedorInheritedor PotentialToolsPotentialTools Schedule Health Assessment Critical Path 1 DCMA 14-pt Assessment Tools Owned Steelray Project Analyzer SSI Toolkit Macros Other STATE2Tech NASA Macro Database to IMS Integration 2 Estimated/Baseline Start/Finish Dates Tools Owned Database Error Report Database-to-IMS Validation “Death Match” Other BUSINESS GROUP 2 Integrity Checker Baseline/Estimated Remaining Work PMT / % Complete EVMS Validation – CPR Metrics 4 Tools Owned BUSINESS GROUP 1 B-Horse Other BUSINESS GROUP 2 C-Horse MCS EVMS Compliance ACWP Reconciliation 3 Tools Owned BUSINESS GROUP 1 “SOX” Reconciliation Excel Worksheet “SOX” CostPoint- to-Database Reconciliation Analysis & Data Revision 5 Tools Owned Other wInsight Reports & Artificial Intel. Format 5 VAR VAR Scorecard Rate Adjustment Analysis STATE2Tech CPR DID/CDRL Compliance 6 BUSINESS GROUP 1 EVMS Validation & Surveillance–Integrity Business Rhythm & ToolsetBUSINESS GROUP 1 EVMS Validation & Surveillance–Integrity Business Rhythm & Toolset Other Analysis for SCM and MCS Compliance Other Analysis Other BUSINESS GROUP 2 CPR Format 1,3,5 Compliance Worksheet Other Tools Owned BUSINESS GROUP 1 CPR Format 1,3,5 Compliance Worksheet BUSINESS GROUP 2 “SOX” Reconciliation Excel Worksheet Variance Analysis and Data Revision As Necessary (Repeat Steps 2-5 if Correct) Compliance To CDRL Data Item Description Requirements wInsight Analysis Reports VAR Corrective Action Log Checklists Checklist Checklist
  3. 3.   Process Process Lead Key Members 1 Schedule Health Assessment Manager 1 Consultant 1 2 Database to IMS Integration Consultant 1 DB Analyst, Process Lead 3 ACWP Reconciliation (SOX) Analyst 1 Analyst 2 4 EVMS Validation – CPR Metrics Process Lead All  5 Analysis & Data Revision Process Lead Analyst 3 6 CPR DID / CDRL Compliance Employee 1  All Al l BUSINESS GROUP 1 BUSINESS GROUP 2 EVMS Validation & Surveillance Radovic  All Approver Director BUSINESS GROUP 1 EVMS Validation & SurveillanceBUSINESS GROUP 1 EVMS Validation & Surveillance– Responsibility Assignment– Responsibility Assignment
  4. 4. Schedule Health Assessment 1 (ME-1) Database to IMS Integration 2 (ME+2) EVMS Validation – CPR Metrics 4 (ME+4) ACWP Reconciliation 3 (ME+4) Analysis & Data Revision (Repeat 2-5 If Nec) 5 (ME+5) CPR DID / CDRL Compliance 6 (ME+6) BUSINESS GROUP 1 EVMS Validation & Surveillance –BUSINESS GROUP 1 EVMS Validation & Surveillance – Monthly Data Integrity Business Rhythm with Month-End Target Completion DatesMonthly Data Integrity Business Rhythm with Month-End Target Completion Dates
  5. 5. Purpose  Establish standard processes, desktop procedures and technical guides/manuals for BUSINESS GROUP 1/Company Programs  Manage to established application of EVMS and PMI best practices via processes  PAV success  Consolidate and unify the way in which BUSINESS GROUP 1 programs are internally validated, analyzed and submitted for external audits  Lead by example - NASA Program X Program as a Demo Program
  6. 6. Results to Date  NASA Program X as a PAV demo program has implemented all validation 6 processes  Results of validation are being identified from month to month and corrective/preventive action taken  Some items are reoccurring by its nature and cannot be closed indefinitely i.e. AUW and related ACWP w/o BAC  Validation at the WP level related to actuals remains irrelevant for programs that collect actuals at the higher levels  Further efforts are invested in correcting the problems  Where no immediate action is possible explanations are provided and future plan for corrective action presented in the VARs  NASA Program X has exercised the validation in a timely fashion  Collaboration and pro-activity in multiple departments are necessary to fully comply and mitigate the risks of temporarily non-compliant items  Permanent solutions are necessary for reoccurring outliers
  7. 7. Reference to PAV WBS Dictionary 1.1.4.2.6 Analysis Desk-Top Procedures:  Assess requirements and develop detailed desk-top procedures to support Analysis.  One or more desk-top procedures may be required, focused on process steps and the applicable roles and responsibilities within that process step.  These desk-top procedures will provide the day-to-day instruction to the task(s) performer on the effort and methodology to achieve the goal of the desk-top procedure.
  8. 8. Reference to PAV WBS Dictionary 1.1.5.7 System (Tool) Documentation (6-Processes) to Document and deliver the Commercial Off The Shelf (COTS) manual for Data Integrity tools developed in conjunction with 6-step BUSINESS GROUP 1 EVMS Surveillance Process examining data integrity to include: 1.1.5.7.1 Schedule health assessment 1.1.5.7.2 Database to IMS integration assessment 1.1.5.7.3 SOX ACWP Reconciliation 1.1.5.7.4 EVMS Validation – CPR (Contract Performance Reports) 1.1.5.7.5 Analysis and Data Revision 1.1.5.7.6 CPR DID/CDRL Compliance
  9. 9. 1.1.5.7.1 Schedule Health Assessment ─ Critical Path Analysis ─ DCMA 14-pt Assessment ─ Other Mandated Analysis for SCM and MCS Compliance ─ Tools Implementation & Utilization: – Steelray – Project Analyzer – SSI Toolkit – Macros – Checklists
  10. 10. 1.1.5.7.2 Database to IMS integration assessment – PMT techniques – % Complete – Estimated and Baseline Start and Finish Dates – Estimated and Baseline Remaining Work – Other Analysis – Tools Implementation & Utilization: • Database Error Report • Database-to-IMS Validation “Death Match” Example: STATE 1maindataTransferradovicAll CAMs-NASA Program X IMS vs Database integration validation MAR09 data MAIN.xls STATE 1maindataTransferradovicAll CAMs-NASA Program X IMS vs Database integration validation APR09 data MAIN.xls • Checklist
  11. 11. Filter Column Named To get the following Results Criteria (Select from Filter list) "Validation for All Conditions for All WPs" To get WPs with all mismatched areas "Check WP" CAM To your specific CAM Cam Name - e.g."GICK" All Dates Validations To filter only date related mismatches "Check Dates" All Filter Column Named To get the following Results Button Name (CLICK) "Validation for All Conditions for All WPs" To get WPs with all mismatched areas Filter All Deltas All Dates Validations To filter only date related mismatches Filter All Dates Deltas All To get any results or to filter; Filter must be ON Filter On/ Off (must be on) How to filter manually: How to filter using Buttons - Macros Must Be ENABLED To get any results or to filter; Filter must be ON (either use button "Filter On/ Off" or got select headers row ther go to menu and select Data then Filter then Autofilter)
  12. 12. IMS EVMS Validation Application for Integration Created by Radovic
  13. 13. 1.1.5.7.3 SOX ACWP Reconciliation ─ “SOX” CostPoint-to-Database Reconciliation ─ Implementation & Utilization of BUSINESS GROUP 1 “SOX” Reconciliation Excel Worksheet as a primary tool
  14. 14. SOX Reconciliation
  15. 15. 1.1.5.7.4 EVMS Validation – CPR (Contract Performance Reports) ─ MCS EVMS Compliance Criteria to include analysis and validity of ACWP, BCWP, BCWS, CV, SV, BAC, EAC, VAC etc. ─ Tools Implementation & Utilization: – BUSINESS GROUP 1 EVMS Validator - Artificial Intel. Example: STATE 1maindataBUSINESS GROUP 1NASA Program XA_Program Management16_Control_Account_MgmtCAM Notebook08.0 - Variance and EAC Analysis8.1 Variance AnalysisEVMS CPR Validiation02-09 CPR EVMS Validation NASA Program X - Action List Simple.xls – wInsight Analysis Reports – Checklists
  16. 16. Orbital CA Level) Status Status Interpretation Safety [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) TA Stop Work [CM: P=0,A>0][CM: S=0,A>0][100% Complete , A Grows] This task is 100% complete; however, actuals appeared in the current month (Subs? Material? Legging invoices? Anticipating addl. Budget - Submitting BCR? Rate or other adjustments?). WIL Emulator ACM [CM: P=0,A<0 -Transfer][CM: S=0,A<0]Verify why transfers have been performed and whether justified? WIL Emulator ATP [CUME:P=0,A>0][CUME: S=0,A>0]Cumulative scheduled work is zero, actuals are greater than zero - ahead of schedule? WIL Emulator VTR [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) dware in the Loop Emulator (HWIL) CO#12[CM: A=0,P>0][CUME: A=0,P>0] This task has no actuals both in the current month and cumulatively; however, performance was taken. Material? Missing accruals? fixing prior month performance? LOE? are Engineering [CM: P=0,A>0][CM: S=0,A>0][100% Complete , A Grows] This task is 100% complete; however, actuals appeared in the current month (Subs? Material? Legging invoices? Anticipating addl. Budget - Submitting BCR? Rate or other adjustments?). E Assessment and Repair [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) ecraft Integration [CM: P=0,A>0] Missing Performance. Forgot? Or Overstated in the prior months and waiting off? 2 Prelim ALAS Design [CM: P=0,A>0] Missing Performance. Forgot? Or Overstated in the prior months and waiting off? 2 Prelim Req Impact [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) AC3 PoD Loads [CM: P=0,A>0][CM: S=0,A>0][100% Complete , A Grows] This task is 100% complete; however, actuals appeared in the current month (Subs? Material? Legging invoices? Anticipating addl. Budget - Submitting BCR? Rate or other adjustments?). vionics IRD ROM [CM: P=0,A>0] Missing Performance. Forgot? Or Overstated in the prior months and waiting off? TM Spec & NPE IRD [CM: P=0,A>0] Missing Performance. Forgot? Or Overstated in the prior months and waiting off? hanisms - CO#12 [CM: P=0,A>0][CM: S=0,A>0][CUME:P=0,A>0][CUME: S=0,A>0][BAC=0,A<>0]No performance taken due to no budget; however, actuals accumulate - candidate for BCR or transfers of actuals ve Thermal Control and TPS [CM: P=0,A>0] Missing Performance. Forgot? Or Overstated in the prior months and waiting off? cture ALAS and Design - R2 [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) Aero Prelim Req Impact - R2 [CM: S=0,P<>0][CM: S=0,A>0] Current month scheduled iz zero, actuals are greater zero while performance is not 0. Fixing prior month performance in this month? Aerosciences - CO#12 [CM: A=0,P>0][CUME: A=0,P>0] This task has no actuals both in the current month and cumulatively; however, performance was taken. Material? Missing accruals? fixing prior month performance? LOE? uidance, Navigation and Control (GN&C) [CM: P=0,A>0] Missing Performance. Forgot? Or Overstated in the prior months and waiting off? GN&C - CLA-5a CO#11 [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) strial Safety - CO#12 [CM: A=0,P>0][CUME: A=0,P>0] This task has no actuals both in the current month and cumulatively; however, performance was taken. Material? Missing accruals? fixing prior month performance? LOE? bility, Maintainability and Supportability (RMS)[CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) ability, Maintainability and Supportability (RMS) CO#1[CM: A=0,P>0][CUME: A=0,P>0] This task has no actuals both in the current month and cumulatively; however, performance was taken. Material? Missing accruals? fixing prior month performance? LOE? ware and Software Quality Assurance [CM: P=0,A>0][CM: S=0,A>0] Actuals accumulate but no scheduled work in the current month therefore no performance taken in the current month (ahead of schedule?) dware and Software Quality Assurance - CO#12[CM: A=0,P>0][CUME: A=0,P>0] This task has no actuals both in the current month and cumulatively; however, performance was taken. Material? Missing accruals? fixing prior month performance? LOE? 1.1.5.7.4 EVMS Validation – CPR (Contract Performance Reports)
  17. 17. 1.1.5.7.5 Analysis and Data Revision ─ Variance Analysis and Data Revision As Necessary (Repeat Steps 2-5 if Correct) ─ Tools Implementation & Utilization: – wInsight Reports & Artificial Intel. Format 5 VAR – Rate Adjustment Analysis Examples: VAR Scorecard – VAR Corrective Action Log
  18. 18. 1.1.5.7.6 CPR DID/CDRL Compliance ─ Compliance To CDRL Data Item Description Requirements ─ Implementation & Utilization of BUSINESS GROUP 1 CPR Format 1,3,5 Compliance Worksheet ─ Checklists example: STATE 1maindataBUSINESS GROUP 1NASA Program X-ARESDataNASA Program X-BUSINESS GROUP 1 PAVDCAA EVMS AuditDCAA EVMS Data Drop Index_Aug09.xls
  19. 19. Reference to PAV WBS Dictionary 1.4.1 Data Integration Validation  In preparation for the Validation Review, an internal audit will be conducted of the Demonstration Program to demonstrate preparations are complete, or to identify any weaknesses and associated corrective actions that may be required with sufficient time to allow response. This step will include a full data integrity check of all EVMS-related data from the Demonstration Program that will be subject to DCMA review. This will include: • Data traces of scope, schedule and cost from contract documents through Control Account Plans and detailed plans • Verification of Change Requests and Baseline Management practices through the validation of actual Program Baseline Change Requests • Data traces of performance reporting, from the CAM through Business Operations and into the monthly reports.
  20. 20. To-Get to Do for PAV review 1. Desk-top instructions Standard Template 2. Technical Process Guide - Standard Template 3. Other Process Guides - Standard Templates 4. Requirements & Specifications - Standard Template 5. Application Guide - Standard Template 6. Centralized Data-drop Location on the server

×