Earned Value: Fun with Numbers or Real Management Data – Answers (part 2)

This is the second in a two part article on Earned Value: Fun with Numbers Part 1 / Answers

Answers: Earned Value terms used in the context of this article

Earned Value: Fun with numbers pt 2

Management Reserve

Correct Answer: N

  • In the Earned Value Management System (EVMS) vernacular, Management Reserve (MR) is the budget set aside for Known Unknowns – not Unknown Unknowns. This distinction is important, as the budget at complete (BAC) plus MR equals the Contract Budget Base (CBB).
  • Management reserve is typically used when an identified risk is realized (Known Unknowns). Once a risk has become a reality, such as re-work, re-test, re-make, more lines of software required, etc., the newly identified work required to satisfy the existing contract SOW must be scheduled and resource loaded (BCWS). This additional budget must be distributed to a CAM (or CAMs) via a work authorization document. The source for this budget is MR and not UB, as UB must have previously been logged with a predetermined budget and associated SOW.
  • While the Unknown Unknowns could be estimated using simulations, models, etc., the project does not have the luxury to have such a budget set aside initially for an Unknown Unknown occurrence. If an Unknown Unknown becomes a Known, thus the newly identified risk becomes reality, the contractor could use the existing MR to budget this newly identified task or tasks to satisfy the contract requirement or prepare a change proposal for their external customer.
  • When there is no MR, the contractor could implement an Over Target Baseline (OTB) in the event newly identified risks are realized with prior customer approval, as there is usually insufficient MR remaining.

Schedule Variance

Correct Answer: G

  • Schedule Variance (SV) = BCWP – BCWS

–      The resulting answer will identify the schedule position on the program, a negative answer indicates a behind schedule condition some or all of the program tasks. A positive result indicates an ahead of schedule condition for some or all of the program tasks.
–      Always use this information to supplement the Program Schedule tools data which uses actual days/week/months to identify the programs schedule position.

Budget At Completion

Correct Answer: D

  • The total contract value of all the time phased planned work

Contract Budget Base/Contract Target Cost

Correct Answer:M

  • The total contract value of all the time phased planned work, plus Management Reserve

Budgeted Cost for Work Scheduled

Correct Answer:A

  • The Budgeted Cost for Work Scheduled, or BCWS, is the time phased value expressed in hours and/or dollars for all of the authorized budgeted work scheduled to be accomplished on a program. This is the time phased baseline from which all work performed is measured.

Schedule Slip

Correct Answer: J

  • The amount of time/duration that the planned completion dates have been missed by, the total number of days/weeks/months that an activity is behind to the original baseline dates.

 Variance At Completion

Correct Answer: I

  • Variance at Completion (VAC) is the difference between the Budget at Completion (BAC) and the Estimate at Completion (EAC).  VAC can be calculated at any level from the control account up to the total contract. It represents the amount of expected overrun (negative VAC) or underrun (positive VAC)
  • The VAC is computed by subtracting the EAC from the BAC. A negative result is unfavorable indicates the tasks being measured are forecasting an overrun at completion. A positive result is favorable indicates the tasks being measured are forecasting an underrun at completion.

Estimate At Completion

Correct Answer: F

  • The Earned Value Guidelines define the EAC as the sum of the contracts cumulative to date Actual Cost of Work Performed (ACWP) plus the company project manager’s best estimate of the time-phased resources (funds) required to complete the remaining authorized work, the Estimate to Complete (ETC).  This relationship is often expressed by the formula EAC = ACWP + ETC.  Thus, the EAC is a forecast of the project’s final cost.  The project manager may revise work priorities, replan remaining tasks on the project schedule and/or adjust the technical approach to complete the project’s goals within the estimated remaining resources.  The goal is to complete all of the contract work scope within the Contract Budget Base–CBB(cost) and Contract Completion Date–CCD (schedule).

Actual Cost of Work Performed

Correct Answer: B

  • The costs actually incurred and recorded in accomplishing the work performed on the program. The costs include Labor, Material/ Sub-Contracts, Other Direct Costs (ODC) and the associated Indirect costs applied to each category.

Estimate To Complete

Correct Answer: E

  • The Estimate to Complete (ETC) is the company project manager’s best estimate of the time-phased resources (funds) required to complete the remaining authorized work.

Cost Variance

Correct Answer: H

  • Cost variance (CV) which is calculated as BCWP minus ACWP.  A result greater than 0 is favorable (an underrun), a result less than 0 is unfavorable (an overrun).

Program Overrun

Correct Answer: O

  • The difference between the total Budget and the Estimated Costs at Completion, a negative number indicates an overrun to the program. (A positive number indicates an underrun to the program)

Time Now

Correct Answer: L

  • Time Now is the end of the current (and cumulative to date) period that the data is being measured against.

Budgeted Cost for Work Performed

Correct Answer: C

  • The Budgeted Cost for Work Performed (BCWP) is the value of work completed based on the value of the BCWS assigned to that work. This is equal to the sum of the budgets for completed work

Forecasted Program Schedule Slip

Correct Answer: K

  • The total number of days/months that the program is estimating the completion date of all authorized efforts will exceed the planned Contract Completion Date (CCD). Compare the CCD date to the Estimated Completion Date (ECD)

Estimated Completion Date

Correct Answer: P

  • The estimated date that all authorized efforts will be completed.

Discussion of the displayed data

The Program began in January, the Time Now (L) is June or approximately 6 months into the effort. There are unfavorable Schedule (G) and Cost (H) Variances. The program was planned (BCWS-A) to complete in March. The Current Estimated Completion Date–ECD (P) is June which indicates a 3 month Forecasted Program Schedule Slip (K). The Budget At Completion (D) Was about $39M (including Management Reserve –MR (N), the Estimate At Completion–EAC (F) is about $56M resulting in a Program Overrun (O) of  $17M.

As you can see, selecting key measurement data metrics empowers the program manager with the information to estimate the impacts of early trends in the program. Using the data from analytical tools such as “EMPOWER” allows the program manager to evaluate the current status and develop corrective action and mitigation plans to help minimize the impacts to the overall contract and keep all customers aware of possible outcomes.

We hope you found this two part article on Earned Value: Fun with Numbers useful. Feel free to share or call Humphrey’s & Associates for more information. 

Earned Value: Fun with Numbers or Real Management Data – Answers (part 2) Read Post »

Earned Value: Fun with Numbers or Real Management Data? Part 1

The modern day EVMS engine can provide massive amount of data that often can overwhelm the users. There are some key data points that when developed and reported properly will provide excellent information to the program team so they can focus on the most critical cost/schedule/technical issues.

The most successful EVMS implementations have selected the best data and indices for their programs and use them as a key element in their management tool box.

The following graph depicts a well-balanced selection of Earned Value data that provides key information for making management decisions. How many of the points can you identify and do you know the data each provides? Match each letter with the appropriate terms listed below.

Fun with numbers 1

Fun with numbers 2

Check back for the next installment in two weeks for the correct terminology and for a brief description on what they mean in managing your programs. Earned Value: Fun with Numbers or Real Management Data – Answers (Part 2)

Earned Value: Fun with Numbers or Real Management Data? Part 1 Read Post »

Exact or Accounting Dates For Baseline Planning & Forecasting to Estimates to Complete – A Survey

Exact or Accounting for Baseline ReviewThe EVMS Guidelines, and other guidance, are not specific as to whether exact dates must be used to demonstrate system integration between the Work Authorization Document (WAD), Integrated Master Schedule (IMS) and Control Account Plan (CAP), or whether the use of accounting month start and complete dates meets the spirit and intent of the EIA-748 requirement.

To determine the industry trend, a survey was conducted regarding which dates contractors are using in the authorization, schedule and cost systems.

Background 

Some organizations view the Work Authorization Document (WAD) as the most important EVMS related document in their business management system because it is absolute proof that technical/schedule/cost information comes together in one place. For that reason exact dates are placed on WADs so that charge numbers are not opened before their schedule requires them to be open.

Other organizations are not so precise. They merely enter the first day of the accounting month that an effort is scheduled to commence. Some customer review teams insist on exact dates or they cite noncompliance with EIA-748. Survey participants were asked which dates, exact or accounting month start and complete, are entered in the cost, schedule and work authorization documents to demonstrate system integration. Participants were also asked about exact dates versus accounting month dates for Estimates to Complete (ETC) forecasts, and whether Level of Effort (LOE) tasks were planned in the schedule to obtain full resource loading of their projects.

Results

Fifteen (15) contractors responded to the survey and the results are displayed in the table below.  For all 15, the IMS was populated with exact dates for the baseline and current forecast.

  • Eleven (11) contractors used exact dates in the WADs and cost tool baselines and forecasts, thus matching the IMS.
  • Three (3) contractors consistently used the accounting month start and complete dates for the WAD baseline and cost tool baseline and forecast dates.
  • One contractor (Contractor 4) populated the WADs with accounting month dates while exact dates were used in the schedule and cost tools.  This contractor indicated that the WADs are being changed to reflect exact actual dates to match the IMS and cost tool and that this was a resource consuming endeavor.

 Baseline Planning & Forecasting to Estimates to Complete

Conclusion

From comments received, the contractors surveyed which use exact dates believe doing so was necessary to demonstrate cost and schedule integration.  They also indicated that increased sophistication of cost and schedule tools has made using exact dates much easier than it may have been in the past.  Because most of the tools used are able to accommodate exact date integration, it is now recommended that wherever possible, those dates be used in the work authorization, schedule and cost systems.

It is also recommended that changing the WAD dates based on actual start and completion dates is not a logical use of resources in that the schedule and cost tools capture actual performance and the WAD is generally a document that represents the baseline.

For more information about utilizing exact or accounting dates for baseline planning and forecasting to ETC for your projects, call Humphrey’s & Associates today.

Humphreys & Associates 35+ years in the EVM community

Exact or Accounting Dates For Baseline Planning & Forecasting to Estimates to Complete – A Survey Read Post »

Executive Level Schedules: Humphreys & Associates Methodology for Top Level Program Schedule Road-Mapping

Humphreys & Associates IPMRMethodology for Top Level Program Schedule Road-Mapping

The lack of a useful, concise, easily understood top level plan for a project is an issue that our consultants have repeatedly noted. It is way past time for the adoption of more useful and understandable executive level schedules. Having a distinctive top level plan linked to the lower level Integrated Master Schedule (IMS) planning can help differentiate one approach or one project from another.

With the advent of modern scheduling software such as Microsoft Project or Primavera, we have been assisting clients in developing more and more complex Integrated Master Schedules. However, a bigger and more complex IMS does not make the project plan any more accessible or understandable. In fact, it makes having an attractive and useful top level schedule more important.

The Data Item Description (DID) that governs the IMS, the Integrated Program Management Report (IPMR) DI-MGMT-81861, requires a Summary Master Schedule and describes it as:

3.7.1.3.2 Summary Master Schedule. A top-level schedule of key tasks/activities and milestones at the summary level which can be sorted by either the Work Breakdown Structure (WBS) or IMP structure (if applicable). It shall be a vertically integrated roll up of the intermediate and detailed levels within the IMS.

The Planning & Scheduling Excellence Guide (PASEG) developed by the NDIA Program Management Systems Committee is a wonderful resource for schedulers. The guide discusses the Summary Master Schedule in a way that avoids specifying it is to be sorted either by WBS or by Integrated Master Plan (IMP) the way the data item description does. It also does not describe the top level as a roll up.  The PASEG describes the Summary Master Schedule as:

Summary Master Schedule – The Summary Master Schedule is ideally a one (1)-page schedule and may also be called a Master Phasing Schedule (MPS), Master Plan or Summary Schedule. As the highest, least detailed schedule, the program’s summary master schedule highlights the contract period of performance, program milestones, and other significant, measurable program events and phases.

The Program Team initially develops the program summary master schedule from the analysis of requirements data during the pre-proposal phase and similar past program efforts. The program team review and approve the program’s top-level schedule, which serves as a starting point in the Top Down planning approach (See Top Down vs. Bottom up Planning). This process continues until contract award to include any changes caused by contract negotiations.

Key components of summary master schedules could include significant items from the following list:

    • Key elements of contract work
    • Test articles
    • Deliverable hardware, software, and documentation
    • GFE/customer-furnished equipment deliveries
    • Key program and customer milestones/events over the life of the contract
    • Subcontract elements

The PASEG further describes the process for developing the Summary Schedule. H&A agrees that this process is the effective one for creating an executable plan. The process makes the top level summary schedule even more important. The process outlined by the PASEG is:

    1. Read and understand the RFP.
    2. Make a high level plan to meet the requirements of the RFP.
    3. Use the high level plan to guide the top-down development of the IMS. This includes building the milestones that represent the Integrated Master Plan (IMP) events, accomplishments, and criteria.
    4. Validate lower level planning back against the top down plan.

In addition to the Data Item Description and the PASEG, H&A suggests that the Summary Schedule have some specific attributes that make it useful. It should be:

    1. Complete – show the key milestones and the entire project top to bottom and across time at a level of condensation that makes sense and is natural to the project.
    2. Easy to read – graphically it should portray the plan in a visually pleasing way that is easy to read.
    3. Easy to follow – flowing from left to right and top to bottom in a sequence that follows the progression of the work of the project.
    4. Self-explanatory – it should tell the story of the project even if adding notes are needed to make the story stand out.

Because the graphics in the IMS tools do not provide those attributes, H&A most often sees clients building some sort of “cartoon” plan, manually drawn in Excel or PowerPoint, and used during the proposal phase until the IMS can be considered solid enough to start using the roll up in the IMS as a Summary Schedule. The problem with this approach is that it is not linked electronically to the IMS; it is not part of the IMS and the data in the two can easily become different.

 The maintenance of the cartoon version is continued in some cases or abandoned. When it is continued it involves labor effort to draw and redraw the plan based on changes and updates. Often the cartoon is abandoned and the roll up approach from the IMS tool takes over. At this point the top level executive type schedule no longer exists and the project plan is no longer readily accessible.

One of the main benefits of having an executive level summary schedule is that the program manager and team can easily tell the story of the project in a one page, coherent, easily understandable plan; and with the proposed methodology this summary schedule is linked to the IMS so the two do not become separated.

Looking at the two examples of a master schedule for the same project shown below, it is apparent that the first one is from Microsoft Project; it has the roll up look and feel to it. The summary bars do not really provide much information other than to indicate there is more information below.

The other example from the H&A methodology is a top level schedule that tells the story of the project in a form that flows the way the project does. It may be in WBS or OBS order but those may not be natural to the flow of the project.  This example is grouped in the order that displays the evolution of the project the way the team thinks of the project. The tie to the underlying IMS is built into the plan. Each milestone or bar on the top level represents one or more tasks within the IMS so a user can find the identification of the corresponding work in the depths of the IMS when needed.

Gantt Chart with Project Tasks
Click image to enlarge
Humphreys & Associates Road Map Chart
Humphreys & Associates Road Map Chart – click image to enlarge

H&A now has developed a methodology supported by commercially available software that follows the guidance of the NDIA Planning & Scheduling Excellence Guide (PASEG) and provides the ease of use and executive level visibility needed in a top level schedule. Now a project can have a useful and demonstrative top level schedule that drives the top down planning effort as recommended in the PASEG.

This methodology was recently used successfully in the aerospace industry to develop the top level executive schedule view that drove the planning of a proposed multi-billion dollar project and to tell the story of the proposed project convincingly. The benefits perceived in that instance were:

  • Enhanced communication with the customer – the story could readily be told on one page.
  • Enhanced communication with company executives – they could easily see what was being planned by the proposal team.
  • Top down planning from the proposal leadership into the Integrated Product Teams (IPTs) early in the proposal process when it counted most and kept all the teams focused on the same plan – everyone knew the plan.
  • Establishment of the System Engineering approach and the Technical/Program reviews as the key points in the plan.
  • Top down electronically linked planning into the Integrated Master Schedule (IMS) so that the development of the 5000 line proposed project schedule could be compared upward to constantly verify that the developing plan would support the top level plan.
  • Establishment of time-fences that alert proposal leadership when lower level plans were moving away from established time goals.
  • Rapid effective translation of the developing IMS into the understandable project plan – especially useful in planning meetings within the proposal teams.
  • Because the top level is linked to the lower level, it can be used in meetings to rapidly isolate and find sections of the lower level IMS relating to a particular topic – no more paging, filtering, and searching for a particular area of the project’s  IMS.
  • Proposal quality graphics that did not require artists or artwork to tell the story.

To learn more about the H&A top level project road-map methodology and other EVMS topics, visit our website or call us to discuss your project.  

Humphreys & Associates 35+ years in the EVM community

Executive Level Schedules: Humphreys & Associates Methodology for Top Level Program Schedule Road-Mapping Read Post »

Keeping the EVM Love Alive In Your Organization

,

Keeping the EVM loveAdmittedly, operating an Earned Value Management System (EVMS) in an organization can sometimes be like getting your kids to the dentist.  They know they have to do it, and they will even concede that it may be good for them, but it does not mean they have to like it.

Earned Value provides a framework for integrating the cost, schedule, and technical scope of your project, and is an exceptionally valuable tool for management and project status.  There are, however, a few strategies that can be employed in order to maintain a healthy system by motivating those who operate within the system to do so with a sense of ownership.

Keeping the EVM love alive can follow the simple formula of Push, Pull and Inform.

1)   Push:  Senior Management Must Use the Data and Demand Quality

Having those up the food chain demanding accurate and timely information can be a powerful “push” that maintains interest and focuses efforts on system health and quality.  Organizations where EVM is nothing more than a reporting requirement and is not used for decision making or conveyance of project status, will have a difficult time maintaining a healthy system.  Sometimes negative attitudes towards Earned Value can even start with the customer and flow down to the contractor.

The alternative is in companies in which it is apparent that EVM is deeply embedded in the projects’ culture.  In a multitude of forums, the language of Earned Value is used to describe the status and issues of the project.  In these companies you probably will not see only the obligatory EVM charts in project reviews, but instead see the concepts and outputs of the system used throughout project management.  If poor variance analyses, inaccurate Estimates at Completions (EAC), incomplete baselines, or lack of corrective actions are challenged by the entire chain of management, then chances are those problems will stop being problems and the organizations can begin relying on the information to manage effectively.

2)    Pull:  Keep the System Useful to the Users

A great deal of resources may be invested in an EVMS, and in organizations with a healthy and useful system the return on this investment can be substantial.   Organizations that employ toolsets with timely and accessible reporting of project information help combat the belief that EVM is just a one-way reporting process.  A common interface for data is an “EVM Cockpit”, or some other tool set or reports that make the information easy to access for day-to-day management purposes.  The flip side of this are systems that make data accessibility difficult, or the problems of the system cause the data to be unreliable for prompt decision making purposes.  For example, one of the more important processes in an EVMS is variance analysis; however, when a great deal of time and effort is spent explaining variances that are not related to project performance, it becomes a significant drain on the attitude towards the system.

It is also important that the critical processes of the system are easy to use and understand.  These processes include project baselining, updates to the Estimate to Complete (ETC), statusing the Integrated Master Schedule (IMS), incorporation of changes, preparing variance analyses, and tracking of corrective actions.  Decisions regarding the architecture of the toolsets supporting these processes can significantly impact the attitudes of system users.  In addition, developing tool sets that eliminate the redundancy of data inputs between the cost and scheduling systems can dramatically improve the quality of the Earned Value data.

3)   Inform:  Regular Communication and Continuous Education to the Project Teams are Critical

Like any important management system in an organization, it is important to continually inform and support those who operate within the EVM system.  There is an endless source of special topics and project notifications that can provide useful information to project teams, which will help maintain EVM knowledge and a healthy system.  Some topics, such as preparing quality variance analysis, thorough corrective actions, and valid ETCs, need routine refreshment.

Below are a few suggestions on ways to communicate within the organization:

  • Monthly Internal Newsletter: An excellent mechanism to convey important updates to EV processes or changes that pertain to the business and the industry. This gives employees a chance to keep up with the latest news and developments.
  • EV Blog:  By blogging regularly, an organization can develop themes that are specific to business issues the organization is experiencing. If there are many of the same questions repeated again and again, the blog can be used to answer those questions. This way, people can just refer to the blog if they have questions that are common.
  • Lunch & Learn Sessions: These sessions are an excellent way for all participants to gain further knowledge on a specific topic and ask questions in real time.  This becomes more advantageous as all participants benefit from the group discussion.
  • Quarterly Webinar: This is particularly beneficial for organizations that may have multiple facilities located throughout the country. Specific subjects would be applicable to all sites. All participants, regardless of location, can attend and benefit.
  • Annual Quiz: This is a great way to gauge how well employees are grasping and using EVM. Questions would be centered on topics relating to events that occurred during the year. The quiz could be recurring and mandatory in the same manner as ethics and sexual harassment training.

For more information about keeping the EVM love alive in your organization give us a call at Humphreys & Associates, Inc. We are happy to answer questions.

Keeping the EVM Love Alive In Your Organization Read Post »

Corrective Action Response: Planning and Closure – Part 2 of 2

, , , , , ,

Review Part 1 of Corrective Action Responses addresses Planning and Closure


Responding to a Corrective Action Request (CAR)– Planning and Closure

It is important that the contractor develop a disciplined, standardized approach for responding to a corrective action response.  This not only helps ensure that the responses are complete and contain compliant corrective actions, but that they also represent the position of the entire contractor team.  Below are nine suggested steps for successful Corrective Action Plan (CAP) development.

1)    Review the DRs/CARs with the customer

Prior to developing a corrective action in response to a Corrective Action Request (CAR), the first step is to ensure that both parties, the contractor and the review team, have a mutual understanding of the finding.  This also serves to screen those findings that may have been the result of a misunderstanding with the data or an incorrect statement from a member of the contractor’s team.  It is also recommended that DRs/CARs with similar or duplicative findings be grouped together so that a single Corrective Action Plan (CAP) can be used to address the issue.  When doing this, it is imperative that this approach is communicated to the review team lead and the grouping strategy approved before beginning corrective actions.  This is generally an acceptable approach providing the CAP closures can be traced to the original findings.

2)     Organize for successful CAP management

Once a mutual understanding has been reached on the corrective actions, the contractor must then begin the process of correcting or mitigating the identified issues.  It is critical that the process of corrective action has the participation of key management and organizations that can affect change.  When there are a significant number of findings that are to be corrected, the establishment of a senior management Review Board is a recommended method for managing the process.  The roles of the board are:

    • Ensure a CAP is developed and supported by a structured CAR/DR resolution process;
    • Assign an individual from the responsible organization to lead the corrective action efforts;
    • Review the proposed schedule for the CAP, and monitor progress towards CAP closure;
    • Review and approve all CAR/DR root cause assessments and proposed corrective action including the closure criteria;
    • Serve as the primary point of contact with the Customer for CAR/DR resolution and closure.

3)     Begin a thorough Root Cause Analysis

A tempting direction at this stage is to allow for a quick fix of the identified issue.  This may be acceptable for “just fix it” types of findings such as typos, formula errors, incorrect data runs, etc.; but most findings require a more in-depth approach to ensure that the underlying drivers of the issue are being addressed.  Most organizations have employees who are specialized in root cause analysis, such as Six Sigma or LEAN process improvement advisers. This would be a good time to employ their skills.  Tools such as “The 5 Whys” and the Ishikawa Fishbone Diagram are excellent methods for identifying the root causes.  These tools and processes are extremely effective in uncovering the sources of the problem.

A customer review team often samples a subset of CAMs, processes, or data in its review because of a limited amount of time or resources.  It is often the case that a more thorough root cause analysis conducted by the contractor team will uncover additional issues that need to be addressed and corrected.   The contractor’s obligation to the customer is to provide full visibility regarding the corrective actions associated with those findings identified by the customer.  While it is important that all issues are corrected or mitigated, it is, however, the contractor’s choice to allow visibility into those issues that were not discovered by the customer review team.

4)     Develop and evaluate Corrective Action Plans

A single DR or CAR issued by a customer team may have numerous corrective actions identified in the solution process.  Often a single problem may have corrective actions that entail changes in processes, training, tools, or management approach, or any combination of all of these.  Regardless, it is important to identify corrective actions that will prevent recurrence of similar outcomes, and will not cause or introduce other new or additional problems.  One important benefit of including senior management in the CAP Review Board process is the capability to reach beyond the owners of a particular CAP to influence other stakeholders in the organization who have the responsibility to incorporate corrective actions or who may be impacted by the solutions being identified.

5)     Develop verification closure steps

It is critical that verification methods, objective measures, metrics, artifacts, and evidential products are identified that will verify that the corrective actions are effective.  This includes any exit criteria for any activities in the CAP Integrated Master Schedule (IMS), which is a schedule network that contains all the detailed work packages (including activities and milestones) and planning packages to support the events, accomplishments, and criteria of the Integrated Master Plan  (if applicable). It is directly traceable to the Contract Work Breakdown Structure (CWBS) and the contract statement of work. The IMS is critical to CAP success.  On data driven findings, the criteria for verification often involves producing several accounting periods of results as evidence that the corrective actions were effective.  The CAP Review Board is responsible for reviewing the status of the exit criteria, and verifying that the required objective measures have been satisfied.

6)     Develop a detailed Integrated Master Schedule for CAP implementation

A critical component of any project, including corrective action development and implementation, is a detailed IMS containing the project scope and the required dates of completion.  There should be a unique IMS for each CAP that includes:

    1. Root Cause Analysis
    2. Changes to processes, tools, training, and other required system adjustments
    3. Management Review and regular team meetings
    4. Responsibility assignment for each activity
    5. Development of products and artifacts which will demonstrate effectiveness
    6. Validation and Verification steps with Closure Criteria

Resource loading the IMS is an important process, as it communicates to the management team the required personnel to accomplish implementation of the Corrective Action Plans, and can serve as a commitment on its part to support the process until closure.  If there is a lack of available resources available to support the process, this may impact the completion dates established for the corrective actions.  All tasks should be logically networked (with predecessors and successors) without any constraints.  Progress should be based on a 0 to 100% scale without subjective interpretation.  As mentioned above, data validation normally requires several months of data submittals, and these deliveries should be milestones in the IMS.  Completion milestones should include notifying the customer of corrective action implementation and confirmation by the customer that the implementation is complete.  Each activity should also have fields which identify the CAR or DR number, the EV Process Area and Guideline, the responsible manager for the CAP, and a unique ID number for each task.

Reviewing the CAP IMS and the accomplishment status is a critical role of the CAP Review Board.

7)     Submit CAP and CAP IMS to the customer for approval prior to implementing the Corrective Actions

While some corrective actions may be straight forward responses to simple findings, it is important to reach a mutual agreement of the CAP approach prior to implementation.  Often the customer’s approval of the CAP is a required step before proceeding.  Important in this agreement is consensus on the artifacts and data sets that will be delivered, along with the timing of the deliveries.

One topic that may need to be addressed with the customer review team is a cutoff date for data corrections.  For example, it is important to reach agreement on the “as of” date for clean data, because changing historical data is usually an unnecessary step.  Occasionally a corrective action is delayed until a new contract modification is implemented or a new contract baselined before a correction can be implemented and verified.  These conditions need to be agreed upon with the customer prior to proceeding.

8)     Implement Corrective Action Plans and track progress to successful completion

One path to the escalation of a CAR to Level IV*, and possibly the introduction of Business System payment withholds, is the failure to successfully implement an agreed upon Corrective Action Plan.  Many organizations discover that the actual implementation of the approved corrective actions is the most difficult part of the process.  Sometimes a successful plan will include interim modifications or fixes in the short term, with long term changes identified as well.  If for example, the issue were with the integration between the  MRP and EVM systems, an interim solution may involve a change in the interface or translation of data between the systems while in the long term a replacement of the MRP is required.  It is important to have CAP solutions that not only mitigate the findings, but also can also be implemented in an acceptable period of time.

It is also important to meet interim commitments of data, processes, or any agreed to delivery of an artifact.  If the execution of a CAP will be delayed for any reason, this should be communicated quickly to the customer.

9)     CAR closure and follow-up

When the issuer of the CAR is satisfied that the contractor’s corrective actions are appropriate to prevent recurrence of the noncompliance, and the solutions have been verified to be effective, the contractor will be notified that the CAR is considered closed.  Even after closure, the areas identified as needing improvement are often targeted for periodic follow-on reviews; so it is important that management attention is maintained to sustain the corrective action.  A well organized and disciplined internal surveillance program is often the best safeguard against future discrepancy reports.

For more information about responding to Corrective Action Requests, contact our consultants at Humphrey’s & Associates.

*Link to part 1 of Corrective Action Response: Sources

Corrective Action Response: Planning and Closure – Part 2 of 2 Read Post »

Scroll to Top