CAR

In Earned Value Management, CAR is an acronym for “Corrective Action Request”

EVM Consulting | Corrective Action Response

, , , , , , ,

Corrective Action Response

How do I respond to a Corrective Action Request?

In EVM Consulting, we deal with Corrective Action Requests (CARs) on a regular basis, so we have plenty of real-world experience. We created an outline of valuable information about DRs / CARs based on our collective experience. Part 1 of the guide is designed to inform you of why CARs are received and who issues them, so you can work to prevent them. Part 2 will prepare you to respond to a CAR in an effective and efficient way.

Corrective Action Response: Sources – Part 1 of 2

In Part 1 of the series we illuminated the varied sources of Corrective Action Requests:
1) Standard Surveillance Instruction (SSI)
2) Agencies that do not use the DCMA for surveillance, such as the Department of Energy.
3) Integrated Baseline Review (IBR)
4) Procedures that are compliant with the EIA-748 Guidelines
5) Contract Performance Report (CPR)
6) Integrated Project Management Report (IPMR)
7) Integrated Master Schedule (IMS)
8) Discrepancy Reports (Levels I-IV)

 

Corrective Action Response: Planning and Closure – Part 2 of 2

In part 2 of the series, we addressed responding to a Corrective Action Request (CAR):
1) Review the DRs/CARs with the customer
2) Organize for successful CAP management
3) Begin a thorough Root Cause Analysis
4) Develop and evaluate Corrective Action Plans
5) Develop verification closure steps
6) Develop a detailed Integrated Master Schedule for CAP implementation
7) Submit CAP and CAP IMS to the customer for approval prior to implementing the Corrective Actions
8) Implement Corrective Action Plans and track progress to successful completion
9) CAR closure and follow-up

EVM Consulting | Corrective Action Response Read Post »

Corrective Action Response: Planning and Closure – Part 2 of 2

, , , , , ,

Review Part 1 of Corrective Action Responses addresses Planning and Closure


Responding to a Corrective Action Request (CAR)– Planning and Closure

It is important that the contractor develop a disciplined, standardized approach for responding to a corrective action response.  This not only helps ensure that the responses are complete and contain compliant corrective actions, but that they also represent the position of the entire contractor team.  Below are nine suggested steps for successful Corrective Action Plan (CAP) development.

1)    Review the DRs/CARs with the customer

Prior to developing a corrective action in response to a Corrective Action Request (CAR), the first step is to ensure that both parties, the contractor and the review team, have a mutual understanding of the finding.  This also serves to screen those findings that may have been the result of a misunderstanding with the data or an incorrect statement from a member of the contractor’s team.  It is also recommended that DRs/CARs with similar or duplicative findings be grouped together so that a single Corrective Action Plan (CAP) can be used to address the issue.  When doing this, it is imperative that this approach is communicated to the review team lead and the grouping strategy approved before beginning corrective actions.  This is generally an acceptable approach providing the CAP closures can be traced to the original findings.

2)     Organize for successful CAP management

Once a mutual understanding has been reached on the corrective actions, the contractor must then begin the process of correcting or mitigating the identified issues.  It is critical that the process of corrective action has the participation of key management and organizations that can affect change.  When there are a significant number of findings that are to be corrected, the establishment of a senior management Review Board is a recommended method for managing the process.  The roles of the board are:

    • Ensure a CAP is developed and supported by a structured CAR/DR resolution process;
    • Assign an individual from the responsible organization to lead the corrective action efforts;
    • Review the proposed schedule for the CAP, and monitor progress towards CAP closure;
    • Review and approve all CAR/DR root cause assessments and proposed corrective action including the closure criteria;
    • Serve as the primary point of contact with the Customer for CAR/DR resolution and closure.

3)     Begin a thorough Root Cause Analysis

A tempting direction at this stage is to allow for a quick fix of the identified issue.  This may be acceptable for “just fix it” types of findings such as typos, formula errors, incorrect data runs, etc.; but most findings require a more in-depth approach to ensure that the underlying drivers of the issue are being addressed.  Most organizations have employees who are specialized in root cause analysis, such as Six Sigma or LEAN process improvement advisers. This would be a good time to employ their skills.  Tools such as “The 5 Whys” and the Ishikawa Fishbone Diagram are excellent methods for identifying the root causes.  These tools and processes are extremely effective in uncovering the sources of the problem.

A customer review team often samples a subset of CAMs, processes, or data in its review because of a limited amount of time or resources.  It is often the case that a more thorough root cause analysis conducted by the contractor team will uncover additional issues that need to be addressed and corrected.   The contractor’s obligation to the customer is to provide full visibility regarding the corrective actions associated with those findings identified by the customer.  While it is important that all issues are corrected or mitigated, it is, however, the contractor’s choice to allow visibility into those issues that were not discovered by the customer review team.

4)     Develop and evaluate Corrective Action Plans

A single DR or CAR issued by a customer team may have numerous corrective actions identified in the solution process.  Often a single problem may have corrective actions that entail changes in processes, training, tools, or management approach, or any combination of all of these.  Regardless, it is important to identify corrective actions that will prevent recurrence of similar outcomes, and will not cause or introduce other new or additional problems.  One important benefit of including senior management in the CAP Review Board process is the capability to reach beyond the owners of a particular CAP to influence other stakeholders in the organization who have the responsibility to incorporate corrective actions or who may be impacted by the solutions being identified.

5)     Develop verification closure steps

It is critical that verification methods, objective measures, metrics, artifacts, and evidential products are identified that will verify that the corrective actions are effective.  This includes any exit criteria for any activities in the CAP Integrated Master Schedule (IMS), which is a schedule network that contains all the detailed work packages (including activities and milestones) and planning packages to support the events, accomplishments, and criteria of the Integrated Master Plan  (if applicable). It is directly traceable to the Contract Work Breakdown Structure (CWBS) and the contract statement of work. The IMS is critical to CAP success.  On data driven findings, the criteria for verification often involves producing several accounting periods of results as evidence that the corrective actions were effective.  The CAP Review Board is responsible for reviewing the status of the exit criteria, and verifying that the required objective measures have been satisfied.

6)     Develop a detailed Integrated Master Schedule for CAP implementation

A critical component of any project, including corrective action development and implementation, is a detailed IMS containing the project scope and the required dates of completion.  There should be a unique IMS for each CAP that includes:

    1. Root Cause Analysis
    2. Changes to processes, tools, training, and other required system adjustments
    3. Management Review and regular team meetings
    4. Responsibility assignment for each activity
    5. Development of products and artifacts which will demonstrate effectiveness
    6. Validation and Verification steps with Closure Criteria

Resource loading the IMS is an important process, as it communicates to the management team the required personnel to accomplish implementation of the Corrective Action Plans, and can serve as a commitment on its part to support the process until closure.  If there is a lack of available resources available to support the process, this may impact the completion dates established for the corrective actions.  All tasks should be logically networked (with predecessors and successors) without any constraints.  Progress should be based on a 0 to 100% scale without subjective interpretation.  As mentioned above, data validation normally requires several months of data submittals, and these deliveries should be milestones in the IMS.  Completion milestones should include notifying the customer of corrective action implementation and confirmation by the customer that the implementation is complete.  Each activity should also have fields which identify the CAR or DR number, the EV Process Area and Guideline, the responsible manager for the CAP, and a unique ID number for each task.

Reviewing the CAP IMS and the accomplishment status is a critical role of the CAP Review Board.

7)     Submit CAP and CAP IMS to the customer for approval prior to implementing the Corrective Actions

While some corrective actions may be straight forward responses to simple findings, it is important to reach a mutual agreement of the CAP approach prior to implementation.  Often the customer’s approval of the CAP is a required step before proceeding.  Important in this agreement is consensus on the artifacts and data sets that will be delivered, along with the timing of the deliveries.

One topic that may need to be addressed with the customer review team is a cutoff date for data corrections.  For example, it is important to reach agreement on the “as of” date for clean data, because changing historical data is usually an unnecessary step.  Occasionally a corrective action is delayed until a new contract modification is implemented or a new contract baselined before a correction can be implemented and verified.  These conditions need to be agreed upon with the customer prior to proceeding.

8)     Implement Corrective Action Plans and track progress to successful completion

One path to the escalation of a CAR to Level IV*, and possibly the introduction of Business System payment withholds, is the failure to successfully implement an agreed upon Corrective Action Plan.  Many organizations discover that the actual implementation of the approved corrective actions is the most difficult part of the process.  Sometimes a successful plan will include interim modifications or fixes in the short term, with long term changes identified as well.  If for example, the issue were with the integration between the  MRP and EVM systems, an interim solution may involve a change in the interface or translation of data between the systems while in the long term a replacement of the MRP is required.  It is important to have CAP solutions that not only mitigate the findings, but also can also be implemented in an acceptable period of time.

It is also important to meet interim commitments of data, processes, or any agreed to delivery of an artifact.  If the execution of a CAP will be delayed for any reason, this should be communicated quickly to the customer.

9)     CAR closure and follow-up

When the issuer of the CAR is satisfied that the contractor’s corrective actions are appropriate to prevent recurrence of the noncompliance, and the solutions have been verified to be effective, the contractor will be notified that the CAR is considered closed.  Even after closure, the areas identified as needing improvement are often targeted for periodic follow-on reviews; so it is important that management attention is maintained to sustain the corrective action.  A well organized and disciplined internal surveillance program is often the best safeguard against future discrepancy reports.

For more information about responding to Corrective Action Requests, contact our consultants at Humphrey’s & Associates.

*Link to part 1 of Corrective Action Response: Sources

Corrective Action Response: Planning and Closure – Part 2 of 2 Read Post »

Level Of Effort Decision Tree – Clarifying Source Articles

, , , , ,
Level Of Effort Decision Tree – Clarifying Source Articles

Updated January 20, 2021

 

Level of Effort Decision Tree – Introduction

If you have not read the LOE source articles, Level of Effort (LOE) Replanning and How to Avoid Corrective Action Requests Related to Level of Effort, it is necessary to read prior to these articles in order to have the context for the following subject matter.

Humphreys & Associates, Inc. prepared an article a couple of months ago in order to increase the awareness of Earned Value Management Systems (EVMS) reviews related to Level of Effort (LOE) replanning. This resulted in considerable attention because we did not adequately explain our intention.

We had hoped readers would recognize that there are many strong and diametrically opposed opinions on acceptable approaches to LOE replanning. An important point to remember is that the principal purpose of an EVMS is to provide adequate information from which to make logical, well-informed decisions based on the best data available.

Our article resulted in a request for the National Defense Industrial Association (NDIA) Integrated Program Management Division (IPMD) to address this topic in its EVMS Clearinghouse Working Group. The company that submitted the issue used one of the approaches that we listed, which led to a DCMA Discrepancy Report. Consequently, they were clearly concerned. To address that one issue would not have provided an intelligent approach – it would have resulted in even more concerns for other organizations. For that reason, we chose to provide an update to our article in the form of a “white paper.” We do not address the many approaches being employed, as some display thinking that is “way out of the box;” such as earning whatever the actual costs are – as opposed to the budget.

We chose to leave some of those approaches out of the options addressed below. One could almost conclude that we are observing the classic consultant response to some issues – “It depends.”

BACKGROUND

The distinctive feature of the Level of Effort (LOE) earned value technique is that it earns value through the passage of time with no consideration of any work being performed. Therefore, it can earn value with no incurrence of actual costs and incur actual costs without earning value. Both of these conditions are currently considered by some DCMA review teams as noncompliant to the EVMS Guidelines (#16 and/or #22) that could result in a DCMA issued Corrective Action Request (CAR).

This is usually not an issue for the typical LOE that is support to the entire project (e.g., project management, contract management, financial management, systems engineering, security, safety, etc.) because these efforts almost always start on time and only face a problem if the support extends past the contract baseline. However, it is frequently an issue for LOE that provides support to discrete efforts that could slip or be moved up for various reasons (e.g., test site availability, equipment failures, successes that eliminate future planned effort, etc.) if the LOE work is not allowed to be replanned to the time period where the discrete work is actually being performed.

The LOE baseline period of performance should match the discrete effort’s period of performance. While the discrete effort can occur early or late and have earned value and actual costs coincide, that is not necessarily true for the supporting LOE, because it earns its value as planned in the baseline regardless of when the work actually starts or when the actual costs are incurred. The examples below show the possible LOE conditions when discrete effort starts early, finishes early, starts late, and finishes late. Each condition trips a significant item of concern when the DCMA runs its diagnostics of a contractor’s EVMS data:

If the discrete effort starts early, and LOE is not allowed to replan, LOE incurs ACWP with no BCWP.

H&A 1 - LOE Decision Tree

If the discrete effort finishes early, the remaining months of LOE support earn BCWP with zero ACWP.

H&A 2 - LOE Decision Tree

If the discrete effort starts late, LOE earns value (BCWP) with no actual costs (ACWP).

H&A 3 - LOE Decision Tree

If the discrete effort finishes late, LOE incurs ACWP without accompanying BCWP because the BCWP now equals the BAC. However, when the support effort’s manager reports an EAC that includes the to-go LOE to report an accurate EAC, it creates the situation of EAC>ACWP with BCWP=BAC, again tripping a DCMA significant item of concern.

H&A 4 - LOE Decision Tree

These conditions have resulted in Corrective Action Requests (CARs) from some local DCMA representatives because they are identified as significant items of concern by the DCMA diagnostics. Unfortunately, the diagnostics applied to discrete work packages are also applied to LOE tasks. There is no consideration of the special circumstances associated with LOE in the diagnostic software being used by review teams.

It is important to note that LOE is often (erroneously) called a work package just like discrete effort is called a work package and, therefore, work package rules are automatically applied to LOE. But not all work package attributes apply to LOE. For example, LOE does not consist of discrete tasks, is not required to be of short duration, and does not measure performance. The special circumstances of LOE were recognized in 1991 by the Department of Defense issuance of the Performance Measurement Joint Executive Group (PMJEG)’s Supplemental Guidance to the Joint Implementation Guide (JIG) involving the Cost/Schedule Control Systems Criteria (C/SCSC). Section 3-6, Revisions, subsection b (Internal Replanning) specified special handling of LOE for the circumstances cited above. However, the JIG Supplemental Guidance has not been incorporated into current implementation guidance. Please note that some DCMA EVMS Center of Excellence personnel have stated that the 1991 JIG Supplemental Guidance is applicable to current guidance. This is the way it used to be and was understood by all. But that position has not been documented and distributed to DCMA field office personnel, resulting in different determinations as to which actions are allowable and which are not. Many DCMA field office EVMS personnel have never been exposed to the JIG Supplemental Guidance. Those that are aware of the 1991 JIG Supplemental Guidance or who would agree with the JIG Supplemental Guidance approach as being compliant tend not to create CARs for the same conditions, while, unfortunately, those who are not aware of the Guidance write CARs.

INTRODUCTION TO THE DECISION TREE

The following decision tree relies heavily on the JIG Supplemental Guidance for recommending actions to avoid CARs. It is organized in outline format with major sections being the four discrete effort status possibilities that can cause LOE to result in a CAR as shown above. The first sub-topic in each section is the supporting LOE condition that results in tripping a significant item of concern in the diagnostic software DCMA employs from the Data Call before arriving on-site. The second sub-topic provides a quotation from the PMJEG Supplemental Guidance to the C/SCSC JIG, Section 3-6 Revisions, Subsection b. Internal Replanning that applies to the identified condition. The third sub-topic provides suggestions on how to implement the guidance to avoid the condition. The following sub-topics provide the advantages, disadvantages, and reporting requirements for each avoidance action.

In presenting these actions we need to make the point that depending on the interpreter none of these or only some of these would be acceptable to a DCMA reviewer. We are merely attempting to bring forth the options observed so that many can consider which approach is best for them and then use simple examples to present their desires to their customers.

Note that JIG references to “cost account” apply to control accounts.

LEVEL OF EFFORT (LOE) DECISION TREE

OUTLINE

Discrete Effort Starts Early

  1. Condition that may result in a DCMA CAR
    1. The LOE BCWS does not start until a later period (cannot earn value in the current period).
    2. LOE has ACWP without BCWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(c).
      2. “Replan future LOE to correlate to the changes in work. LOE, whether planned in separate cost accounts or as part of predominantly discrete cost accounts, has additional flexibility and may be adjusted within the current accounting period without government approval, provided no actual costs (ACWP) have been charged to the LOE.”
      3. How to implement the Supplemental Guidance
        1. In the current accounting period, replan the LOE to begin in the current period.
        2. Determine whether the discrete effort’s early start will result in an early finish (length of the period of performance remains the same).
          1. If so, no BAC change should occur – only the shift in the BCWS.
          2. If not, either provide additional BAC from MR or re-spread the BAC over the revised future period of performance (often called the “peanut butter” approach).
  2. Advantage
    • Avoids the ACWP without BCWP condition.
  3. Disadvantage
    • Changes the baseline in the current period. If the local DCMA office is not aware of the Supplemental Guidance or knows about its existence but disagrees with it, a CAR may be issued. Also, some DCMA teams consider the stretching out of current budget over a longer period of time as creating “token budgets” – for which they have written CARs.
  4. Reporting requirement
    • Must be reported in Integrated Program Management Data and Analysis Report (IPMDAR) database for Format 5.

Discrete Effort Finishes Early

  1. Condition that may result in a DCMA CAR
    1. The discrete effort has finished early and if the LOE had not previously been replanned in anticipation of the early finish, no LOE support effort would be required for the remaining period(s) of the LOE BCWS that must still earn value.
    2. The LOE has BCWP without ACWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(b).
      2. “Replan incomplete future work and adjust the work package budget at completion (BAC) to reflect the change in accordance with normal replanning guidance…”
      3. How to implement the Supplemental Guidance
        1. Because the “incomplete future work” has been eliminated, close the LOE package. The BCWS will already be equal to the BCWP earned to date.
        2. Subtract the BCWP from the BAC and return the BCWR initially to the UB Log and subsequently to the MR Log.
        3. If this can be achieved in the period in which the discrete effort was completed, this is a change to the next accounting period, thus avoiding a change to the current period baseline.

        NOTE: There is another point to be made here. The LOE task was to support the discrete work scope no matter how long it took. If the discrete task finished early because its work scope was reduced, the LOE task requirement was also reduced and the above action is justified. If the discrete task simply finished early, this would be a cost variance in that it cost less to support the unchanged work scope. The above action would be done solely to avoid the BCWP without ACWP condition.

  2. Advantage
    • Avoids the BCWP without ACWP condition.
  3. Disadvantage
    1. If the change is made in the same period in which the discrete effort was completed (or a prior period), there is no disadvantage although some would argue that this approach would be “changing budgets based on performance” which is akin to using MR to hide true cost variances.
    2. If the change is made in the period subsequent to the completion of the discrete effort, the current period baseline will change. If this is a repetitive occurrence, it probably means that a contractor is constantly changing the baseline to avoid true cost variances; therefore, it may result in a DCMA CAR.
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5 (MR was increased).

Discrete Effort Starts Late

  1. Condition that may result in a DCMA CAR
    1. The discrete effort has not started (no ACWP or BCWP), hence no LOE was required. This results in zero ACWP for the LOE, but it does report BCWP because of the passage of time.
    2. The LOE has BCWP without ACWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(c).
      2. “Replan future LOE to correlate to the changes in work. LOE, whether planned in separate cost accounts or as part of predominantly discrete cost accounts, has additional flexibility and may be adjusted within the current accounting period without government approval, provided no actual costs (ACWP) have been charged to the LOE.”
      3. How to implement the Supplemental Guidance
        • In the current month replan the LOE to begin in the month that the discrete effort is currently scheduled to begin.
  2. Advantage
    • Avoids the BCWP without ACWP condition.
  3. Disadvantages
    1. Changes the baseline in the current period. If the local DCMA office is not aware of the Supplemental Guidance or disagrees with the Supplemental Guidance, a CAR may be issued.
    2. If the discrete effort recovers its schedule variance, the LOE will be put in the position of having BCWP yet to be earned with no LOE required (equivalent to the early finish condition presented below).
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5.

Discrete Effort Finishes Late

  1. Conditions that may result in a DCMA CAR
    1. The LOE incurs ACWP with no accompanying BCWP.
    2. The LOE incurs ACWP with no accompanying ETC, usually indicated by ACWP>EAC.
    3. Both of these are significant items of concern conditions.
    4. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(b).
      2. “Replan incomplete future work and adjust the work package budget at completion (BAC) to reflect the change in accordance with normal replanning guidance…”
      3. How to implement the Supplemental Guidance
        1. In or before the last period of performance of the LOE, replan the LOE to cover the extended discrete effort.
        2. Use one of two methods to provide budget for the additional effort:
          1. If ACWP is less than BCWP, recover budget from the previously earned LOE BCWP by using the single point adjustment technique of setting BCWS and BCWP equal to ACWP and replan the recovered budget (BAC minus BCWP) into the future.
          2. If ACWP is equal to or greater than BCWP, but less than BAC, replan the unearned budget (BAC minus BCWP) into the future.

        NOTE: Alternative to 3) implementing the Supplemental Guidance

        1. Allow the LOE package to complete without replanning, which results in accepting the ACWP without BCWP condition.
        2. To mitigate the severity of this approach, be certain to provide an ETC for the periods beyond the LOE baseline period of performance. This action would avoid an ACWP>EAC condition.
  2. Advantages
    1. Avoids the ACWP without BCWP condition.
    2. Avoids the ACWP>EAC condition.
  3. Disadvantage
    • There will be a baseline change in the current period. Because ACWP has occurred, the LOE exception to be able to make a change in the current period if no ACWP has been recorded does not apply. Therefore, a DCMA CAR may be issued.
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5.

Observations/RECOMMENDATIONS based on the foregoing:

  1. First and foremost, because many DCMA personnel are not familiar with the JIG Supplemental Guidance or may not agree with it (remember that the DCMA Center of Excellence has not formally confirmed that the JIG Supplemental Guidance remains in effect), contractors must determine the desired approach of the cognizant DCMA personnel for handling the LOE conditions noted above. Early discussions to determine acceptable approaches to the LOE special conditions will avoid many of the CARs/DRs being issued.
  2. Eternal vigilance is required. If a potential change in the performance period of the discrete effort becomes apparent sufficiently early, the change can be accomplished with little chance of incurring a DCMA CAR. This assumes that people recognize the right to change LOE in an “open LOE task”.
  3. The DCMA Center of Excellence must officially transmit additional guidance to the DCMA field offices to ensure consistent application of EVMS Guideline requirements to LOE.
  4. Some may suggest using the Apportioned Effort technique in lieu of LOE, but that would require that the supporting budget be estimated as a percentage of the discrete effort and its time-phasing be established at the same percentage as the time-phasing of the base. Usually, LOE budget is based on an average level of support that is inconsistent with or has a “loose” relation to the discrete package’s time-phasing.
  5. One alternative approach is to consider short duration (3-4 months) LOE for supporting discrete effort. An advantage to this approach is that while the first LOE in the series might incur a significant item of concern condition, the following efforts could be adjusted without penalty.
  6. Another alternative approach is to make the entire support effort a percent complete EVT work package with the Quantifiable Backup Data (QBD) being the milestones in the supported discrete effort.
  7. If the LOE has been reported as complete in the prior month, it has been suggested by some in the DCMA EVMS Center of Excellence that the LOE BCWP that has already been earned can be “harvested” to budget a continuation of the LOE past its original period of performance. This was not a consideration of the JIG Supplemental Guidance and most would argue that this approach is in direct conflict with Guideline 30. Contractors should not use this method unless it is formally approved by the DCMA EVMS Center of Excellence.

To contact Humphreys & Associates click here.

Level Of Effort Decision Tree – Clarifying Source Articles Read Post »

Scroll to Top