EVM for Biotech and Pharma – Part I Implementation and Training

, , , , , , , , , , , , ,

Updated December 13, 2017

 

EVM for Biotech and PharmaAs you know, the Earned Value Management System (EVMS) is a management process with characteristics that are absolutely logical to manage projects whether there is an external customer or not. The EVMS is also required by the Federal Government on DOD, DOE, FAA, NSA, DOT, DOJ, NASA, etc. contracts over $20M.

With the phasing in of the Affordable Health Care Act and recent funding for research and preparation in the event of bio-terrorism, other branches of the Government, such as Health and Human Services (HHS) and Biomedical Advanced Research and Development Authority (BARDA), are becoming more involved in the healthcare sector. Implementing and using EVMS is a baseline requirement for biotech and pharmaceutical firms awarded large contracts by the Federal Government.

This will require companies and universities that receive funding to understand and implement Earned Value Management and that key project personnel, including management and executives, will require high quality Earned Value Training.

Why EVM and Government Contracts

Earned Value Management has been used since the 1960’s and has become the standard by which the Government measures and evaluates the management and reporting processes on projects awarded to contractors. Initially, it was implemented on projects; such as the development of satellites, long-range missiles, fighter aircraft, etc., but has become the US Government’s gold standard to manage the technical, schedule and cost progress of projects and to identify and manage risk and opportunities.

In order for defense contractors to be eligible for large contracts, they are required to follow the 32 Guidelines of the EIA-748-C which can entail system design and development and a substantial learning curve. Earned Value Management company-wide training and proper implementation becomes critical for project efficiency, future funding and to meet Government requirements.

Integral to EVM are the uses of the Integrated Master Plan (IMP)/Integrated Master Schedule (IMS) and risk and opportunity management.  The Integrated Master Schedule is the basis for developing the Performance Measurement Baseline (PMB) which in turn, is the basis for measuring performance on a project.   Measurement of progress against the baseline provides early identification of problems and helps to identify and mitigate costs and risks, while also identifying opportunities, by implementation of appropriate corrective actions.

Earned Value Management Systems for Project Management

The basic concept of the Earned Value Management System is more than a unique project management technique.  The EIA-748-C contains 32 Guidelines that define a set of requirements that a contractor’s management system must meet. The objectives of an EVMS are:

  •  Relate time phased budgets to specific contract tasks and/or statements of work
  • Relate technical, schedule and cost performance information
  • Furnish valid, timely and auditable data/information for proactive management action and decision making
  • Provide the basis to capture work progress assessments against the baseline plan to facilitate realistic project costs and completion dates
  • Supply managers with a practical level of summarization for effective decision making

Once a contractor’s EVM System is designed and implemented, there are significant benefits to the contractor and to the customer:

  • Contractor benefits include increased visibility and control to quickly and proactively respond to issues which makes it easier to meet project technical, schedule, and cost objectives
  • Customer benefits include confidence in the contractor’s ability to manage the project, early problem identification, and objective rather than subjective contract cost and schedule status

Earned Value Management Training

Experienced project managers will tell you that understanding the scope, schedule and costs of a project is essential to its success. The primary objective of the EVMS is to ensure that all elements of a project are planned, authorized, managed, and controlled in a consistent and cost-effective manner.  There is an increasing demand for training for organizations beyond the traditional aerospace and defense related construction, software, research and development, and production environment to now include non-defense companies to implement and use the Earned Value Management System.

EVM for Biotech and Pharma

Biotech and Pharma companies are not strangers to dealing with government regulations and requirements. Most have gone through rigorous Food and Drug Administration (FDA) processes to receive approval of compounds and/or devices. Nonetheless, learning how to design and use an EVM system can take a considerable investment of time and money, but is an essential requirement for initial and ongoing funding.

In addition to the EIA-748-C, there are numerous documents that give direction regarding the implementation and use of an EVM system.  Some of these are the National Defense Industrial Association (NDIA) Integrated Program Management Division (IPMD) EIA-748 Intent Guide, Cost Accounting Standards (CAS), Data Item Descriptions (DID), Military Standards (MIL-STD) such as MIL-STD-881, the Earned Value Management System Interpretation Guide (EVMSIG), and many others.  We have helped many organizations to ensure that they do not overkill or underkill based on their desired management system characteristics.  H&A personnel understand the requirements and are able to “size” those requirements to meet company and customer requirements.

Although Biotech and Pharma are relatively recent industries to use EVM, Humphreys & Associates (H&A) has been providing Earned Value Management training and implementation services for over 35 years. H&A provides self-paced online, classroom and private training courses, and can assist in all aspects of Earned Value Management Implementation.

For more information about EVM training or support, or with questions about your company’s requirements, please contact the Humphreys & Associates corporate office.

EVM for Biotech and Pharma – Part I Implementation and Training Read Post »

DFARS 252.234-7001 – “Thou Shalt Do Earned Value”

Overview

Earned Value Management (EVM) have become increasingly relevant for industries like Biotech and Pharma.

Hypothetically, your organization has received a Request for Proposal (RFP) and wishes to bid for the work.  The RFP includes the clause DFARS 252.234-7001 if the cost to the government is anticipated to be in excess of $20M.  What choices does a company have?  First, the clause could be ignored and the bid made as Firm Fixed Price (FFP). However, this places the entire cost risk on the company and unless the scope is well known and routinely achievable, this risk may be unacceptable.

Otherwise, with any other kind of contract, be it incentive or cost plus, it will require the company to comply with the Earned Value Management Systems (EVMS) clause.  Assume that the proposal is anticipated to be in excess of $50M (as this is the most stringent requirement), your company does not have an EVMS, and it is decided to bid and include a plan to reach compliance.

The subject DFARS Clause requires that a contract be managed with a fully compliant Earned Value Management System as defined in EIA-748 (the latest revision is “C” dated March 2013).  If a system has not been validated, meaning accepted by the Government, the company must include in its proposal how validation will be achieved.

This includes a description of the system proposed to be used including an annotated checklist which addresses each of the 162 management system characteristics, proposed changes to the current system, resumes of the personnel who will design and implement a compliant system, how the Guideline requirements will be met, subcontractor compliance, and a time-phased plan to achieve EVMS compliance.

What is the Extent of the Requirement?

The answer to this question is the object of the first steps towards full Earned Value Management (EVM) system design, implementation, operation, and acceptance.

Step 1: Familiarize company management with the EIA-748 Guideline requirements.  This is usually done with a two to four hour presentation to management conducted by experienced EVMS personnel.  The single most important outcome from this presentation, leading to a successful EVMS implementation and acceptance by the customer, is senior management’s commitment in fully supporting the steps that follow.

Step 2: Review the current management control systems including existing software and identify which of these fully support the earned value requirements.  This information is then used to develop an implementation plan of the necessary tasks, their associated schedule as well as the costs of needed changes.

Step 3:  This significant step helps senior management to:

    1. Review the cost benefit of the EVMS and either change the proposal strategy to a Firm Fixed Price (FFP) bid and stopping the EVMS process without significant investment
    2. Decide to implement the system a step at a time and proceed with the design and subsequent implementation and maintenance of the EVMS; or
    3. Simply not bid

The Choice – Proceed to Implement

Assuming the answer is to proceed, the question becomes what are the next steps?

First, the management system is divided into the required subsystems such as:  work definition and assignment, planning and scheduling, budgeting, work authorization, accounting, material and subcontract management, data analysis and reporting, and change control.  Next, pertinent existing information and materials (forms, documents, reports, etc.) are gathered that support these same subsystems. Interviews are also conducted to determine the “real” needs.  After collecting the existing system documentation and understanding the processes from interviews conducted, the  system documents  are placed in sequence on wall flow charts, commonly called storyboards, which allow the identification of system/subsystem “holes” and/or “gaps and overlaps” versus the EVMS requirements.  New forms, procedures, software modifications and other additions can then be identified and developed to fill these holes.

At this point in the process, the final management system design should be developed and a revised implementation plan/schedule presented to senior management for approval.  Upon approval, the first step is now accomplished.

Second, is to develop an EVMS compliant System Description, procedures and associated desk top instructions.  The System Description is a document that defines the management system much like the operator’s manual to your automobile.  It is a “what to do” document and includes definition of the processes, depicts forms and reports used in and produced by the system, and describes how the system meets the requirements of the EIA-748 Guideline requirements. This is typically organized by the Nine Process Groups of organizing, scheduling, etc.  The procedures and desk top instructions define how to do it and support the requirements outlined in the System Description.  Procedures and desk top instructions define the detailed steps necessary for all requirements and what organizations are responsible for those steps.   With the system documentation in place, and upon its presentation and acceptance by management, the second step is now complete. You could say that you have now designed and built a new automobile and it is time to train people how to drive.

The third step is to train all levels of management in the operation and use of the EVM System.  This can be accomplished in groups (functional management, control account managers (CAM), IPT Leads, senior management, etc.), and/or by one-on-one training.

Fourth, once all of the above has been accomplished, the company is ready to apply and operate the EVM system on a project.  Ideally the project that was proposed has now been won, and it is the one with which the system will be implemented—and used.  It is much easier to put the system in place and begin to operate it on a new project/contract than it is to try and retrofit it onto an existing project.  This entails following the definition, planning, and authorization subsystem steps defined in the approved Management System Description, procedures and associated desk top instructions, and then producing the required data for analysis and reporting to management and the customer.  Generally speaking, three months of system data and reports are required by the customer before the next step can be undertaken.

Fifth, the next major step is the customer’s review of the EVM system and its subsequent acceptance and validation.  Once system operation has begun, at least one visit will be conducted by the customer’s EVMS representative (in the case of DOD contracts it is the Defense Contract Management Agency (DCMA)).  The visit(s) is conducted to assess the progress against the plan that was submitted in the original proposal.  The visit(s) is usually two to three days in length and conducted by three or four well qualified government representatives.

Once an organization conducts a self assessment and informs the reviewing agency that it is ready for their review, that agency reviews the documentation provided by the organization to determine readiness for a Validation Review.  This review will then be scheduled with the company.  It may be quite some time in the future, as there are very few DCMA representatives available and there are many companies requiring reviews of one kind or another.  A “data call” will occur which is a request for information such as 12 months of Contract Performance Reports (CPRs) or Integrated Program Management Reports (IPMR), the baseline logs from the beginning of the program, etc. When the review does occur, the program team should plan on 15 to 20 reviewers for at least two weeks. The company will need to provide all of the support the review team requires. This will include work rooms, computers, printers, and other elements that will be specified in the review notification.  Other preparations will include development of in-briefings, construction/updates of storyboards, and conduct of mock interviews with project and management personnel to prepare them for their government interviews.

The company cannot expect to complete the Validation Review without action items being assigned.  The DCMA will create Discrepancy Report(s) which will lead to Corrective Action Reports (CARs) that are rated by the degree of severity from 1 to 4. These system discrepancies will each require a Corrective Action Plan (CAP) to be developed and accepted by the DCMA, monitored, and progress reported to the DCMA.  Once the DCMA has accepted all of the responses, the company can expect to receive a formal “System Acceptance Letter,” but it should not heave a sigh of relief – there is still one more step to be accomplished.

The On-Going Process

This last step is Surveillance, the development and execution of a plan that ensures continued system operation in accordance with the EIA-748 Guidelines.  History has proven over the past 46 years that EVM Systems’ operation tends to degrade over time.  This occurs because of taking short cuts, lack of continued management commitment and emphasis, degrading system use, a “we are too big to be failed” attitude, and an occasional laissez-faire attitude.

While all of the steps except this last one can usually be accomplished in nine months to a year, the last one, Surveillance, will need continued operational discipline as long as a validated EVM system is required.

If you have questions on the DFARS clause 252.234-7001 or would like to explore EVM training options, please feel free to contact Humphreys & Associates.

DFARS 252.234-7001 – “Thou Shalt Do Earned Value” Read Post »

Level Of Effort Decision Tree – Clarifying Source Articles

, , , , ,
Level Of Effort Decision Tree – Clarifying Source Articles

Updated January 20, 2021

 

Level of Effort Decision Tree – Introduction

If you have not read the LOE source articles, Level of Effort (LOE) Replanning and How to Avoid Corrective Action Requests Related to Level of Effort, it is necessary to read prior to these articles in order to have the context for the following subject matter.

Humphreys & Associates, Inc. prepared an article a couple of months ago in order to increase the awareness of Earned Value Management Systems (EVMS) reviews related to Level of Effort (LOE) replanning. This resulted in considerable attention because we did not adequately explain our intention.

We had hoped readers would recognize that there are many strong and diametrically opposed opinions on acceptable approaches to LOE replanning. An important point to remember is that the principal purpose of an EVMS is to provide adequate information from which to make logical, well-informed decisions based on the best data available.

Our article resulted in a request for the National Defense Industrial Association (NDIA) Integrated Program Management Division (IPMD) to address this topic in its EVMS Clearinghouse Working Group. The company that submitted the issue used one of the approaches that we listed, which led to a DCMA Discrepancy Report. Consequently, they were clearly concerned. To address that one issue would not have provided an intelligent approach – it would have resulted in even more concerns for other organizations. For that reason, we chose to provide an update to our article in the form of a “white paper.” We do not address the many approaches being employed, as some display thinking that is “way out of the box;” such as earning whatever the actual costs are – as opposed to the budget.

We chose to leave some of those approaches out of the options addressed below. One could almost conclude that we are observing the classic consultant response to some issues – “It depends.”

BACKGROUND

The distinctive feature of the Level of Effort (LOE) earned value technique is that it earns value through the passage of time with no consideration of any work being performed. Therefore, it can earn value with no incurrence of actual costs and incur actual costs without earning value. Both of these conditions are currently considered by some DCMA review teams as noncompliant to the EVMS Guidelines (#16 and/or #22) that could result in a DCMA issued Corrective Action Request (CAR).

This is usually not an issue for the typical LOE that is support to the entire project (e.g., project management, contract management, financial management, systems engineering, security, safety, etc.) because these efforts almost always start on time and only face a problem if the support extends past the contract baseline. However, it is frequently an issue for LOE that provides support to discrete efforts that could slip or be moved up for various reasons (e.g., test site availability, equipment failures, successes that eliminate future planned effort, etc.) if the LOE work is not allowed to be replanned to the time period where the discrete work is actually being performed.

The LOE baseline period of performance should match the discrete effort’s period of performance. While the discrete effort can occur early or late and have earned value and actual costs coincide, that is not necessarily true for the supporting LOE, because it earns its value as planned in the baseline regardless of when the work actually starts or when the actual costs are incurred. The examples below show the possible LOE conditions when discrete effort starts early, finishes early, starts late, and finishes late. Each condition trips a significant item of concern when the DCMA runs its diagnostics of a contractor’s EVMS data:

If the discrete effort starts early, and LOE is not allowed to replan, LOE incurs ACWP with no BCWP.

H&A 1 - LOE Decision Tree

If the discrete effort finishes early, the remaining months of LOE support earn BCWP with zero ACWP.

H&A 2 - LOE Decision Tree

If the discrete effort starts late, LOE earns value (BCWP) with no actual costs (ACWP).

H&A 3 - LOE Decision Tree

If the discrete effort finishes late, LOE incurs ACWP without accompanying BCWP because the BCWP now equals the BAC. However, when the support effort’s manager reports an EAC that includes the to-go LOE to report an accurate EAC, it creates the situation of EAC>ACWP with BCWP=BAC, again tripping a DCMA significant item of concern.

H&A 4 - LOE Decision Tree

These conditions have resulted in Corrective Action Requests (CARs) from some local DCMA representatives because they are identified as significant items of concern by the DCMA diagnostics. Unfortunately, the diagnostics applied to discrete work packages are also applied to LOE tasks. There is no consideration of the special circumstances associated with LOE in the diagnostic software being used by review teams.

It is important to note that LOE is often (erroneously) called a work package just like discrete effort is called a work package and, therefore, work package rules are automatically applied to LOE. But not all work package attributes apply to LOE. For example, LOE does not consist of discrete tasks, is not required to be of short duration, and does not measure performance. The special circumstances of LOE were recognized in 1991 by the Department of Defense issuance of the Performance Measurement Joint Executive Group (PMJEG)’s Supplemental Guidance to the Joint Implementation Guide (JIG) involving the Cost/Schedule Control Systems Criteria (C/SCSC). Section 3-6, Revisions, subsection b (Internal Replanning) specified special handling of LOE for the circumstances cited above. However, the JIG Supplemental Guidance has not been incorporated into current implementation guidance. Please note that some DCMA EVMS Center of Excellence personnel have stated that the 1991 JIG Supplemental Guidance is applicable to current guidance. This is the way it used to be and was understood by all. But that position has not been documented and distributed to DCMA field office personnel, resulting in different determinations as to which actions are allowable and which are not. Many DCMA field office EVMS personnel have never been exposed to the JIG Supplemental Guidance. Those that are aware of the 1991 JIG Supplemental Guidance or who would agree with the JIG Supplemental Guidance approach as being compliant tend not to create CARs for the same conditions, while, unfortunately, those who are not aware of the Guidance write CARs.

INTRODUCTION TO THE DECISION TREE

The following decision tree relies heavily on the JIG Supplemental Guidance for recommending actions to avoid CARs. It is organized in outline format with major sections being the four discrete effort status possibilities that can cause LOE to result in a CAR as shown above. The first sub-topic in each section is the supporting LOE condition that results in tripping a significant item of concern in the diagnostic software DCMA employs from the Data Call before arriving on-site. The second sub-topic provides a quotation from the PMJEG Supplemental Guidance to the C/SCSC JIG, Section 3-6 Revisions, Subsection b. Internal Replanning that applies to the identified condition. The third sub-topic provides suggestions on how to implement the guidance to avoid the condition. The following sub-topics provide the advantages, disadvantages, and reporting requirements for each avoidance action.

In presenting these actions we need to make the point that depending on the interpreter none of these or only some of these would be acceptable to a DCMA reviewer. We are merely attempting to bring forth the options observed so that many can consider which approach is best for them and then use simple examples to present their desires to their customers.

Note that JIG references to “cost account” apply to control accounts.

LEVEL OF EFFORT (LOE) DECISION TREE

OUTLINE

Discrete Effort Starts Early

  1. Condition that may result in a DCMA CAR
    1. The LOE BCWS does not start until a later period (cannot earn value in the current period).
    2. LOE has ACWP without BCWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(c).
      2. “Replan future LOE to correlate to the changes in work. LOE, whether planned in separate cost accounts or as part of predominantly discrete cost accounts, has additional flexibility and may be adjusted within the current accounting period without government approval, provided no actual costs (ACWP) have been charged to the LOE.”
      3. How to implement the Supplemental Guidance
        1. In the current accounting period, replan the LOE to begin in the current period.
        2. Determine whether the discrete effort’s early start will result in an early finish (length of the period of performance remains the same).
          1. If so, no BAC change should occur – only the shift in the BCWS.
          2. If not, either provide additional BAC from MR or re-spread the BAC over the revised future period of performance (often called the “peanut butter” approach).
  2. Advantage
    • Avoids the ACWP without BCWP condition.
  3. Disadvantage
    • Changes the baseline in the current period. If the local DCMA office is not aware of the Supplemental Guidance or knows about its existence but disagrees with it, a CAR may be issued. Also, some DCMA teams consider the stretching out of current budget over a longer period of time as creating “token budgets” – for which they have written CARs.
  4. Reporting requirement
    • Must be reported in Integrated Program Management Data and Analysis Report (IPMDAR) database for Format 5.

Discrete Effort Finishes Early

  1. Condition that may result in a DCMA CAR
    1. The discrete effort has finished early and if the LOE had not previously been replanned in anticipation of the early finish, no LOE support effort would be required for the remaining period(s) of the LOE BCWS that must still earn value.
    2. The LOE has BCWP without ACWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(b).
      2. “Replan incomplete future work and adjust the work package budget at completion (BAC) to reflect the change in accordance with normal replanning guidance…”
      3. How to implement the Supplemental Guidance
        1. Because the “incomplete future work” has been eliminated, close the LOE package. The BCWS will already be equal to the BCWP earned to date.
        2. Subtract the BCWP from the BAC and return the BCWR initially to the UB Log and subsequently to the MR Log.
        3. If this can be achieved in the period in which the discrete effort was completed, this is a change to the next accounting period, thus avoiding a change to the current period baseline.

        NOTE: There is another point to be made here. The LOE task was to support the discrete work scope no matter how long it took. If the discrete task finished early because its work scope was reduced, the LOE task requirement was also reduced and the above action is justified. If the discrete task simply finished early, this would be a cost variance in that it cost less to support the unchanged work scope. The above action would be done solely to avoid the BCWP without ACWP condition.

  2. Advantage
    • Avoids the BCWP without ACWP condition.
  3. Disadvantage
    1. If the change is made in the same period in which the discrete effort was completed (or a prior period), there is no disadvantage although some would argue that this approach would be “changing budgets based on performance” which is akin to using MR to hide true cost variances.
    2. If the change is made in the period subsequent to the completion of the discrete effort, the current period baseline will change. If this is a repetitive occurrence, it probably means that a contractor is constantly changing the baseline to avoid true cost variances; therefore, it may result in a DCMA CAR.
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5 (MR was increased).

Discrete Effort Starts Late

  1. Condition that may result in a DCMA CAR
    1. The discrete effort has not started (no ACWP or BCWP), hence no LOE was required. This results in zero ACWP for the LOE, but it does report BCWP because of the passage of time.
    2. The LOE has BCWP without ACWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(c).
      2. “Replan future LOE to correlate to the changes in work. LOE, whether planned in separate cost accounts or as part of predominantly discrete cost accounts, has additional flexibility and may be adjusted within the current accounting period without government approval, provided no actual costs (ACWP) have been charged to the LOE.”
      3. How to implement the Supplemental Guidance
        • In the current month replan the LOE to begin in the month that the discrete effort is currently scheduled to begin.
  2. Advantage
    • Avoids the BCWP without ACWP condition.
  3. Disadvantages
    1. Changes the baseline in the current period. If the local DCMA office is not aware of the Supplemental Guidance or disagrees with the Supplemental Guidance, a CAR may be issued.
    2. If the discrete effort recovers its schedule variance, the LOE will be put in the position of having BCWP yet to be earned with no LOE required (equivalent to the early finish condition presented below).
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5.

Discrete Effort Finishes Late

  1. Conditions that may result in a DCMA CAR
    1. The LOE incurs ACWP with no accompanying BCWP.
    2. The LOE incurs ACWP with no accompanying ETC, usually indicated by ACWP>EAC.
    3. Both of these are significant items of concern conditions.
    4. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(b).
      2. “Replan incomplete future work and adjust the work package budget at completion (BAC) to reflect the change in accordance with normal replanning guidance…”
      3. How to implement the Supplemental Guidance
        1. In or before the last period of performance of the LOE, replan the LOE to cover the extended discrete effort.
        2. Use one of two methods to provide budget for the additional effort:
          1. If ACWP is less than BCWP, recover budget from the previously earned LOE BCWP by using the single point adjustment technique of setting BCWS and BCWP equal to ACWP and replan the recovered budget (BAC minus BCWP) into the future.
          2. If ACWP is equal to or greater than BCWP, but less than BAC, replan the unearned budget (BAC minus BCWP) into the future.

        NOTE: Alternative to 3) implementing the Supplemental Guidance

        1. Allow the LOE package to complete without replanning, which results in accepting the ACWP without BCWP condition.
        2. To mitigate the severity of this approach, be certain to provide an ETC for the periods beyond the LOE baseline period of performance. This action would avoid an ACWP>EAC condition.
  2. Advantages
    1. Avoids the ACWP without BCWP condition.
    2. Avoids the ACWP>EAC condition.
  3. Disadvantage
    • There will be a baseline change in the current period. Because ACWP has occurred, the LOE exception to be able to make a change in the current period if no ACWP has been recorded does not apply. Therefore, a DCMA CAR may be issued.
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5.

Observations/RECOMMENDATIONS based on the foregoing:

  1. First and foremost, because many DCMA personnel are not familiar with the JIG Supplemental Guidance or may not agree with it (remember that the DCMA Center of Excellence has not formally confirmed that the JIG Supplemental Guidance remains in effect), contractors must determine the desired approach of the cognizant DCMA personnel for handling the LOE conditions noted above. Early discussions to determine acceptable approaches to the LOE special conditions will avoid many of the CARs/DRs being issued.
  2. Eternal vigilance is required. If a potential change in the performance period of the discrete effort becomes apparent sufficiently early, the change can be accomplished with little chance of incurring a DCMA CAR. This assumes that people recognize the right to change LOE in an “open LOE task”.
  3. The DCMA Center of Excellence must officially transmit additional guidance to the DCMA field offices to ensure consistent application of EVMS Guideline requirements to LOE.
  4. Some may suggest using the Apportioned Effort technique in lieu of LOE, but that would require that the supporting budget be estimated as a percentage of the discrete effort and its time-phasing be established at the same percentage as the time-phasing of the base. Usually, LOE budget is based on an average level of support that is inconsistent with or has a “loose” relation to the discrete package’s time-phasing.
  5. One alternative approach is to consider short duration (3-4 months) LOE for supporting discrete effort. An advantage to this approach is that while the first LOE in the series might incur a significant item of concern condition, the following efforts could be adjusted without penalty.
  6. Another alternative approach is to make the entire support effort a percent complete EVT work package with the Quantifiable Backup Data (QBD) being the milestones in the supported discrete effort.
  7. If the LOE has been reported as complete in the prior month, it has been suggested by some in the DCMA EVMS Center of Excellence that the LOE BCWP that has already been earned can be “harvested” to budget a continuation of the LOE past its original period of performance. This was not a consideration of the JIG Supplemental Guidance and most would argue that this approach is in direct conflict with Guideline 30. Contractors should not use this method unless it is formally approved by the DCMA EVMS Center of Excellence.

To contact Humphreys & Associates click here.

Level Of Effort Decision Tree – Clarifying Source Articles Read Post »

NDIA and Earned Value Management – Humphreys & Associates Marks 35+ Years of Participation

, , , , ,

NDIA and Earned Value ManagementThe National Defense Industrial Association (NDIA), Integrated Program Management Division (IPMD) plays a central role in defining earned value management within the defense contracting community. Earned value management, or EVM, is a project management methodology that measures the technical, cost and scheduling performance of projects and/or programs. EVM systems (EVMS) are widely used and in some cases required by federal government agencies on large and complex contracts. The NDIA IPMD is industry’s opportunity to work closely with the federal government to set policy and provide guidance to its members.

NDIA and Eared Value Management Standards – Their Leadership Role

The NDIA has long taken the lead in setting EVM standards. In the 1990s, it recommended modifications to the 35 Department of Defense Cost Schedule Control Systems Criteria (C/SCSC) and proposed 32 guidelines that included the needs of industry as well as meeting the government requirements. The Defense Contracting Management Agency (DCMA) concurred with the use of the 32 guidelines which became the 748A standard. The NDIA IPMD has since maintained the role of managing the standard.

The NDIA Integrated Program Management Division (IPMD) also provides guidance in the implementation and use of EVM systems (EVMS) to achieve integrated program management. While IPMD membership is limited to industry representatives, government personnel from the various agencies implementing EVMS are regular participants in the IPMD’s quarterly working group meetings. The various IPMD working groups focus on strengthening the understanding and implementation of compliant EVM systems.

NDIA EVM System Guides

The IPMD has published a series of widely used EVMS guides. The Earned Value Management Systems Intent Guide provides an interpretation of the EIA 32 guidelines for  companies seeking to implement a compliant EVM system. The committee revised the Earned Value Management System Intent Guide in 2014 and continues working on further improvements. The Planning and Scheduling Excellence Guide (PASEG) Version 3 was released in 2016 and is used in the development of Integrated Master Plans (IMP) and Integrated Master Schedules (IMS) EVMS compliant processes and artifacts.    Other IPMD documents address specific aspects of the EVM process, such as the Earned Value Management System Acceptance Guide, the Integrated Baseline Review (IBR) Guide and the Surveillance Guide. Other recent additions include a Guide to Managing Programs Using Predictive Measures and an Industry Practice Guide for Agile on EVM Programs.

At set contract value thresholds, the Office of Management and Budget (OMB), Federal Acquisition Regulations (FAR), and Defense Acquisition Regulations (DFAR) requires the government program offices to ensure their supplier’s program management system meets the intent of the Earned Value Management Systems (EVMS) of the EIA 748 standard. In some cases these systems must be validated by the Defense Contract Management Agency (DCMA) as being compliant with the EIA standard.  The NDIA continues to work with government and industry to drive the evolution of standards for Earned Value Management Systems implementation and acceptance in the United States and internationally.

Humphreys & Associates has been an active participant in the NDIA IPMD for more than 35 years. Three of our consultants, including the founder of the company, were part of the eight person committee that developed the EIA 748 Standard for EVMS. We also have three past chairs of the National Defense Industrial Association (NDIA) Integrated Program Management Systems Committee (IPMD) on our staff. Our consultants continue to be active participates in the working groups responsible for the system guides and the continuing improvement of the EVMS guidelines.

Humphreys & Associates is the industry leader in Earned Value Management Systems design, implementation and EVMS training.  You can learn more on the Humphreys & Associates website.

NDIA and Earned Value Management – Humphreys & Associates Marks 35+ Years of Participation Read Post »

EVM Lite – Part 2: Tailoring approaches to EV Lite

So, what if there is no EVMS contract requirement, but a company wants to use the EVM principles to measure performance on important work?

Approaches for tailoring EVM Lite (also called EV Lite):

  • First, the levels of the Work Breakdown Structure (WBS) could be limited to minimal extension.  With fewer lowest level WBS elements, fewer control accounts are created which results in a reduction in the overall administrative costs of the system.
  • Similarly, responsibility can be assigned to managers higher in the Organization Breakdown Structure (OBS), or Integrated Product Teams can be used to combine functions.  By having fewer lowest level OBS elements, fewer control accounts will be created.  Most contractors are well aware of these implementation tactics and actively engage in them.
  • Other approaches include the Project Schedule – more distance between the milestones and use of the Percent Complete Technique, providing the validity of the Earned Value (EV) data is unaffected.  Also, the Variance Analysis Report Thresholds could be tailored to specific risk areas and made less stringent.  The Change Control Process could be tailored to a more streamlined transfer of work and budget involving Stop Work Orders.
  • With respect to reporting, The Integrated Program Management Report (IPMR) or Contract Performance Report (CPR), Format 2, Organizational Categories, and Format 4, Staffing, could be eliminated.
  • In some cases, Format 3, Baseline is eliminated.  Note: The new IPMR Guidance does not allow tailoring of the Contract Data Requirements Item List (CDRL) to removed reports on contracts that exceed $50 million.  None of the bulleted “EVM Lite” items above are even in the realm of the acceptable items for EVMS tailoring.  If a company has an EVMS contract requirement, EVM Lite will not receive a favorable reaction from the DCMA.

Some companies use EVM for critical internal Research and Development projects or fixed priced work.  Companies need to ask the question “Where do we want to fit in the EVMS Continuum?”  Consider the graphic below:

EVM Lite: Part 2 -EVMS Continuum by Humphreys & Associates

The right hand side of the continuum represents implementation of EVMS to the maximum, and represents the highest cost to operate and maintain an EVMS.  The left hand side represents something that looks like EVMS because it contains Earned Value, but none of the discipline necessary to ensure the integrity and traceability of the EVMS data.  Most people that talk about EVM Lite want to be closer to the left hand side of the continuum.

Any alternative approaches must consider the trade-off between the steps necessary to maintain good baseline control and system discipline versus implementation/ maintenance costs.  If the performance measurement baseline is not adequately controlled, a good basis for measurement does not exist.  If the earned value is not reliable and other data integrity issues exist, status reporting is suspect and the data cannot be used with confidence to forecast expected outcomes.

Humphreys & Associates can help a company’s team sort out which methods would work best for its project.  H&A EVM experts can help determine which requirements can be relaxed, which ones need to be implemented and still maintain the fundamental EVM principles within each subsystem.

EVM Lite – Part 2: Tailoring approaches to EV Lite Read Post »

What Does it Mean When Somebody Says “We use EVM Lite” – Part 1

Here is why Humphreys & Associates takes an interest in this approach to Earned Value Management.

Earned Value Management (EVM) “lite” or EV Lite is a hot topic because people recognize that budgets versus actual costs are not meaningful enough for assessing true project technical/schedule/cost status. An awareness exists that there is a significant advantage to using Earned Value (EV) measurement to manage projects.

The EVM Lite approach is common for Independent Research and Development and Firm Fixed Price (FFP) projects. Therefore, it is important to understand what this term means.

EVM Lite is a title that could mean a combination of any of the following:

  • Relaxation of the level of detail (fewer control accounts of larger size, fewer work packages of larger size with less milestones/technical achievement points and  more dependence on subjective earned value techniques )
  • Less rigor in approvals for Work Authorization Documents (WAD) and Budget Change Requests (BCR)
  • Less rigor in Rolling Wave Planning and enforcement of the freeze period
  • Less rigor in the variance analysis process, including looser variance thresholds
  • Compliance with only the 16 “critical” American National Standards Institute, EIA-748 Guidelines
  • Earned Value Management System (EVMS) not subject to third party verification
  • Less detail in the EVM System Description (fewer examples, no “live” data examples)
  • EVMS Cross Reference Checklist only at the Guideline level

EVM Lite implies an EVMS with relaxed requirements or a less rigorous approach that still meets the spirit and intent of the EIA-748 Guidelines. But it is important to note that none of the descriptions of EVM Lite above would pass muster in a DCMA review to determine whether a contractor’s EVMS complies with the EIA-748 Guidelines and cannot be used in that event.

If a contract mandates the use of an EVMS then EVM Lite is not an option. It is important to us our customers know this. However, if your contract does not mandate the use of EVM, then EVM Lite might be a viable option to pursue if management desires insight into their programs.

Part 2 to follow – Tailoring Approaches to EVM Lite 

What Does it Mean When Somebody Says “We use EVM Lite” – Part 1 Read Post »

Scroll to Top