EAC

Insights into Current Industry EVMS Issues

, , , , , , , ,
Insights into Current Industry EVMS Issues

Quick Summary

  • The August 2026 NDIA IPMD forum emphasized using Earned Value Management Systems (EVMS) as an early-warning system that helps management identify risks, make timely decisions, and protect project outcomes.
  • Forum discussions included integrating subcontractor schedules into the Integrated Master Schedule (IMS), improving Schedule Risk Assessments (SRAs), maintaining credible Estimates at Completion (EACs) and forecast completion dates, and proactively managing Level of Effort (LOE).
  • The NDIA IPMD Clearinghouse Committee provides a forum for industry and government EVMS practitioners to discuss challenges and develop mutually acceptable solutions. H&A actively participates in these forums and provides related guidance through our blogs and articles.

H&A earned value consultants routinely attend and present at the NDIA Integrated Program Management Division (IPMD) forums that are held twice a year as well as serve on the IPMD Board of Directors. The IPMD forum presentations, discussions between industry and government customer representatives, and Clearinghouse Committee topics provide an opportunity to discuss current challenges and options for resolving them. If you are not familiar with the IPMD Clearinghouse Committee, a time slot on the agenda is reserved for this committee’s working session. Industry Earned Value Management System (EVMS) practitioners raise and discuss issues along with the government EVMS counterparts to develop mutually acceptable resolutions and/or recommendations. Issues raised during the Clearinghouse Committee sessions have often been the basis for launching many other IPMD committees such as the Planning and Scheduling Committee and Prime/Sub Committee.

In addition to EVMS related challenges that surface on recent H&A engagements, the H&A blogs and articles are often written to address common issues or general themes from these IPMD forums. The August 2026 forum was no different. What follows is a short list of discussion and presentation topics from the August 2026 forum with links to H&A blogs or articles that address these current issues and presentations.

  • The value of an EVMS. This was a general theme from three presenters that aligns with recent H&A EVMS Education Center articles including one titled “Ten Project Failure Risks: Using an EVMS to Improve Project Outcomes.” The purpose and value of an EVMS is often lost when the focus is on producing contractual reports or managing to a set of compliance metrics instead of using the data as an early alert system for emerging risks and issues. An EVMS provides management a disciplined way to understand the current status of a project and where it may be headed. Management must provide the response to the EVMS alert signals, make decisions, and take action while there is still time to protect project outcomes.
  • Approach for integrating subcontractor schedule data into a prime’s Integrated Master Schedule (IMS). There are often differing opinions from the contractor’s or the government customer’s point of view about how the IMS should be structured to include this data. The main goal is to determine a logical approach that does not overcomplicate the structure and content of the IMS that makes it difficult to maintain or compromises the overall purpose of an IMS. The H&A blog “Integrating Subcontractor Data into an Integrated Master Schedule” discusses this common challenge and risks when scheduling requirements are not clearly defined. It also discusses three approaches for incorporating subcontractor schedule data with pros and cons for each approach.
  • Schedule Risk Assessments (SRAs). The continuing discussions on SRAs often center around the quality of the SRA data and that it is being treated like a check the box exercise. The solution isn’t to require contractors to perform monthly SRAs. That fails to address the root cause: meaningless duration estimates. In some instances global factors are applied to existing duration estimates as a short-cut. Producing a useful SRA starts with a high-quality IMS along with a disciplined risk management process and focused analysis of selected tasks that have a high probability of impacting a major event or project completion date. The H&A blog “Maximizing the Value of Schedule Risk Assessments (SRAs)” provides suggestions on how to implement a straight-forward process that helps to produce a more realistic IMS.
  • Estimates at Completion (EACs). This is another continuing discussion between industry and their government customers about practices that help to ensure a contractor’s forecast completion date (FCD) and EAC are realistic. The H&A blog “Maintaining a Credible Estimate at Completion (EAC)” emphasizes the importance of realistic EACs and why it matters to all stakeholders. The blog discusses practices that can help to ensure EACs are actively maintained along with suggestions for practical process improvements including leveraging evolving tools and analytics.
  • Proactive management of Level of Effort (LOE). The LOE topic often comes up in the Clearinghouse working sessions. When the percentage of LOE work packages and their total budget value for a given project is low, some consider LOE to be a non-factor in the overall picture of project performance. However, that is not always the case. Selecting the LOE earned value method must be a conscious decision (not a planning short-cut) and actively managed to ensure the timing and duration as well as any relationship to discrete work packages remain valid. The H&A blog “Level of Effort (LOE) Best Practice Tips” discusses common LOE issues and provides suggestions on how to ensure LOE is properly planned and managed.

Interested in Learning More?

The NDIA IPMD Clearinghouse Committee is a useful resource for industry to discuss EVMS related issues and identify options to resolve them. H&A is a direct conduit to the Clearinghouse Committee co-leads that work with the government counterparts to document recommended solutions. If you need help resolving an issue with your EVMS, we can help. Call us today.

Insights into Current Industry EVMS Issues Read Post »

Comparing the Efficacy of Independent Estimate at Completion (IEAC) Methods Using Real Project Data

Comparing the Efficacy of Independent Estimate at Completion (IEAC) Methods Using Real Project Data

“Data! Data! Data!” he cried impatiently. “I can’t make bricks without clay.”

-Sherlock Holmes, The Adventure of the Copper Beeches

There are many discussions about EACs and evaluating EACs including using Independent EAC (IEAC) formulae to compare with the contractor EACs. With good reason, we should wonder how accurate are those IEACs that we use so often and sometimes make decisions based on them. Are we misjudging contractor’s EACs based on formulae that are weak or inappropriate?

Humphreys & Associates has initiated a study to determine how accurate IEACs are, and we would like your help. The study will compare different IEAC formulae against the Program Manager (PM) most likely EAC at the 25, 50, and 75 percent complete point for completed projects. The objective is to assess how closely the IEACs and PM most likely EAC were able to predict the final cost outcome for the project.

How Accurate are IEAC Formulae?

Many formulae exist for using recorded data from an earned value management system (EVMS) to make independent estimates of the final cost at completion (EAC) for the element in question. The element might be a control account, a Work Breakdown Structure (WBS) element, or even an entire project.

What is not known is how accurate these methods are at forecasting the final actual cost for the project. This study hopes to determine that answer.

Real World IEAC Data

This study was initiated by collecting earned value data from 12 completed projects. We need projects that are completed because, on a completed project, the final actual outcome is known. We collected project data at the 25, 50, and 75 percent complete points. At each of these points, the IEAC formulae were applied to determine how closely they were able to predict the final actual cost outcome for the project. The quest is to learn how the various IEACs performed. Is any one of them more accurate than the others?

From this investigation, any indication of the relative efficacy of the formulae would be used to inform future use of the IEAC methods.

Our Method for Testing IEACs

In general, the IEAC approach is to use existing recognized formulae. We have chosen these IEACs as a starting point:

  • IEAC 1 = BAC/CPIe at the percent point reported. This formula can be stated in words as “the entire project is performed at the same efficiency as experience to date.”
  • IEAC 2 = ACWP + [BCWR/CPI (.5) + SPI (.5)]. This formula uses weighted SPI and CPI which theoretically allows for sensitivity to both cost and schedule historical performance. The weights used in this application are even at .50 and .50.
  • IEAC 3 = ACWP + [BCWR/CPI x SPI]. This formula uses the SPI and CPI multiplied together which theoretically allows for sensitivity to both cost and schedule performance to date.
  • IEAC 4 = ACWP + BCWR. This formula assumes the remaining work will be done as budgeted with no factoring.

One additional non-traditional IEAC will be used.

IEAC 5 = Use of IEAC 2 weighted SPI and CPI but decreasing the proportion applied to the SPI as the percent of project completion increases. In other words, the impact of schedule performance diminishes as the project becomes closer to completion.

We will also take the average of all the formulae to see how that works.

Initial Data Set

One aerospace contractor and one US Government agency have provided the required data for 12 completed projects with an interest in the outcome of the study. The source of the data and the specific projects will not be disclosed in the study.

These real-world projects did not have an exact 25%, 50%, or 75% dataset. The closest dataset to each of those completion percentages was used. One example dataset looks like this (color coding should be ignored):

Example Product Data

How can you help?

We need more project data to gather enough varying project outcomes to make the test realistic. We do not plan to keep the types of projects or products separate but will take all the data we can get and look at them all.

Please consider providing data for the study. We have created an Excel spreadsheet template to help gather project data in a common format for analysis. You can download this template here. Add as many tabs as needed for each project. Send your completed spreadsheet to humphreys@humphreys-assoc.com.

In a separate blog we will outline other help we need to complete the study and to analyze the results.

Comparing the Efficacy of Independent Estimate at Completion (IEAC) Methods Using Real Project Data Read Post »

Using Earned Value Management (EVM) Performance Metrics for Evaluating EACs

, , ,

A previous blog, Maintaining a Credible Estimate at Completion (EAC), discussed why producing a realistic EAC is essential to managing the remaining work on a contract. Internal management and the customer need visibility into the most likely total cost for the contract at completion to ensure it is within the negotiated contract cost and funding limits.

As noted in the earlier blog, one common technique to test the realism of the EAC is to compare the cumulative to date Cost Performance Index (CPI) to the To Complete Performance Index (TCPI).

Example of Using the Metrics for Evaluating Data

One example of documented guidance to industry for evaluating the realism of the EAC is the DOE Office of Project Management (PM) Compliance Assessment Governance (CAG) 2.0, and the related DOE EVMS Metric Specifications they use to assess the quality of schedule and cost data. This blog highlights the use of this guidance and how any contractor can incorporate similar best practices to verify EACs at a given WBS element, control account, or project level are realistic.

To refresh, the CPI is the efficiency at which work has been performed so far for a WBS element, control account, or at the total project level. The formula for the cumulative to date CPI is as follows.

Best practice tip: To ensure a valid CPI calculation, verify the BCWP and ACWP are recorded in the same month for the same work performed.

The TCPI provides the same information, however, it is forward looking. While the CPI is the work efficiency so far, the TCPI is the efficiency required to complete the remaining work to achieve the EAC. The formula for the TCPI is as follows.

TCPI Formula

Best practice tip: To ensure a valid TCPI, verify the BCWP and ACWP are recorded in the same month for the same work performed, and the BAC and EAC are for the same work scope. In other words, the scope of work assumptions are the same for the budget and remaining cost. This is why anticipated changes should not be included in the EAC.

The DOE uses the CPI in two of their assessment metrics and the TCPI in one, however, these are critical metrics partly because they are the only ones used to assess two different data evaluations: 1) commingling level of effort (LOE) and discrete work, and 2) EAC realism.

Commingling LOE and Discrete Work

The first use of CPI (no TCPI in this metric) falls under the Budgeting and Work Authorization subprocess. The primary purpose is to evaluate the effect of commingling LOE and discrete work scope has on control account metrics. The basic premise for this metric is that if the CPI for the LOE scope is significantly different than that for the discrete, the mixture of LOE in that control account is likely skewing overall performance reporting.

Here is the formulation DOE uses.

C.09.01:  Control Account CPI delta between Discrete and LOE >= ±0.1

X = Number of incomplete control accounts (WBS elements) in the EVMS cost tool, where

  1. The LOE portion of the budget is between 15% and 80% of the total budget, and
  2. The difference between the CPI for the discrete work and the LOE work is >= ±0.1.
Y = Number of incomplete control accounts (WBS elements) in the EVMS cost tool.
Threshold = 0%

Best practice tip: Run this metric quarterly on your control accounts that commingle LOE and discrete work packages. When there is a significant discrepancy between the performance of the LOE versus discrete work effort, consider isolating the LOE effort from the discrete effort at the earliest opportunity. An example could be the next rolling wave planning window or as part of an internal replanning action. Alternatively, it may be necessary to perform the calculations at the work package level to assess the performance of just the discrete effort when it is impractical to isolate by other means.

Process and procedure tip: Ensure the LOE work packages within a control account are kept to minimum (typically less than 15%), during the baseline development phase. This helps to prevent discrete work effort performance measurement distortion during the execution phase. A useful best practice H&A earned value consultants have helped contractors to implement during the budget baseline development process is to perform an analysis of the earned value methods used within a control account and the associated work package budgets. This helps to verify any LOE work packages are less than the 15% threshold for the control account. In some instances, it may be logical to segregate the LOE work effort into a separate control account. The objective is to identify and resolve the issue before the performance measurement baseline (PMB) is set.

EAC Realism

One DOE metric uses the TCPI and this involves a comparison to the CPI. This falls in the Analysis and Management Reporting subprocess. This DOE EVMS Metric Specification states: “This metric confirms that estimates of costs at completion are accurate and detailed.” As noted above, the metric compares the cost performance efficiency so far to the cost efficiency needed to achieve the EAC and is specific to the EAC a control account manager (CAM) would review for their scope of work. Depending on the level actual costs are collected, this analysis may need to be performed at the work package level instead of the control account level.  

Here is the formulation DOE uses assuming actual costs are collected at the work package level.

F.05.06:  Work Package CPI – EAC TCPI > ±0.1
X = Number of incomplete (>10% complete) work packages where CPI –TCPI > ±0.1.
Y = Number of incomplete (>10% complete) work packages in the EVMS cost tool.
Threshold = 5%

There is no requirement that the forecast of future costs has a linear relationship with past performance. While there may be legitimate reasons why future cost performance will fluctuate from the past, outside reviewers who receive EVM data will look for a trend or preponderance of data that would indicate the EACs are not realistic. When a significant number of active work packages are outside the ±0.1 CPI-TCPI threshold, it is an indication that the EACs are not being maintained or are driven by factors other than project performance.

Best practice tip: Run this metric every month for each active work package prior to month-end close. For those work packages outside the ±0.1 threshold, review the EAC to ensure it is an intentional forecast of costs given the current conditions.

Process and procedure tip: One of the training courses H&A earned value consultants often conduct is a Variance Analysis Reporting (VAR) workshop. This workshop is designed to help CAMs become more proficient with using the EVM metrics to assess the performance to date for their work effort, identify the root cause of significant variances, and document their findings as well as recommended corrective actions. This analysis includes verifying their estimate to complete (ETC) is a reasonable assessment of what is required to complete the remaining authorized work and their EACs are credible.

 

Additional References

Further discussion on using the CPI and TCPI to assess the EAC realism at the project level can be found in the DOE CAG, Analysis and Management reporting subprocess, Estimates at Completion. This section provides a good overview of comparing the cumulative to date CPI to the TCPI as well as comparing an EAC to calculated independent EACs (IEACs) for further analysis to assess the EAC credibility. 

Interested in learning more about using EVM metrics as a means to verify EACs at the detail or project level are realistic? H&A earned value consultants can help you incorporate best practices into your processes and procedures as well as conduct targeted training to improve your ETC and EAC process. Call us today at (714) 685-1730.

Using Earned Value Management (EVM) Performance Metrics for Evaluating EACs Read Post »

Scroll to Top