Earned Value Management (EVM)

Maximizing the Value from Integrated Baseline Review (IBR) Investments 

, , , , , , , ,

A previous blog, How Integrated Baseline Reviews (IBRs) Contribute to Project Success, provided an overview of the purpose and scope of IBRs as well as the benefits of conducting an IBR. This blog adds to the discussion on the benefits of conducting an IBR. It reflects observations gathered from our earned value consultants while assisting clients to prepare for IBR events

As a reminder, IBRs provide the opportunity to verify the:

  • Contractor and the customer have a common understanding of the scope of work, technical requirements, and accomplishment criteria. 
  • Contractor has established an executable performance measurement baseline (PMB) for the entire contractual scope of work that accurately reflects how they plan to accomplish the work within the contractual period of performance, negotiated contract cost, and funding profile. 
  • Required resources have been identified and assigned to the project to accomplish the project’s objectives. For example, the staffing plan accurately reflects the sequence of work as well as resource availability and demand.  
  • Technical, schedule, and cost risks/opportunities have been identified, assessed, and captured in a risk/opportunity register. Risk mitigation actions have been incorporated into the PMB to reduce known threats to an acceptable level. This is often the most valuable component of the IBR to ensure all parties have an understanding of the risks/opportunities, assumptions, and risk mitigation or opportunity capture plans. 

Factors that Contribute to a Successful IBR

Treating an IBR as just a contractual requirement limits its value to all parties. IBRs are essential to the successful execution of any project. IBRs require a focused mindset to clearly define as well as assess the measurable benefits gained for the time and effort invested in the IBR. From our observations, contractors that defined what they expected to gain from an IBR, whether the IBR was contractually required or not, made a measurable difference in the outcomes from the IBR. The effectiveness of an IBR is contingent upon management’s commitment to excellence in implementing their EVMS and their desire to ensure they have reliable and useful data for management visibility and control. And that begins with establishing an executable PMB. 

The following list of factors often influence the perceived value of an IBR and hence the approach a contractor takes to planning and conducting their IBRs. 

  • Recognizing the relative importance of the review.
  • Defining the value or measurable benefits they expect to gain from conducting the review.
  • Well defined risk/opportunity management process. 
  • Timely and sufficient review planning and preparation.
  • Joint or collaborative planning and preparation.
  • Well defined objectives as well as entrance and exit criteria. 
  • Tailoring the IBR approach to best accomplish the review objectives.
  • Communication and expectation management.

These factors were ultimately indicative of whether the IBRs were considered value-added (retrospective assessment by the participants) based on the level of understanding, investment in or attention to, or the degree of success in implementing these factors. Based on H&A earned value consultant’s observations, the single factor that tends to drive the IBR approach is clearly defining the value the contractor expects to gain beyond what is mandatory or contractually required. 

IBR Investment Value

The term “IBR investment value” is purposefully used here. The intent is to invite you to re-assess how IBRs are viewed apart from simply meeting government agency IBR requirements. “IBR investment value” is used to mean a qualitative assessment that encapsulates the value-add or measurable benefits teams often have difficulty defining as well as to help provide the impetus and guiding direction for conducting an IBR. It has both intrinsic and extrinsic properties. 

The intrinsic value of the IBR investment resides in those specific elements of information (as identified by the customer in the form of questions or concerns) that are either exchanged, clarified, or refined through the course of discussions between the customer and performing contractor teams. This intrinsic value can be measured by how well the exchanged information supports:

  • A complete, clear and mutual understanding of the work to be accomplished.
  • The resources needed to get the work done.
  • The detailed plan to perform the work.
  • What resources are available to support the plan.
  • What’s missing or unknown that is needed to complete the work correctly and on time.
  • What risks, issues, concerns, or opportunities are associated with contractor’s concept that need to be fully considered to make the plan work. 

The extrinsic value of the IBR Investment rests wholly in the quality of the exchanges (discussions), and the resulting actions generated from the discussions. This extrinsic IBR value addresses how appropriate, rich and comprehensive the information exchanges were, and answers to questions, such as:

  • Were the discussions responsive to a list of customer information requirements and concerns? 
  • Were the right discussions held? At the right level of detail?
  • Were the right people involved in each discussion? 
  • Did the discussions provide sufficient context? Were they comprehensive? Complete?
  • Did the discussions address associated risks, issues, opportunities or other concerns? Relationships to other discussions/elements?
  • Were all the customer’s questions or concerns answered to their satisfaction?
  • Were the discussions documented to support decisions? Alternatives? Changes? Studies?

The exchanges of essential information (intrinsic value) and the quality of those exchanges (extrinsic value) when combined directly translate to the investment value achieved from the IBR. It characterizes how well the information exchanged provides both teams with the necessary details to successfully define, schedule, budget, and manage the contracted effort relative to the investment into the IBR process. A realistic, risk adjusted PMB helps to prevent schedule delays and cost overruns during project execution that often impact a contractor’s profit margins and tarnishes their credibility with their customers. 

What are the characteristics of a value added IBR approach?  

A successful approach H&A earned value consultants have observed contractors implement is a structured process corporate management actively participates in to ensure they gain the most value from all IBR events. 

This is often an outgrowth from corporate initiatives to retain top project management talent and establishing an EVMS self-governance process. It is part of a corporate culture that is committed to excellence in project management and sustaining a best in class EVMS – becoming efficiently expert at EVM

What are some common characteristics of their IBR approach?

  • A chartered authority or corporate team responsible for assisting project personnel with IBR events in addition to EVMS implementation, self governance, and customer surveillance events. A good practice we have seen implemented is to establish rotating members on the IBR teams from different projects as a means to pollinate best practices across projects. It also provides an opportunity to mentor top talent on track to move up to higher management positions.  
  • A standard repeatable process with defined measurable outcomes that can be tailored to the unique project requirements or objectives. This includes maintaining a set of materials for the internal IBR team to effectively plan and execute an IBR as well as to close out any action items. Examples include training materials to prepare project personnel, process description with team member roles and responsibility assignments, data call list, role based interview question forms with assessment criteria, data quality assessment materials and tools, list of data traces to be performed, schedule risk assessment tools, risk/opportunity evaluation criteria, defined assessment criteria (technical, schedule, cost, resources), in-briefing and out-briefing templates, and template to capture action items to track to closure. The corporate team is often responsible for actively maintaining the content for the IBR teams and conducting training. 
  • They place an emphasis on two components that directly impact the quality of the schedule and cost data.  This includes:
    • Well-documented data driven basis of estimates (BOEs) that can be substantiated using historical or bench-marked data with the goal of reducing expert judgement cost estimates to the lowest level possible as a risk reduction strategy.  
    • The quality of the risk/opportunity management plan and the content in the risk/opportunity register. This content directly affects the ability of all parties to gain a better understanding of the risks/opportunities and best options to mitigate a risk or capture an opportunity. A well constructed schedule is required to be able to perform schedule risk assessments (SRAs). SRAs help to identify where duration risk exists in the schedule and to determine a level of confidence in meeting major project milestones as well as the project completion date.  
  • They perform internal IBRs as a standard practice on all projects regardless of contractual requirements. This is particularly important when subcontractors are performing a substantial percentage of the work effort. The corporate team often assists Project Managers with conducting a joint IBR with major subcontractors.  

Need help establishing a corporate IBR process?

H&A earned value consultants often help clients to establish a corporate EVM council or center of excellence with defined responsibilities to ensure project personnel effectively implement their EVMS, integrate risk/opportunity management into the EVMS, as well as define and implement a standard repeatable process for IBRs and self-governance. Clients often need assistance establishing a repeatable process for conducting schedule risk assessments, an essential component of the IBR process. A defined process that clearly articulates the expected measurable outcomes from conducting IBRs is one way to ensure all parties gain the most value from the event with the end objective of ensuring a realistic and executable PMB has been established.  

Call us today to get started.  

Maximizing the Value from Integrated Baseline Review (IBR) Investments  Read Post »

Who Should “Own” Earned Value Management (EVM)? Programs or Finance?

, , , , , ,
Who should own erarned value management?

I have read several Earned Value Management (EVM) reports, papers, and articles that debate what company organization should “own” EVM and the company’s Earned Value Management System (EVMS). These debates most often mention the finance department and program organization as common EVM “owners.” The majority opinion seems to be that because EVM is a program management best practice it belongs in the program organization. A minority opinion is that because EVM is denominated in dollars, schedule included, and because EVM reports are financial in nature, EVM belongs in the finance department. Before we dive into this debate, a summary of the responsibilities of a Chief Financial Officer (CFO) and the head of programs is useful. In the Company A and Company B examples to follow, both the CFO and the head of programs reported to the company president.

What are the duties of a Chief Financial Officer (CFO)? 

A CFO has three duties; each measured in the time domain. The first duty of the CFO is as the company’s controller and is responsible to accurately and honestly report past company financial performance. The CFO is also responsible for the current financial health of the company – to ensure that today’s decisions create rather than destroy value. And lastly, the CFO must protect the company’s future financial health and that all expenditures of capital maximize that future financial health. Every business decision, especially those of the CFO, are either good decisions (are accretive – increase shareowner value) or are bad decisions (are dilutive – destroys shareowner value).

What are the duties of the Head of Programs?

The head of programs is typically a Vice President or higher and all program and project managers report to them. The head of all programs has profit and loss responsibility for their portfolio of programs and projects. In addition, each program and project manager is responsible for achieving the technical, schedule, and cost requirements of the contracts they are executing on behalf of the company’s customers. 

A Tale of Two Companies

I have first-hand experience with two companies and how each company decided who should “own” EVM that illustrates the nuances to these two approaches. 

Company “A” had EVM assigned to the finance department. All EVM employees were overhead, even those assigned to a program. A new CFO arrived and quickly decided to reduce indirect costs, declaring that he was “coin-operated.” The new CFO terminated the employment of all EVM employees. Each program attempted to create an EVM branch office but failed. DCMA issued a Level 3 Corrective Action Request (CAR) detailing the EVMS deficiencies and the CFO was fired. A second new CFO arrived and agreed to transfer EVM to the head of programs. The head of programs was instrumental in changing the disclosure statement making EVM personnel assigned to a program a direct charge to that program or contract. The head of programs created a Program Planning and Control (PP&C) organization and demanded all Program Managers and their program members to quickly learn, use, and master EVM. A program control room was built with five screens. Daily 2 pm EVM data-driven reviews were held on short notice. These daily reviews became known as “CAM Bakes.” The EVM and program management culture changed quickly and dramatically at Company “A.”

Company “B” had EVM assigned to the CFO who was as “coin-operated” and unaware of EVM as was the first new CFO of Company “A.” The culture of company “B” was very hostile to EVM, so it probably did not matter who “owned” EVM. The company failed 16 of the EIA-748 Standard for EVMS 32 guideline requirements and they lost their DCMA approved EVMS status. Significant withholdings were imposed and the company’s reputation was damaged. Several top managers hostile to EVM sought employment elsewhere. A new CFO arrived who was also coin-operated – with one difference – the CFO was an expert in EVM. The new CFO formed a partnership with the head of programs. The new CFO was as much a program manager as he was a CFO. The new CFO told his direct reports assigned to each program to “make the program managers successful.” And they did exactly that. 

The new CFO understood that the company was the sum of all its contracts and that every dollar flowed from its customers. The EVM and program management culture at Company “B” changed rapidly.

Who Should “Own” EVM? Programs or Finance?

Returning to our original question of who should “own” EVM, the majority theory is that the program organization should “own” EVM. All else being equal, I tend to agree with this theory. 

However, while theory is suggestive, experience is conclusive. My experience at Company “A” proved that a strong program leader could rapidly change the EVM and program management culture of a company. My experience at Company “B” proved that a CFO could “own” EVM and be successful at changing the company’s EVM and program management culture. The CFO and the head of programs must form an EVM partnership no matter who “owns” EVM. 

Who “owns” EVM at your company? 

Mr. Kenney is a senior business executive with over 35 years of experience in the aerospace industry as well as over 10 years as a consultant to industry. He is an experienced practitioner of program management best practices as an Executive Vice President of Government Programs, Vice President of Naval Programs, and Program Manager at various aerospace and defense contractors. He is also a retired U.S. Marine Corps Colonel with 27 years of active and reserve duty. 

Who Should “Own” Earned Value Management (EVM)? Programs or Finance? Read Post »

Earned Value Management (EVM): How Much is Enough?

I took the scenic route to selecting the theme of this blog. First, it was suggested that I write a blog on the benefits and costs of the earned value process as it applies to program management. Next it was suggested that I describe the harm of not using any of the elements of the earned value process.

This blog summarizes my observations of how companies have chosen “how much EVM is enough” for them and share my observations of the results of these decisions. Each company has selected an EVM implementation strategy and each company’s strategy falls along a bounded continuum.

Two Goal Posts and a Cross Bar

There are as many strategies for implementing earned value management as there are companies using EVM to manage their programs and projects.

I will describe this continuum of company EVM strategies as a left goal post and a right goal post with the space between as a cross bar. The “left goal post” represents companies that elect to be very poor at EVM or to not use EVM at all. The “right goal post” represents companies that have committed to being “best-in-class” practitioners of the EVM process and are the polar opposite of the companies at the left goal post. There are few companies at either the left or right goal posts. The “cross bar” represents the vast majority of companies that have selected an EVM strategy somewhere between the left and right goal posts.

Left Goal Post: The Unwilling

I have firsthand experience with a company that at the time I initially joined them, had decided to ignore earned value management even though it was a requirement in several of its contracts. After many painful years of attempting to maintain this EVM resistant strategy, this company decided that a better strategy would be to become an “efficiently expert” at EVM.

Cross Bar: Merely Compliant at EVM

It has been my experience that most companies desire to become “EVM compliant,” which generally means being compliant with the EIA-748 Standard for EVMS 32 guidelines and to avoid failing to comply with those guidelines that could result in losing their approved or certified EVMS status. This is the vast middle ground between the two goal posts. I have five observations regarding companies in the “cross bar” majority.

Observation #1: Compliance as a Goal

Compliance should be a given or a pre-condition, not a goal. Remaining merely compliant implies a status quo or static posture.

I will use the game of golf as an analogy. Golf is a game of honor and compliance to well established rules. All PGA professional tour golfers “comply” with the rules that govern golf. Although all PGA tour pro golfers comply with these rules, their performance on tour differs dramatically.

Ninety percent of all PGA golf pros, past and present, have no tour wins. That means only 10% of all PGA tour golf pros have won at least a single PGA tour. There are seven players in the history of the PGA that have fifty or more tour wins. If the bar is lowered to forty or more wins, only three players are added to the list. If the bar is lowered yet again to thirty or more tour wins, only eight more players are added to the list. Only 18 golfers have won 30 or more PGA tournaments.

Professional golfers do not confuse compliance with performance, nor do these professionals assume that “being compliant” will improve their performance.

Observation #2: The Tyranny of the Status Quo

With apologies to Milton Friedman and his book of the same name, companies that attempt to maintain mere guideline compliance will do no better than the status quo, and often regress toward non-compliance. Maintaining status quo is a myth – you either improve or regress.

All professionals, companies included, must compete in their markets and selected fields. To succeed in this competition requires constant improvement in areas critical to success. A company, organization, or individual without the means or the desire to improve will eventually fail and perhaps perish.

Observation #3: Blaming the Scoreboard

As a program manager, I considered EVM as my scoreboard. I reacted to the EVM data – the scoreboard – and made decisions based on that data (Guideline 26: Implement managerial actions taken as the result of earned value information).

I recall the 2024 Super Bowl’s final score: Chiefs 25, 49ers 22. Did the scoreboard cause the 49ers to lose the game or did a poor decision by their coach cause the loss?  Imagine a coach that cannot see the scoreboard. That coach does not know the score or how much time remains. That coach cannot react to the realities of the game.

Observation #4: EVM Causes Poor Program Performance

I have witnessed several company leaders assert that the use of EVM on a poorly performing program is the cause of that program’s poor cost and schedule performance. A correlation between two variables, or a sequence of two variables (use of EVM and poor performance), does not imply that one caused the other. This is the logical fallacy known as “X happened, then Y happened, therefore X caused Y.”  Night follows day, but day does not cause night. Use of EVM does not cause poor program performance. Not reacting to EVM data and promptly taking corrective action with your program’s cost and schedule performance often leads to poor outcomes.

Observation #5: It Takes More Energy to be Poor at EVM than to be an Expert

Returning to the earlier golf analogy, professional golfers make very difficult shots appear easy. I played in a pro/am tournament years ago. The pro I was teamed with took me to the range hours before our tee time. He asked me how many balls I hit before each round. I told him sometimes none and sometimes 50. He hit 1,000 balls before our round. When we finished our round, he was ready for another 18 holes. I was not. Both of us “complied” with the rules of golf. His score was significantly lower than mine. His game was effortless and produced a below par score. My game was labored and produced a poor result.

It is the same with EVM or any other process. The better you are at a skill, the easier it becomes. Experts consume far fewer calories at their craft than ambivalent amateurs.

Right Goal Post: Efficiently Expert at EVM

The polar opposite of a resistant EVM strategy is a strategy to become “efficiently expert.”  As I mentioned earlier, I joined a company that attempted to sustain an EVM resistant strategy. Their EVM strategy led to de-certification, large dollar withholdings, and significant damage to their corporate reputation.

After the most ardent EVM opponents in this company sought employment elsewhere, a new strategy was adopted. This company embraced a strategy to become “best-in-class” as expert practitioners of EVM. This company’s goal was EVM perfection. EVM perfection is an impossible ambition, but wiser than “mere compliance.”  And as with the PGA tour golf pro, EVM became nearly effortless.

Which EVM strategy will your company choose?

Mr. Kenney is a senior business executive with over 35 years of experience in the aerospace industry as well as over 10 years as a consultant to industry. He is an experienced practitioner of program management best practices as an Executive Vice President of Government Programs, Vice President of Naval Programs, and Program Manager at various aerospace and defense contractors. He is also a retired U.S. Marine Corps Colonel with 27 years of active and reserve duty.

Earned Value Management (EVM): How Much is Enough? Read Post »

Improving Integrated Master Schedule (IMS) Task Duration Estimates

, , , ,
Improving Integrated Master Schedule (IMS) Task Duration Estimates

One of the top reasons projects fail is because of poor task duration estimating for an integrated master schedule (IMS). Without accurate and consistent estimates, project outcomes can become unpredictable, leading to missed deadlines, budget overruns, and overall project failure. A realistic schedule is required to place the necessary resources in the correct timeframe to adequately budget the work as well as to produce credible estimates to complete and to forecast completion dates. While missed deadlines and budget overruns are detrimental for any project, there can be additional business ramifications when producing schedules in an Earned Value Management System (EVMS) contractual environment.

While there are effective methods available to improve task duration estimates, they are often underutilized. A common reason for this oversight is the lack of time allocated to developing the project schedule and determining task durations.

During the proposal phase, initial durations are typically estimated at a more summary level than the detailed execution phase. The proposed work is often defined at a level one to two steps higher than where the actual tasks will be performed. After project initiation, the team’s initial effort is to break the work down into more manageable tasks. This decomposition is crucial for achieving more accurate estimates. It’s no surprise, then, that the initial breakdown efforts often result in duration estimates that don’t align with the proposed durations.

Parkinson’s Law tells us that work expands to fill the time available. If task durations are excessively long, costs will inevitably rise. To counter this, it’s important to require estimators to provide both the estimated effort and the duration needed to accomplish the task. This approach helps to gain a better understanding of the scope of the task and to avoid unrealistic estimates. If you see a task that requires 10,000 hours with a duration of 2 weeks, then you immediately would suspect something is wrong with the estimates.

Techniques for Developing More Accurate Task Duration Estimates

What are your options? H&A earned value consultants and senior master schedulers often employ the following techniques to help a client produce a more realistic IMS.

  1. Establish a Probability Goal. It is essential to set clear expectations for the estimating team. Without guidance, teams may default to estimates with a 50/50 probability of success, which is a recipe for failure. Instead, directing the team to aim for estimates within a 75% to 80% probability range can lead to better outcomes.
  2. Break Down Tasks. Decompose tasks into smaller, more manageable components. The further out the task’s horizon, the greater the variability in estimates. For example, asking someone to estimate the drive time from Washington, DC, to Boston without specifying the vehicle, route, limitations, or conditions introduces unnecessary uncertainty.
  3. Use Professional Judgment. Engage someone with experience in the specific type of work required for the task. A seasoned expert will provide more accurate duration estimates based on their knowledge and experience. Often, we ask the potential task manager to do the estimate, but that person may not be the one with the most related experience or knowledge about the work.
  4. Leverage Historical Data. If the task or a similar one has been done before, use that historical data to inform the estimate. This approach provides a realistic benchmark for future estimates.
  5. Use generative AI. If you have access to an AI capability along with access to historical data, that could be an option to leverage the source data using specific prompts to glean relevant information. As with all AI tools, always verify the generated results to ensure it is a useful basis to substantiate the estimate.
  6. Apply Parametric Estimating. When possible, use parametric analysis to estimate the durations. For example, if it took a specific number of days to clean up a certain amount of toxic waste under similar conditions, this data can be used to estimate the duration of a new but comparable task.
  7. Engage Multiple Estimators. Gathering estimates from more than one person helps to reduce individual biases and provides a more rounded estimate.
  8. Apply the Delphi Method. This technique involves three knowledgeable individuals providing estimates or three-point estimates. The initial estimates are analyzed, and the results are shared with the estimators without attributing specific values to any individual. After discussing the findings, the estimators revise their estimates based on the collective insights, leading to a more refined and accurate duration estimate.
  9. Use Three-Point Estimates. Ask estimators to provide best-case (BC), most likely (ML), and worst-case (WC) durations, along with their reasoning. Applying a formula like the Program Evaluation and Review Technique (PERT) duration formula (1BC+4ML+1WC)/6 can yield an adjusted and realistic estimate. You can vary the best and worst case estimate for risk if you have information on that.

    To see how this simple approach can work, walk through this exercise. Ask yourself how long it takes you to drive to work most of the time. Let’s say the answer is 45 minutes. Then ask yourself how long it would take on a Sunday morning in the summer when the roads were dry (the best case). Let’s say your answer is 25 minutes. Then ask yourself how long it would take on a Monday morning in the winter during a moderate snow event (the worst case). You tell yourself 90 minutes. Now you have enough information to calculate the PERT duration.

    Best Case = 25 minutes
    Most likely = 45 minutes
    Worst Case = 90 minutes
    PERT Duration = (25 + 180 + 90)/6 = 49 minutes

    Finally, let’s say you ask yourself how likely it is that you end up on the high side instead of the low side. If your answer is it is much more likely to encounter conditions that slow you down, you would modify the formula to use one and a half times the worst case (25 + 180 + 135)/6 = 57 minutes. That longer duration shows the impact of your impromptu risk analysis and provides a duration that has a much higher probability of being achievable.

    Now think about the same scenario but conducted by you interviewing three people who drive the same route to work. That would approximate the Delphi method.
  1. All or something less. It may not be necessary to analyze every task to the degree suggested. Even if you could do the analysis along the top several critical paths that would be an improvement. If you were to apply numerical factors to the tasks in related portions of the project that would be impactful. For example, all mechanical design tasks or all software development tasks.

What is the best approach?

You will need to analyze your project and determine which approach or approaches would yield useful information at a reasonable cost. If you apply your own thinking on how to improve your duration estimates, you will undoubtedly find a method most suitable for your situation. Depending on a project’s complexity and risk factors, you may also find it useful to take a more formal approach. Conducting a schedule risk assessment (SRA), a probabilistic assessment of a project’s outcome, can help you gain a better understanding of where the duration risk exists in the schedule.

H&A earned value consultants and scheduling subject matter experts often assist clients to establish basic guidance to help scheduling personnel to get into the habit of adequately defining tasks and using techniques to improve duration estimates. This is critical to be able to produce well-constructed and executable schedules to improve the likelihood of achieving project technical, schedule, and cost objectives.

H&A offers a range of project scheduling training workshops that can help schedulers to implement industry best practices. These workshops also cover how to take the next step to implement advanced scheduling techniques such as schedule risk assessments to ensure the schedule is realistic and achievable. H&A earned value consultants and master schedulers often provide one-on-one mentoring using the scheduling tool of choice to help scheduling personnel work through the learning curve of using advanced network scheduling techniques to produce executable schedules.  

Call us today at (714) 685-1730 to get started.

Improving Integrated Master Schedule (IMS) Task Duration Estimates Read Post »

Merging Earned Value Management System Descriptions

, , ,

Are there best practices that apply when a company with an approved/certified Earned Value Management System (EVMS) acquires another company that also has an approved/certified EVMS in place? What happens with the EVM System Descriptions as well as related processes and procedures? What about the various project control tools being used? How do you level set the project control proficiency levels of personnel using the EVMS? Schedule and cost level of detail and data architecture also come into play. For example, project performance data is often used at the corporate level for financial analysis, portfolio analysis, and external reporting and may require data to be organized in a specific manner. Is the EVMS providing reliable status, forecast completion date (FCD), and estimate at completion (EAC) information to management? 

What are your options?

H&A earned value consultants have observed different approaches and often assist companies with determining their strategy. Assuming you are the acquiring company, you could:

  1. Require the acquired company to use your EVMS. 
  2. Let them continue using their EVMS for an agreed upon timeframe or indefinitely.
  3. Take the best of both and establish a new and improved EVMS.  

Each option has its pros and cons. There are also other implications for at least the acquired company. DCMA will need to conduct an Integrated Baseline Review (IBR) and/or a compliance review if the acquired company’s EVMS assessment is no longer applicable. If you make significant modifications to your EVM System Description, DCMA will need to review the revised System Description to determine whether it still complies with the EIA-748 Standard for EVMS guideline requirements.

Things to Consider

  • What do you want to achieve?

    If the goal is to establish a common EVM System Description across the corporation, the strategy will need to reflect that. Define the business objectives that clearly articulate the benefits of using a standardized approach that can help to create and implement the plan to achieve your goal. In this example, that could narrow your path forward to either option 1 or 3 depending on the state of your EVMS.

  • What is the state of your current EVM design and System Description?

    Do you already have a best in class corporate level system in place? If yes, option 1 is a good fit. The strategy would be to create a plan to transition the acquired company to your EVMS. A single EVMS is easier to maintain and to train people on how to use it effectively. Commonality makes it easier to move personnel between projects.

    Perhaps your company is fine with different EVM Systems at a business unit level. For example, perhaps the business units have a different customer base (DoD versus DOE), and the requirements are different. In this case, it may make sense to go with option 2. We recommend being prepared to do an in-depth assessment of the acquired company’s EVMS to become familiar with it, gain an understanding of how project personnel use it, and evaluate the quality of the schedule and cost data. It is imperative that you have a good understanding of the strengths and weaknesses of the acquired company’s EVMS. You may find best in class practices that you could incorporate into your EVMS. On the other hand, you may discover issues you need to address with a corrective action plan. Some of them may be as simple as providing desktop instructions for the schedulers or control account managers (CAMs). The more difficult are actions taken to change the culture such as resistance to providing visibility into the data.

    Option 3 may be good path in situations where you know there are components in your EVMS that need to be streamlined or enhanced. It provides an opportunity to fix known issues with your EVM design or System Description. It could also be an opportunity to replace a mix of software tools or home-grown tools with a standard set of commercial off the shelf (COTS) schedule, cost, and analysis as well as risk tools. Integration with a standard Agile tool may also come into play. In this case, your strategy may be to create a working group from both companies to create a best in class corporate EVMS. 

  • Structure of the EVM System Description.

    There may be “layers” to it that makes it easier to accommodate unique business unit environments. For example, perhaps you have established a corporate level System Description that states what the company does to comply with the EIA-748 guidelines when an EVMS is contractually required or what is required to satisfy internal management needs for project/portfolio analysis (no external customer management system or reporting requirements). The corporate level system should define specific rules all business units are expected to follow. The business units define how they comply with the corporate requirements (their specific process). A good approach is to also allow project managers to define project directives to specify project unique requirements as long as they comply with the corporate and business unit requirements.

    In this example, option 1 is a good fit. The strategy would be to help the acquired company to establish revised EVM processes that align with the corporate requirements similar to other business units in the corporation.

Other Considerations

Your strategy and tactical plan must address identified risks and opportunities. A common challenge is resistance to change. A potential risk mitigation approach could be to bring in the acquired company’s personnel as part of a joint corporate management team with the goal to create a single best in class EVMS. It is essential to establish ownership in the new or revised process. An example from one H&A client illustrates the importance of taking ownership in the EVMS as part of a successful transition.

“We didn’t force what we had on them, nor did we give in. We have a corporate EVM System Description. When we acquired the company, we brought them in to do a revision of the System Description, as the decision was made that we will operate as one company. They are now using that System Description and are using the same EVM cost tool. We are working other initiatives to harmonize other systems. It was surprisingly not contentious. We incorporated their leads into the organization with minimal disruption. We also have corporate training, which they supported and some of their legacy folks are leading that. The company as a whole changed, rather than forcing our way on them. Not many major differences between us, but inclusion of the folks from the acquired company as well as business groups was key. Frankly, one of our legacy divisions was harder to work with than anyone from the company we acquired.” – EVMS Director, A&D Contractor

While this is an example of where things went well, your risk mitigation approach should be prepared for situations where the teams do not agree upon the documented process, tools, or training that could result in an impasse. Knowledge of the current internal environment and personnel mix can help to determine the best mitigation strategy. A strong leadership team must be in place to ensure teams are working to achieve common objectives and to amicably resolve differences with a target completion date.

The tactical plan must also include a robust training plan that covers the revised EVMS process, procedures, and any new tools. This is critical to ensure project personnel gain a good understanding of what changed, who is responsible for what, workflow, requirements such as data coding or level of data detail, and how to use the tools effectively. Role based training is often useful to ensure project control personnel, schedulers, CAMs, and others are following the documented procedures specific to their day-to-day tasks. Desktop instructions are also useful to ensure project personnel are using the software tools effectively in alignment with the documented process and procedures.

What to do if you find yourself in this situation?

It often helps to start with a gap analysis of your or the acquired company’s EVM design and System Description as well as assess how project personnel implement the system and the quality of the data. H&A earned value consultants often conduct an EVMS gap analysis to provide a fact-based and independent analysis of the EVMS, project personnel proficiency levels, and quality of the schedule and cost data. Once you are able to identify and quantify the strengths and weaknesses of the system, you are in a better position to determine your best strategy that aligns with your corporate business objectives and goals.

Over the years, H&A earned value consultants have observed first-hand what strategies and tactics for designing and implementing a best in class EVMS ensures success in a variety of business environments. We can also help you avoid common pitfalls that can derail the best laid plans – it is often the case a client didn’t realize there were hidden risks, or they had made incorrect assumptions.

We can help you determine the right strategy for your situation. Call us today at (714) 685-1730 to get started.

Merging Earned Value Management System Descriptions Read Post »

Introduction to the Cost and Software Data Reporting (CSDR) Reporting Requirements

, , ,

A common client request is to assist them with sorting through the various DoD contractual reporting requirements and contract value reporting thresholds that apply. We frequently run into situations where a contractor needs clarification on why they have a Cost and Software Data Reporting (CSDR) requirement and whether they should seek to waive the requirement. Subcontractors to a prime often question the requirement to provide actual cost data directly to the DoD, especially for Firm Fixed Price (FFP) contracts.

Background

CSDRs are the primary means the DoD uses to collect data on the development, production, and sustainment costs incurred by contractors performing DoD acquisition contracts. It is a DoD system for collecting actual costs, software data, and related business data. The resulting data repository serves as the primary source for contract cost and software data for most DoD resource analysis efforts including cost database development, applied cost estimating, cost research, program reviews, analysis of alternatives (AoAs), and life cycle cost estimates.

CSDR reporting requirements are determined by the contract value regardless of the acquisition phase and contract type. In general, CSDR reporting is required for Acquisition Category I-II programs and Information System (IS) programs valued at more than $50M. They can also be required for Middle Tier Acquisition programs (greater than $20M) and other programs (greater than $100M). Risk can also be a determining factor regardless of the contract value.

DoD Instruction (DoDI) 5000.73, Cost Analysis Guidance and Procedures (March 2020), provides additional details about the cost data reporting. Table 1 in the 5000.73 lists the cost reporting requirements contract value thresholds. The DoD Manual 5000.04 Cost and Software Data Reporting (May 2021) is the primary requirements document for the development, implementation, and operation of the DoD CSDR system to ensure data reported is accurate and consistent.

About CADE

The Office of the Secretary of Defense Cost Assessment and Program Evaluation (OSD CAPE) established the Cost Assessment Data Enterprise (CADE), a secure web-based information system that hosts the controlled unclassified CSDR repository, the Defense Acquisition Cost Information Management System, and the forward pricing rate library. CADE also contains a selected acquisition report database, a contracts database, data analytics capabilities, and a library containing cost estimating content such as cost analysis requirement descriptions and cost estimates. CADE is access-controlled, and available through the public-facing CADE Portal website.

Similar to the cost estimating and proposal pricing functions within contractor’s organizations that rely on historical actual costs to assess the validity of a proposed cost estimate, independent and sound cost estimates are vital for effective DoD acquisition decision making and oversight. CADE plays a critical role in capturing the expenditure, technical, and programmatic data after contract execution in a consistent manner to enable independent cost estimating and analysis. This cost estimate data is essential to support efficient and effective resource allocation decisions throughout the planning, programming, budgeting, and execution process for the DoD.

CSDR Reporting Requirements

There are a series of Data Item Descriptions (DIDs) for this reporting requirement.  Some forms are submitted electronically using DoD defined XML schemas, Excel, or JSON encoded data in accordance with a File Format Specification (FFS) and Data Exchange Instruction (DEI). The list of DIDs are as follows. These DIDs can be downloaded from the CADE website.

  • Contract Work Breakdown Structure, DI-MGMT-81334D (May 2011).
  • Cost Data Summary Report, DI-FNCL-81565C (May 2011), DD Form 1921, XML Schema.
  • Functional Cost-Hour Report, DI-FNCL-81566C (September 2015), DD Form 1921-1, XML Schema.
  • Progress Curve Report, DI-FNCL-81567C (May 2011), DD Form 1921-2, XML Schema. 
  • Sustainment Functional Cost-Hour Report, DI-FNCL-81992 (May 2011), DD Form 1921-5, XML Schema.
  • Contractor Business Data Report, DI-FNCL-81765C (March 2021), DD Form 1921-3, Excel. 
  • Software Development Report, DI–MGMT-82035A (October 2022), DD Form 3026-1, XML Schema. 
  • Software Maintenance Report, DI–MGMT-82035A (October 2022), DD Form 3026-2, XML Schema.
  • Enterprise Resource Planning (ERP) Software Development Report, DI-MGMT-82035A (October 2022), DD Form 3026-3, XML Schema.
  • Cost and Hour Report (FlexFile), DI-FNCL-82162 (November 2017), JSON encoded data file following FFS and DEI.
  • Quantity Data Report, DI-MGMT-82164 (November 2017), JSON encoded data file following FFS and DEI.
  • Maintenance and Repair Parts Data Report, DI-MGMT-82163 (November 2017), Excel.
  • Technical Data Report, DI-MGMT-82165 (November 2017), Excel.

The Cost and Hour Report (FlexFile) and Quantity Data Report play a critical role in collecting cost data from contractors for the DoD data repository because they use JSON data encoding to organize the content. They are intended to replace the legacy 1921 series of paper-based formats including the DD 1921, 1921-1, 1921-2, and 1921-5. It also requires contractors to provide significantly more historical cost data than the 1921 formats. As a result, the DoD cost estimating community has additional insight into historical costs. The goal is to establish a common framework and standard nomenclature to collect data from different contractors, all of them with unique cost accounting structures, that are mapped to the DID, FFS, and DEI requirements for use in the data repository.

Establishing a Consistent, Repeatable Process to Produce the CSDR Data Deliverables

For contractors new to the CSDR reporting requirements and in particular, the FlexFile JSON data encoding, can appear to be daunting. That’s where software tools such as those from Midnite Dynamics can help. Midnite Dynamics specializes in assisting contractors with producing the CSDR data deliverables. 

Their software tool, C*CERT+, streamlines, automates, validates, and produces the legacy 1921 family of Excel and XML reports as well as the FlexFile and Quantity Data Report JSON submittals. C*CERT+ eliminates what otherwise is a manually intensive, resource draining, tedious and costly effort subject to recurring rejections. It is one thing to create the required legacy reports or FlexFile JSON files for submittal, it is another to pass the submittal validation process. C*CERT+ provides numerous data validations and analysis reports to ensure the data is 100% compliant before it is submitted. For example, the software includes over 90 FlexFile validations to ensure data compliance as illustrated in Figure 1.

Figure 1: Example of FlexFile data validation results.
Figure 1: Example of FlexFile data validation results.

The software includes a Validation and Remarks utility to analyze the source data details that could result in a Validation Trip. Remarks can be entered directly into the validation module for anything that requires an explanation. This is illustrated in Figure 2. This narrative is included with the data submittal.

Figure 2: Example of providing remarks about the FlexFile data content.

C*CERT+ also interfaces with existing EVM cost tools and accounting systems to produce the existing legacy 1921 reports, the FlexFile, and other data submittals as well as to consolidate separate projects/CLINs/task orders into a single contract report.

Once the C*CERT+ Standard Category Mapping Rules are set up, they can be shared throughout the corporation or business unit to establish a standard and repeatable process for producing the data deliverables. This mapping process translates the contractor’s source data into an output that matches the CSDR data submittal format rules. This saves a tremendous amount of time and makes it much easier to consistently produce the CSDR data deliverables. An example of the Mapping Rules is illustrated in Figure 3.

Figure 3: Mapping Rules translate contractor unique cost data into a format that matches the CSDR data submittal requirements.

Do your process and procedures or training materials need an update to include specific guidance for project control teams to produce required DoD contractual reports or data submittals using your tool sets of choice? Give us a call today at (714) 685-1730 to get started. 

Introduction to the Cost and Software Data Reporting (CSDR) Reporting Requirements Read Post »

Scroll to Top