EVM and Unified Risk Management

By / / , , , ,
, , , ,

Working with numerous clients, H&A earned value consultants have observed many instances where project management teams consider the risk and opportunity (R&O) management process to be something technical in nature, run by engineers and focused on the technical aspects of the project’s product. Meanwhile, there is often a separate risk process going on much less formally to consider risks in terms of the project’s schedule and cost goals. This bifurcated approach is a source of risk itself.

Procuring agencies such as the DoD, NASA, DOE, and others have published their own risk management guides. The Government Accountability Office (GAO) has various reports on this topic including examples of their findings. DCMA mentions risk in their Business Practice 4  Guideline Evaluation Template (GET) Process/Implementation Verification Points often used by contractors to check whether their earned value management system (EVMS) meets the intent of the EIA-748 Standard for EVMS guidelines. The exact questions asked by DCMA are important but the overall idea that risk and EVMS are co-dependent is the critical aspect. This is also true for the DOE. They identify risk management as one of the 10 subprocesses necessary for an EVMS.

Setting the Stage

Risk is defined as a factor, element, constraint, or course of action that introduces an uncertainty of outcome that should it occur, could negatively impact the ability to meet the project’s planned technical, schedule, or cost objectives. Negative impacts are sometimes called a threat where the objective is to mitigate the risk. A realized risk becomes an issue that must be resolved to minimize the impact. An opportunity is defined as a positive risk where the objective is to capture the beneficial impacts. Opportunities are not as common as threats.

R&O management is defined as the process of identifying, assessing, and responding to risks and opportunities throughout the project’s life cycle. The goal of R&O management is to identify potential risks and opportunities, determine the likelihood or probability the risk or opportunity will occur, and determine the impact should a risk be realized, or an opportunity is captured. Risks and opportunities are prioritized so that those with greater impact and a higher probability of occurring receive a greater share of resources and attention.

In this blog, we are using the term risk with a focus on the negative impacts or threats to a project.

Example of Common Project Risks and Risk Assessment Approach

H&A’s senior management routinely reviews literature, considers our work with clients, and discusses with our earned value consultants the main contributors to project failure. These findings are updated regularly and presented in H&A training materials as an Ishikawa Fishbone Cause and Effect diagram. Figure 1 is an example of this type of diagram. 

Figure 1: Example of an Ishikawa Fishbone Case and Effect Diagram

Figure 1: Example of an Ishikawa Fishbone Case and Effect Diagram

When this approach is used for risk assessments, each contributing risk is assessed, and the response documented. An example of a risk/response table is shown below for the first three identified risks.

Risk ItemGood Example of a Real Project Response to an Identified Risk
Poor communicationsGoals are known and documented. Communications plan is in place. Have an established cadence for weekly internal and customer meetings to quickly resolve issues. An internal project performance management dashboard is updated daily with current data. Updated IMS and risk register are broadcast weekly to the team. A strong business rhythm has been established.
Scope creepWork scope (requirements and SOW) are well defined and a change control process is in place. Performers are trained in spotting scope creep and how to handle potential changes in scope.
Inaccurate cost estimateImplemented a process enabling cost estimators to search historical actual cost data, identify analogous tasks, substantiate, and document the basis of estimate. For high risk areas, techniques such as the Delphi method, SMEs, and non-advocate reviews are used. Performance is constantly monitored to spot work elements where the actual costs do not align with the budgeted costs or the estimate at completion (EAC) is triggering internal variance at completion (VAC) thresholds. 

This same type of approach can be used by the project control team to create risk Ishikawa diagrams to identify technical risks that could impact the ability to achieve schedule and cost goals. Likewise, risk Ishikawa diagrams can be used to identify risks in the integrated master schedule (IMS) and time phased budget or estimate to complete (ETC) and EAC.

A Unified Approach to Risk

A unified approach includes technical, schedule, cost, and other risk identification and assessment that is an integral part of a contractor’s EVMS. R&O management should be integrated into the EVMS subsystems including work organization, planning and scheduling, work authorization and budgeting, management analysis and reporting, and change management. 

Identified risks are analyzed and quantified to develop a risk handling strategy. Where applicable, risk mitigation tasks have been entered into the IMS. Ideally a schedule risk assessment (SRA) has been completed to gain an understanding of duration risks that can help to improve the accuracy of the schedule. Assuming the IMS is resource loaded and leveled, the result is a more accurate time phased budget plan as it incorporates the risk handling strategies when the performance measurement baseline (PMB) is established. The R&O process also provides the necessary rationale for determining the budget amount set aside for management reserve (MR).

The R&O assessments should be a normal part of generating the Variance Analysis Reports (VARs) and updating the ETC and EAC. These assessments can also drive the need for processing baseline change requests (BCRs) as well as determining the best approach for corrective actions. 

Using Directed Searches of Identified Risks

To facilitate a unified approach, we recommend establishing a cadence of standing risk review sessions that are conducted in a methodical way to ensure the project manager, integrated product team (IPT) leads, control account managers (CAMs), schedulers, and financial analysts routinely walk through the identified risks that have the potential to impact the project’s IMS or time phased cost.

The intent is to establish a framework such as Ishikawa diagram to guide the risk review session, a directed search of the identified risks should anything further need to be addressed. It is important that a “does anyone have a risk to suggest” approach is not used. Every topic should be covered in every session by walking the Ishikawa risk items. Most of the time it will be a quick “no change” response. Separate Ishikawa diagrams could be used to guide the discussions for the contributing technical, schedule, and cost risks. The meeting room should have the ability to view the live IMS, cost data, and performance analysis data. Team members should be prepared to take notes during the meeting to compile action items.

Figure 2 is an example of a basic Ishikawa diagram of IMS risks the project control team could focus on for the risk review session. This would reflect the project control team’s identified risks to the IMS they routinely monitor.

Figure 2: Example of an IMS Ishikawa Fishbone Case and Effect Diagram

Figure 2: Example of an IMS Ishikawa Fishbone Case and Effect Diagram

For example, updating the current schedule every reporting period has the potential to compromise the integrity of the IMS to provide accurate forecast information about the project’s remaining work. Perhaps the project control team has identified a list of contributing schedule status risks, risk response, and example directed questions for each review meeting. These questions could be focused at the CAM level. The following table is a simple example. 

Risk ItemRisk ResponseExample Directed Questions
IMS critical or driving pathsVerify logic. Verify traceability exists and has not been damaged by updates. Review constraints, deadlines, and milestones. Perform data quality check, correct errors.Did milestones move? Did the end date move? What were the baseline dates for starts or finishes that fall into the period?What were the forecasted dates for starts and finishes that fall into the period?What did not happen? Why?
RealismCalculate and assess the Baseline Execution Index (BEI) and Current Execution Index (CEI). Compare the ratio of actual performance to the ratio of future performance.Is the BEI/CEI result within goals? Are there performance discrepancies? Does the forecast need to be updated to align with reality? Is the forecast showing the performance the team can achieve based on what has been achieved?
Quality of ETC/EACVerify updates are occurring. Compare current ETC/EAC to previous ETC/EAC.Has the ETC been updated? What changed and why? For example, for activities with material requirements, price or usage variances may impact the ETC/EAC. For activities with labor requirements, availability or personnel changes may impact future work effort ETC/EAC.

The same approach would be used for guided budget and cost risk discussions. Tailored cause and effect diagrams should be created for a company business environment and each project’s unique characteristics.

Interested in learning more?

H&A’s training courses purposely include content on R&O management and integrating it into the EVMS. H&A’s Project Scheduling as well as Advanced Earned Value Management Techniques (AEVMT) workshops in particular include more discussion on R&O topics.

A company’s EVMS should be designed to aid the identification and management of risks and opportunities. For example, during the process of developing the schedule and budget baseline, activity durations, resource requirements, and budget distribution can be refined to reflect identified and assessed risks. Proactively identifying and managing risks improves project performance. The expectation of specific risks occurring leads to contingency plans that lower the likelihood and impact of risks as well as the establishment of schedule margin and MR to address identified and assessed risks.

Call us today at (714) 685-1730 to get started.

EVM and Unified Risk Management Read Post »

Management Reserve Best Practice Tips

By / / , , , , , ,
, , , , , ,

A recurring theme H&A earned value consultants find themselves discussing with clients is emphasizing that management reserve (MR) is a very precious budget set aside that must be protected and used appropriately. Unfortunately, MR is often used inappropriately, and quickly depleted in the early stages of a project.

What happens when MR is consumed for other uses than what it was intended? There is no budget available for appropriate uses of MR such as for emerging work, rework, redesign, or make/buy adjustments within the scope of the contract when it is needed in the latter stages of a project. When that happens, a project manager is forced to create a “home” for actual costs for these activities. This results in other inadvisable actions such as:

  • Zero budget work packages which are also known as estimate to complete (ETC) only work packages.
  • De earning the budgeted cost for work performed (BCWP) and opening completed work packages to accept charges.
  • Culling budgets from future unopened work packages, and if they exist, planning packages, summary level planning packages (SLPP), and undistributed budget (UB).

These actions will call into question the integrity of the EVMS and EVM data. The customer conducting EVMS surveillance will also be quick to point out this deficiency in the EVMS implementation and raise the issue to ensure it has management’s attention to correct. The inappropriate use of MR has created a cascade of problems that could have been avoided. In some instances, project personnel were simply not following the rules for the use of MR found in the contractor’s EVM System Description. That’s an easier problem to resolve than other root causes.

The Role of Risk and Opportunity Management in Establishing MR

What H&A earned value consultants often uncover as the root cause of inappropriate uses of MR was that a robust risk and opportunity (R&O) management process would have made a difference in establishing a quantified set aside for MR to handle realized risks. Proactively identifying and managing risks improves project performance. The expectation of specific risks occurring leads to risk handling plans that lower the likelihood and impact of risks. It also provides an informed basis to establish an adequate amount of MR that reflects identified and assessed risks.

The risk assessment provides additional information that assists a project manager’s decision making process to validate a request to use MR is appropriate and has the backup data needed to justify the use of MR and the amount of MR allocated. This detail is necessary for the baseline change request (BCR) approval process as well as the Integrated Program Management Report (IPMR) Format 5 or Integrated Program Management Data and Analysis Report (IPMDAR) Performance Narrative Report (PNR). A project manager is required to identify the changes to MR during the reporting period and provide a brief explanation of the change. This explanation has the potential to pique the interest of the customer to gain a better understanding of why MR was used and the potential impact to the integrity of the EVM data.

Note: MR may increase or decrease for a variety of reasons. The primary use of MR is to handle realized risks within a control account that is within the statement of work (SOW) for the contract. All MR debits or credits should be tracked in a log for full traceability for the entire life of the project. Remember that MR can never be a negative value.

Acceptable Uses of MR

As highlighted in an H&A article titled “The Effective Use of Management Reserve,” examples of the appropriate uses of MR include:

  • Newly identified work is authorized and assigned to a control account manager (CAM). It may be that once the work begins, one or more tasks that were missed in the original planning process now need to be scheduled and resource loaded. Newly identified work could also be the result of internal replanning that required a change in approach or resource requirements.

    An example of this could be a project manager issued a work authorization to a CAM to conduct three tests to meet the requirements in the contract SOW. In the middle of the first test, it becomes clear to the CAM and project manager that a fourth test will be necessary. The project manager and CAM should be aware of this potential risk and be prepared to implement their risk handling strategy as a result of the R&O management process. The CAM can quickly prepare a BCR that the project manager can immediately approve to allocate MR budget to complete the fourth test. 
  • It is necessary to redo a task. This may include unanticipated redesign, remake, or retest. Hopefully, the project’s risk register identified the potential risks associated with the original tasks and management was prepared for the realized risk. 
  • Make/buy adjustments.  This could result in an MR debit or credit. 
  • Statement of work transfers from one organization to another. This could result in an MR debit or credit. 

Inadvisable Uses of MR Commonly Allowed

Although it is often allowed in a contractor’s EVM System Description, it is inadvisable to use MR for direct and indirect rate changes in the future. Note: MR should never be used to make any rate adjustments (or any other adjustments) to historical budgeted cost for work scheduled (BCWS) or BCWP data.

A rate change is not a change to the SOW for a CAM. It is merely a change to the cost of that work. Cost variances that occur because of direct and/or indirect rate changes can easily be explained in a Variance Analysis Report (VAR). Ironically, this use of MR is typically treated as a one-way street. Contractors apply MR when the direct and/or indirect rates are going up in the future but do not return to MR when the rates are projected to go down.

When a contractor’s EVM System Description allows MR to be used for future direct and/or indirect rate changes, ideally, the likely rate changes are identified as a risk and quantified when the initial MR is established for a project. This requirement should be noted in the EVM System Description. That way the set aside for MR includes budget for corporate rate adjustments that are outside of the control of the project manager or CAM. 

Another example of a commonly allowed but inadvisable use of MR is to “true up” a purchase order that is in excess of the original budget at completion (BAC) for material, equipment, or purchased services. For example, a project manager issues a work authorization to a CAM that includes purchasing material, equipment, or services from a supplier. The CAM then reaches an agreement with a supplier with scope, schedule, and budget. If that agreement is greater or less than the BAC, MR should not be applied, nor should budget be returned to MR to make the BAC match the PO value. Assuming the scope does not change, then MR should not be used to wipe out a cost variance whether positive or negative. The cost variance can be easily explained and the EAC can be increased or decreased. This is another example where contractors are treating this as a one-way street; they apply MR when it goes up, but do not return to MR when it goes down. A contractor would not “true up” for internal work overruns/underruns so why “true-up” for material or services provided by a supplier? 

Best Practice Tips

The following is a short list of best practices H&A earned value consultants often recommend clients implement for managing MR.

  • The EVM System Description should clearly spell out what are appropriate and inappropriate uses of MR. It should also provide guidance to eliminate instances of the “one way street” debit from MR. If needed, provide supplemental procedures, decision trees, or other work instructions to help project personnel follow EVM best practices and preserve MR for handling realized risks which typically occur in latter stages of a project.
  • Ensure that the R&O management process is integrated with the EVMS and provides the necessary risk identification and assessment information for the project manager to establish a realistic MR set aside based on quantifiable information. Where applicable, ensure likely rate changes are captured as a potential risk to the project and considered when the initial MR for the project is established if they intend to use MR for rate changes in the future.
  • Conduct recurring training to reinforce the purpose for MR and the appropriate use of MR. A recommended approach is to discuss a variety of use cases with project personnel so they know how to handle various situations that may occur on a project. 

Have you noticed “creative” uses of MR that are contrary to EVM best practices? Hopefully, you identified those situations as part of your EVMS self-governance process and were able to quickly implement corrective actions before your customer pointed out the issue to you. H&A earned value consultants often assist clients with producing procedures or work instructions that clearly spell out how to use MR appropriately. We also offer a range of EVMS training to reinforce EVM best practices including the appropriate use of MR. Call us today to get started.

Management Reserve Best Practice Tips Read Post »

Introduction to the Cost and Software Data Reporting (CSDR) Reporting Requirements

By / / , , ,
, , ,

A common client request is to assist them with sorting through the various DoD contractual reporting requirements and contract value reporting thresholds that apply. We frequently run into situations where a contractor needs clarification on why they have a Cost and Software Data Reporting (CSDR) requirement and whether they should seek to waive the requirement. Subcontractors to a prime often question the requirement to provide actual cost data directly to the DoD, especially for Firm Fixed Price (FFP) contracts.

Background

CSDRs are the primary means the DoD uses to collect data on the development, production, and sustainment costs incurred by contractors performing DoD acquisition contracts. It is a DoD system for collecting actual costs, software data, and related business data. The resulting data repository serves as the primary source for contract cost and software data for most DoD resource analysis efforts including cost database development, applied cost estimating, cost research, program reviews, analysis of alternatives (AoAs), and life cycle cost estimates.

CSDR reporting requirements are determined by the contract value regardless of the acquisition phase and contract type. In general, CSDR reporting is required for Acquisition Category I-II programs and Information System (IS) programs valued at more than $50M. They can also be required for Middle Tier Acquisition programs (greater than $20M) and other programs (greater than $100M). Risk can also be a determining factor regardless of the contract value.

DoD Instruction (DoDI) 5000.73, Cost Analysis Guidance and Procedures (March 2020), provides additional details about the cost data reporting. Table 1 in the 5000.73 lists the cost reporting requirements contract value thresholds. The DoD Manual 5000.04 Cost and Software Data Reporting (May 2021) is the primary requirements document for the development, implementation, and operation of the DoD CSDR system to ensure data reported is accurate and consistent.

About CADE

The Office of the Secretary of Defense Cost Assessment and Program Evaluation (OSD CAPE) established the Cost Assessment Data Enterprise (CADE), a secure web-based information system that hosts the controlled unclassified CSDR repository, the Defense Acquisition Cost Information Management System, and the forward pricing rate library. CADE also contains a selected acquisition report database, a contracts database, data analytics capabilities, and a library containing cost estimating content such as cost analysis requirement descriptions and cost estimates. CADE is access-controlled, and available through the public-facing CADE Portal website.

Similar to the cost estimating and proposal pricing functions within contractor’s organizations that rely on historical actual costs to assess the validity of a proposed cost estimate, independent and sound cost estimates are vital for effective DoD acquisition decision making and oversight. CADE plays a critical role in capturing the expenditure, technical, and programmatic data after contract execution in a consistent manner to enable independent cost estimating and analysis. This cost estimate data is essential to support efficient and effective resource allocation decisions throughout the planning, programming, budgeting, and execution process for the DoD.

CSDR Reporting Requirements

There are a series of Data Item Descriptions (DIDs) for this reporting requirement.  Some forms are submitted electronically using DoD defined XML schemas, Excel, or JSON encoded data in accordance with a File Format Specification (FFS) and Data Exchange Instruction (DEI). The list of DIDs are as follows. These DIDs can be downloaded from the CADE website.

  • Contract Work Breakdown Structure, DI-MGMT-81334D (May 2011).
  • Cost Data Summary Report, DI-FNCL-81565C (May 2011), DD Form 1921, XML Schema.
  • Functional Cost-Hour Report, DI-FNCL-81566C (September 2015), DD Form 1921-1, XML Schema.
  • Progress Curve Report, DI-FNCL-81567C (May 2011), DD Form 1921-2, XML Schema. 
  • Sustainment Functional Cost-Hour Report, DI-FNCL-81992 (May 2011), DD Form 1921-5, XML Schema.
  • Contractor Business Data Report, DI-FNCL-81765C (March 2021), DD Form 1921-3, Excel. 
  • Software Development Report, DI–MGMT-82035A (October 2022), DD Form 3026-1, XML Schema. 
  • Software Maintenance Report, DI–MGMT-82035A (October 2022), DD Form 3026-2, XML Schema.
  • Enterprise Resource Planning (ERP) Software Development Report, DI-MGMT-82035A (October 2022), DD Form 3026-3, XML Schema.
  • Cost and Hour Report (FlexFile), DI-FNCL-82162 (November 2017), JSON encoded data file following FFS and DEI.
  • Quantity Data Report, DI-MGMT-82164 (November 2017), JSON encoded data file following FFS and DEI.
  • Maintenance and Repair Parts Data Report, DI-MGMT-82163 (November 2017), Excel.
  • Technical Data Report, DI-MGMT-82165 (November 2017), Excel.

The Cost and Hour Report (FlexFile) and Quantity Data Report play a critical role in collecting cost data from contractors for the DoD data repository because they use JSON data encoding to organize the content. They are intended to replace the legacy 1921 series of paper-based formats including the DD 1921, 1921-1, 1921-2, and 1921-5. It also requires contractors to provide significantly more historical cost data than the 1921 formats. As a result, the DoD cost estimating community has additional insight into historical costs. The goal is to establish a common framework and standard nomenclature to collect data from different contractors, all of them with unique cost accounting structures, that are mapped to the DID, FFS, and DEI requirements for use in the data repository.

Establishing a Consistent, Repeatable Process to Produce the CSDR Data Deliverables

For contractors new to the CSDR reporting requirements and in particular, the FlexFile JSON data encoding, can appear to be daunting. That’s where software tools such as those from Midnite Dynamics can help. Midnite Dynamics specializes in assisting contractors with producing the CSDR data deliverables. 

Their software tool, C*CERT+, streamlines, automates, validates, and produces the legacy 1921 family of Excel and XML reports as well as the FlexFile and Quantity Data Report JSON submittals. C*CERT+ eliminates what otherwise is a manually intensive, resource draining, tedious and costly effort subject to recurring rejections. It is one thing to create the required legacy reports or FlexFile JSON files for submittal, it is another to pass the submittal validation process. C*CERT+ provides numerous data validations and analysis reports to ensure the data is 100% compliant before it is submitted. For example, the software includes over 90 FlexFile validations to ensure data compliance as illustrated in Figure 1.

Figure 1: Example of FlexFile data validation results.
Figure 1: Example of FlexFile data validation results.

The software includes a Validation and Remarks utility to analyze the source data details that could result in a Validation Trip. Remarks can be entered directly into the validation module for anything that requires an explanation. This is illustrated in Figure 2. This narrative is included with the data submittal.

Figure 2: Example of providing remarks about the FlexFile data content.

C*CERT+ also interfaces with existing EVM cost tools and accounting systems to produce the existing legacy 1921 reports, the FlexFile, and other data submittals as well as to consolidate separate projects/CLINs/task orders into a single contract report.

Once the C*CERT+ Standard Category Mapping Rules are set up, they can be shared throughout the corporation or business unit to establish a standard and repeatable process for producing the data deliverables. This mapping process translates the contractor’s source data into an output that matches the CSDR data submittal format rules. This saves a tremendous amount of time and makes it much easier to consistently produce the CSDR data deliverables. An example of the Mapping Rules is illustrated in Figure 3.

Figure 3: Mapping Rules translate contractor unique cost data into a format that matches the CSDR data submittal requirements.

Do your process and procedures or training materials need an update to include specific guidance for project control teams to produce required DoD contractual reports or data submittals using your tool sets of choice? Give us a call today at (714) 685-1730 to get started. 

Introduction to the Cost and Software Data Reporting (CSDR) Reporting Requirements Read Post »

The Role of EVM Consulting in Effectively Managing Projects Using Agile

By /

Understanding EVM Consulting 

EVM consulting helps in effectively managing projects where some work elements are using Agile product development processes by providing expertise in Earned Value Management and how to implement an EVMS that accommodates Agile. Since Agile is a product development methodology and EVM is project management discipline, it is possible to implement both approaches on the same project provided care is taken to document their alignment and linkages. EVM consulting assists with defining the specific areas where Agile and EVM processes and data integrate, increasing the likelihood of project success. 

Consultant Explaining about Managing Agile Projects Effectively

How EVM Consulting Helps Manage Projects Using Agile 

EVM consulting helps to effectively manage projects that are using Agile product development processes by providing expert guidance on implementing Earned Value Management practices that accommodate Agile. It allows project managers to track project performance, identify potential issues, and make informed decisions to ensure the project stays on track. EVM consulting also helps in establishing a realistic Performance Measurement Baseline (PMB), improving project forecasting, and enhancing communication among project stakeholders.

Key Components of EVM Consulting 

EVM consulting involves implementing a structured and integrated approach to organize, accomplish, and manage all project work effort. The processes include integrating project scope, schedule, and cost objectives, establishing a baseline plan to accomplish project objectives, and using earned value techniques for performance measurement throughout the project execution phase. The main components include:

  • Performance Measurement Baseline (PMB): Establishing the PMB is a culmination of the integrated planning, scheduling, and budgeting processes and provides a common basis to measure work accomplished as well as to track scope, schedule, and budget changes.
  • Variance Analysis: Identifying and addressing deviations from the plan helps to ensure technical, schedule, and cost objectives are met by implementing timely corrective actions. 
  • Forecasting: Predicting future project performance based on current trends. 
  • Risk Management: Assessing and mitigating potential threats to project success. 

Implementing EVM Consulting for Projects Using Agile 

EVM consulting can be an effective way to manage projects that are using Agile product development processes. It helps in tracking project performance and ensuring that it stays within budget and on schedule. With EVM consulting, you can gain valuable insights into the project’s progress and identify any areas needing improvement early on. For those interested in enhancing their EVM proficiency, the EVMS DOD Virtual Learning Lab offers an intensive online EVM training course. This can lead to better decision-making and more efficient project management, ultimately contributing to the project’s success.

Best Practices for EVM Consulting for Projects Using Agile 

Incorporating EVM consulting for projects using Agile helps in effective project management. Some best practices include: 

  • Integration: Producing a project directive or procedure that defines how the Agile processes will be integrated with the EVM processes to ensure alignment and data traceability for scope management, scheduling, budgeting, and forecasting as well as to track project progress and performance efficiently. This integration allows for greater visibility and control over the project’s financial and schedule performance, aiding in proactive decision-making and risk management. 
  • Adaptation: Incorporating content into your EVM System Description that discusses the touch points between the Agile and EVM processes to support the iterative and incremental nature of Agile product development, allowing for more accurate measurement of progress and forecasting of project outcomes. 
  • Transparency: Ensure clear communication between the project control team and Agile product development teams to foster collaboration and decision-making. Transparency strengthens trust and enables everyone to make informed contributions towards project success. 
  • Continuous Improvement: Regularly review and adapt EVM practices to enhance project control and product delivery. By embracing continuous improvement, project control teams can refine their EVM processes to better align with evolving project needs and industry best practices. 

Conclusion: Maximizing Project Management Effectiveness with EVM Consulting 

EVM consulting plays a vital role in maximizing project management effectiveness, especially for projects using Agile product development processes. By leveraging EVM techniques, project managers can gain valuable insights into project performance, identify potential risks, and make informed decisions to drive project success. With EVM consulting, project teams can maintain a strong focus on project objectives, assess progress against predefined criteria, and adapt their approaches as needed. This approach enables more effective resource allocation, risk mitigation, and ultimately, project success. 

FAQs: Frequently Asked Questions About EVM Training Courses 

  • Are EVM courses suitable for those who have no knowledge of EVM? Yes, the EVM courses offered by Humphreys & Associates are suitable for both beginners and professionals who want to improve their skills. They offer a range of course options, including online self-paced and live virtual instructor-led courses, to accommodate different schedules and learning styles. 
  • What is the method of delivery for the training? Humphreys & Associates offers online self-paced and live virtual instructor-led courses. The online training is a complete presentation of Humphreys & Associates’ highly regarded three-day EVMS training workshop in an online, interactive, multimedia format. 
  • What documentation is available that can help me understand EVMS and Agile and how they are related? To understand the relationship between EVMS and Agile, the DoD Acquisition Data and Analysis (ADA) Integrated Program Management (IPM) Division has produced resources such as the “Agile and EVM: A Program Manager’s Desk Guide.” This guide explains how Agile methodologies can be integrated with existing DoD program management and system engineering processes, including EVM: NDIA IPMD Industry Practice Guide for Agile on Earned Value Management Programs.
  • Does the fact that Agile/Scrum Sprints have very short durations cause a problem with EVMS? Agile/Scrum Sprints with very short durations do not cause a problem with EVMS. Teams update their progress daily, and it is preferable if the Sprints are four weeks or less and align with the cut-off dates for the EVMS. 
  • What roles within the Project Management Office (PMO) are there for EVMS and for Agile and how do they relate? The roles within the Project Management Office (PMO) for EVMS and for Agile are varied. For instance, the Scrum Master is a facilitator on the Scrum team and there is no corresponding EVMS role. The team members organize themselves so there is no team lead like the control account manager (CAM) in an EVMS, however, someone on the team will need to function as the CAM for required EVMS actions.
  • Should the EVM System Description be a single document or a summary document with supporting procedures?  There are pros and cons to each approach. The benefit of a single document is that it provides an integrated view of the entire EVMS process without having to reference multiple documents.
  • How can I ensure that my EVMS complies with the EIA-748 guideline requirements? Humphreys & Associates recommends conducting a requirements analysis or gap analysis to assess what you are currently doing against the EIA-748 32 guidelines taking into account your desired end state and current or impending contractual requirements. The assessment identifies strengths and weaknesses and provides specific recommendations to implement a compliant EVMS.
  • How can I prepare for an EVMS compliance review? Humphreys & Associates recommends conducting mock EVMS reviews. These reviews provide an independent, fact-based assessment of your EVMS, its implementation, data quality, and proficiency level of EVMS project personnel. 
  • What is the importance of continuous training in maintaining quality schedule and cost data in EVMS? Continuous training is important to ensure project personnel are using the schedule and cost tools effectively, are following the EVMS processes and procedures, and understand what is required to produce and maintain quality data. Humphreys & Associates recommends a proactive stance, with robust change control processes, continuous enhancement of documented practices, and improvements to data management systems to ensure accuracy and traceability.
  • How can I ensure data integrity in my EVMS? Ensuring data integrity in your EVMS involves making sure that the schedule and cost software tools are properly configured, data validation checks are routinely performed, and that schedule and cost data align. Humphreys & Associates recommends a proactive stance, with robust change control processes, continuous enhancement of documented practices, and improvements to data management systems to ensure accuracy and traceability.

EVM Training Course List 

To enhance your skills in this area, we present a comprehensive list of EVM Training Courses tailored to meet the needs of various stakeholders, from project managers to government contractors. Whether you’re preparing for a customer Integrated Baseline Review, seeking to improve your EVM proficiency, or aiming to pass certification exams, these courses offer valuable insights and practical experience. Delivered in an online format, these courses provide the flexibility to learn at your own pace while ensuring a deep understanding of EVM principles and their application in real-world scenarios. 

CAM Discussion: The CAM Discussion serves as an essential component of the preparation process for a customer Integrated Baseline Review (IBR), compliance review, or surveillance review. This simulation offers a practical experience of a CAM documentation review and interview session, illustrating how a proficient CAM conducts an interview with a government customer. Additionally, it provides a useful recap emphasizing key technical points along with suggestions for follow-up action items. 

CAM Essentials_DOD: CAM Essentials provides comprehensive training to improve EVM proficiency and understanding of the basics. This online training bundle features the EVMS Virtual Learning Lab (DOD), Scheduling Virtual Learning Lab, and CAM Discussion courses, all available separately. 

CAM Essentials_DOE: CAM Essentials offers comprehensive tools for improving EVM skills and understanding the fundamentals. This online training bundle includes the EVMS Virtual Learning Lab (DOE), Scheduling Virtual Learning Lab, and CAM Discussion courses, each available separately. 

CAM Essentials_NASA: CAM Essentials provides comprehensive training to improve EVM proficiency and understanding of the basics. The online training bundle includes the EVMS Virtual Learning Lab (NASA), Scheduling Virtual Learning Lab, and CAM Discussion courses, which are also available individually. 

CPR/IPMR/CFSR Completion and Reconciliation: The Integrated Program Management Report (IPMR) and Contract Funds Status Report (CFSR) are crucial communication tools between contractors and their customers. This online course provides valuable insights into the proper completion of these reports and their reconciliation. 

EVMS Certification and Preparation Quiz: This online course comprises 120 questions in four separate quizzes, covering the nine EVMS process groups, the Contract Performance Report (CPR)/Integrated Program Manager Report (IPMR), earned value data analysis, Integrated Baseline Review (IBR), and compliance reviews. It serves as an excellent study and preparation resource for the AACE International Earned Value Professional (EVP) or the PMI Project Management Professional (PMP) certification exams. 

EVMS DOD Virtual Learning Lab: The EVMS Virtual Learning Lab offers a comprehensive 21-hour instruction program. This online training delivers Humphreys & Associates’ acclaimed three-day EVMS workshop in an interactive, multimedia format. The video content includes all workshop coursework, quizzes, and case studies, allowing students to assess their understanding and receive prompt feedback through scored quizzes and exams. 

EVMS DOE Virtual Learning Lab: The EVMS Virtual Learning Lab offers a comprehensive 21-hour online training program. This interactive multimedia format is based on Humphreys & Associates’ acclaimed three-day EVMS workshop, delivering all course content, quizzes, and case studies in a video format. Students can assess their understanding through scored quizzes and exams. 

The course can be used for project personnel to enhance their EVM proficiency or for someone who wants to learn the basics of earned value management at their own pace.  

EVMS NASA Virtual Learning Lab: An intensive 21-hour online training program that offers a complete presentation of Humphreys & Associates’ three-day EVMS workshop. The course has been adapted into an interactive multimedia format, including all quizzes and case studies from the original workshop. Students can test their knowledge and receive immediate feedback through scored quizzes and exams. 

The course can be used for project personnel to enhance their EVM proficiency or for someone who wants to learn the basics of earned value management at their own pace.  

IBR – Online Video: The Integrated Baseline Review (IBR) course is designed to provide a comprehensive understanding of the IBR process. It is a fast-paced presentation that is essential for ensuring a clear grasp of the technical requirements of a project and establishing accurate schedule and cost goals. This course offers a detailed explanation of the review process and can be tailored to provide training for specific needs and timings. The approximate duration of the course is 2 hours. 

OTB/OTS Implementation – Online Video: Learn about Over Target Baseline (OTB) and Over Target Schedule (OTS) Implementations in this approximately 1 hour and 30-minute video. 

A formal re-programming action, known as an OTB and/or an OTS, may occur during risky major acquisitions. Understanding the rationale for and the various methods used to implement an OTB/OTS, as well as correctly completing the IPMR/CPR formats in accordance with the Data Item Description (DID) instructions, is not a simple process. Our video provides clarity on this complex process. 

The video includes completed IPMR/CPR Formats 1, 2, and 3, showcasing four OTB methods, along with before and after Baseline graphs for each method. It also contains examples and Baseline graphs for Over Target Schedule, Format 3. 

Scheduling Virtual Learning Lab: The Scheduling Virtual Learning Lab offers an intensive 21 hours of instruction covering critical path fundamentals, schedule baseline, float, network logic development, risk assessment, changes, and scheduling in an EVMS environment. The content is based on the well-regarded three-day Project Scheduling Workshop by Humphreys & Associates, adapted to a video format and featuring quizzes and case studies for immediate knowledge testing and feedback. 

The course is designed for project personnel looking to enhance their project scheduling skills and for individuals who want to learn the fundamentals of project scheduling at their own pace. 

A student who completes the Scheduling course will earn 21 Professional Development Units (PDUs) or 2.1 Continuing Education Units (CEUs). 

For information on Corporate or Quantity Discount pricing, please contact us at products@humphreys-assoc.com or call us at (714) 685-1730. 

The Role of EVM Consulting in Effectively Managing Projects Using Agile Read Post »

Level of Effort (LOE) Best Practice Tips

By / / , , ,
, , ,
Level of Effort (LOE) Best Practice Tips

Clients are often seeking advice from our earned value consultants about implementing a practical approach in response to government customer requirements to proactively manage level of effort (LOE) tasks. The DoD EVMS Interpretation Guide (EVMSIG), NASA guidance, and DOE guidance such as the Compliance Assessment Governance (CAG) document clearly state the requirements for contractors related to planning, maintaining, and managing LOE. DOE also specifies a limit to the percentage of LOE allowed within a control account to avoid skewing performance measurement of the discrete work effort. In addition, both the DCMA and DOE EVMS data quality test metric specifications include manual and automated tests with thresholds specific to LOE.

Common accepted best practices for LOE include:

  • Reducing the amount of LOE to the lowest level possible to minimize the number of activities that need to be actively managed. Objective measures of performance are always preferred.
  • When LOE activities are included in the schedule, they should not drive the date calculations of discrete activities in the integrated master schedule (IMS). They should also not appear on the critical path.
  • LOE must be segregated from discrete work effort. In practice, this means a work package can only be assigned a single earned value method. The work package is one of three types. It is either 1) discrete effort with an assigned earned value technique such as the Milestone or Percent Complete technique, 2) apportioned effort, or 3) LOE. 
  • It must be verified it is truly LOE, i.e., it is management or sustainment type of activity that has no identifiable end products or established relationship to other measurable effort. It is clearly not discrete effort or apportioned effort. Remember that with LOE, the passage of time is the only measurement criteria. At the end of the performance month, the budget value for that month is earned. For this reason, LOE is the least desirable earned value method. 
  • The budget or estimate to complete the work effort is time phased and reflects the planned or forecast period of performance. The period of performance and resource requirements must be substantiated. Determining the basis of estimate for the LOE activity can also help to verify the work is truly LOE.

So, what is the problem? 

Common situations H&A earned value consultants run into are contractors where:

  • Managing the LOE is put on “auto pilot.” This might work for project management type of activities that span the duration of the project. It does not work so well when the LOE is associated with the occurrence of discrete work effort that is subject to change – i.e., the discrete work effort duration changes or the start date and/or the complete date changes. The result?
  • LOE tasks may incur actual cost of work performed (ACWP) with no budgeted cost for work performed (BCWP);
  • LOE tasks earn BCWP with no ACWP; or
  • The estimate at completion (EAC) is greater than the ACWP with BCWP equal to the budget at completion (BAC).

    Any one of these conditions would trip the DCMA and DOE test metrics and should be avoided. These types of situations were illustrated in a previous blog, “Level of Effort Decision Tree” that discusses how to properly replan LOE. 
  • Their EVM System Description doesn’t provide sufficient guidance to project personnel on what proactive management of LOE means. What are the rules for planning and maintaining LOE? How is LOE handled differently from discrete work packages?

    Some System Descriptions allow LOE replanning to occur within the “freeze period,” usually defined as the current reporting period and often plus one additional month. This is contrary to other best practice guidance about how to handle changes for open discrete effort work packages. For discrete effort work packages, changes within the freeze period are not allowed and the work package must be closed to replan the remaining work. What’s the process for handling that open LOE work package? What about retroactive changes when the LOE work occurs earlier or later than planned, or the duration is different than planned? Then what?

    When project personnel lack guidance, then arguments often ensue about what is the “correct” interpretation of the wording in governing documents or test metric specifications that are often inconsistent.
  • Validation checks are not routinely performed. This includes validation checks to ensure that control account managers (CAMs) are selecting the appropriate earned value method for a work package following the EVM System Description guidance during the work definition and planning phase. It also includes routine monthly data checks to identify common data anomalies typically associated with LOE such as ACWP and no BCWP or BCWP with no ACWP. The goal is to fix problems in the current reporting month and avoid making any retroactive changes. You should be catching and fixing avoidable DCMA or DOE EVMS test metric “triggers” every reporting period.

Best Practice Tips

Here is a short list of best practice tips that H&A earned value consultants have helped clients to implement over the years to ensure LOE is properly planned and proactively managed. The approach is tailored for each client to reflect the type of work the company typically performs. This is documented in their EVM System Description, related procedures, and recurring training to ensure project personnel have clear, specific guidance they can follow.

  • Consider using the Percent Complete earned value technique instead of LOE. A best practice is to identify quantifiable backup data (QBD) for a work package using the Percent Complete earned value technique. The QBD for the LOE type of work package could be the milestones identified for the discrete effort work package the LOE work package is supporting. This helps to ensure the work packages are reviewed and managed together.
  • Could the Apportioned Effort method be used instead of LOE? Is it possible to establish a direct relationship between the discrete effort and supporting effort? For example, is historical data available to document that the support number of hours is a given percentage of the discrete effort labor hours? If so, then using the Apportioned Effort method is a much better alternative. When the discrete work package is statused, the apportioned effort work package would be automatically statused as well. 
  • Consider shorter durations for the LOE when that LOE is supporting discrete effort. Should the first occurrence of the LOE trigger a data anomaly test metric, it can be proactively handled along with any future replanning. The remaining LOE would already be in one or more separate work packages so there won’t be any criticism for changing open work packages. Any adjustments can be made in the current reporting period avoiding any retroactive changes that would trigger other data metric tests. What is considered to be “short duration” should be defined in the EVM System Description. An example would be LOE work packages of 3 to 4 months in duration. Be sure to provide specific guidance to project personnel on how to process these types of current reporting period LOE replanning adjustments. The LOE work package breakpoints should be technically related. For example: “Phase I Support,” “Drawing Support,” and so forth instead of generic descriptions such as “April Support,” “May Support,” or “June Support.”
  • Use rolling wave planning. This is by far one of the better solutions. This helps to ensure the discrete tasks and any supporting LOE tasks are planned together before the work is authorized to begin. Shorter durations for the LOE tasks are often used to align with the forward planning window.
  • Incorporate LOE earned value method checks into your routine status and data analysis process. Identify any upcoming LOE activities (for example, the next 60 to 90 days), along with the CAM responsible for the work effort to verify they accurately reflect the current plan. It is always better to proactively replan future LOE when needed instead of defaulting to an “auto pilot” mode. The CAM should understand this is part of their responsibilities.

Does your EVM System Description or training materials need a refresh to include specific guidance for project personnel that documents the preferred approach for planning, maintaining, and managing LOE? H&A earned value consultants frequently help clients with EVM System Description content enhancements or creating specific procedures that reflect your unique business environment. Call us today at (714) 685-1730 to get started.

Level of Effort (LOE) Best Practice Tips Read Post »

Scroll to Top