Level of Effort (LOE)

Including Level of Effort (LOE) in the Integrated Master Schedule (IMS)

, , ,

A recent H&A blog titled “Level of Effort (LOE) Best Practice Tips” discussed different approaches for handling LOE to avoid generating false variances. That discussion did not elaborate on including the LOE tasks in the integrated master schedule (IMS). This blog is a follow on to that earlier discussion with a focus on options for including LOE in the IMS along with notes on best practices, tips, and customer expectations.

In the general sense of an earned value management system (EVMS), the LOE scope of work is contained in summary level planning packages (SLPPs) or control accounts as subordinate planning packages or work packages. The budget values for those elements will most likely come from a resource loaded IMS or a resource loading mechanism aligned with the IMS. Not all organizations resource load the IMS activities but instead extract time buckets from the IMS for resource loading using other mechanisms. Resource loading the IMS activities is the recommended practice because it assures cost/schedule integration, but it can be difficult.

LOE work might not appear in the IMS since it is considered optional by some customers such as the Department of Defense (DoD). The Department of Energy (DOE) requires LOE tasks to be included so you can expect it to be in the IMS when DOE is the customer.

Before we talk about LOE in the IMS we must think about the type of work the LOE tasks represent. LOE might be a general task such as “Control Account Management” that is not directly related to other work except perhaps in the time frame in which they happen. But some LOE tasks such as support tasks are related to other discrete work. Modeling the LOE in the IMS starts by understanding what type of effort is involved and can help to determine the approach for linking activities. 

LOE Best Practice Tips Related to the IMS

The Level of Effort (LOE) Best Practice Tips blog included these points related to the IMS:

  • “When LOE activities are included in the schedule, they should not drive the date calculations of discrete activities in the integrated master schedule (IMS). They should also not appear on the critical path.”
  • “LOE must be segregated from discrete work effort. In practice, this means a work package can only be assigned a single earned value method.”
  • “Consider shorter durations for the LOE when that LOE is supporting discrete effort. Should the first occurrence of the LOE trigger a data anomaly test metric, it can be proactively handled along with any future replanning. The remaining LOE would already be in one or more separate work packages so there won’t be any criticism for changing open work packages.”

Government Agency and Industry Guidance on LOE on the IMS

Is there any guidance that can help clarify how best to handle LOE tasks in the IMS? Let’s take a look at three of the guidance documents that may be useful for your environment.

  1. The Integrated Program Management Data and Analysis Report (IPMDAR) Data Item Description (DID), DI-MGMT-81861C (August 2021). This DID is typically placed on contracts with the DoD or NASA that exceed the contract value threshold for EVM reporting or EVMS compliance. Relevant mentions of the data requirements for the IMS in the DID are as follows.

“2.4.1.1 Content. The Schedule consists of horizontally and vertically integrated discrete tasks/activities, consistent with all authorized work, and relationships necessary for successful contract completion.”

Note: This is where the option to exclude LOE from the IMS appears since this requires only discrete tasks/activities. The following sections provide additional guidance when LOE is included in the IMS.

“2.4.2.7 Level of Effort (LOE) Identification. If tasks/activities within an LOE work package are included in the Schedule, clearly identify them.”

“2.4.2.9 Earned Value Technique (EVT). Identify the EVT (e.g., apportioned effort, level of effort, milestone).”

  1. National Defense Industrial Association (NDIA) Integrated Program Management Division (IPMD) Planning and Scheduling Excellence Guide (PASEG) (Version 5.0). The PASEG is a widely recognized industry guide on scheduling best practices in government contracting environments. Section 5.8, Level of Effort (LOE) provides a discussion on the topic including things to promote and things to avoid. Excerpts from the PAGEG follow.

“There are pros and cons around including or excluding LOE tasks in the IMS. Including LOE tasks in the IMS allows for a more inclusive total program look at resource distribution, which aids in the maintenance and analysis of program resource distribution. However, if modeled incorrectly, including LOE tasking in the IMS can cause inaccurate total float and critical path calculations.”

“Tasks planned as LOE in the IMS should be easily and accurately identifiable. This includes populating the appropriate Earned Value Technique field (as applicable) and possibly even identifying the task as LOE in the task description.”

“Consider adding an LOE Completion Milestone to tie all LOE tasking to the end of the program.”

“LOE tasks should not be networked so that they impact discrete tasks. Incorrect logic application on LOE can lead to invalid impacts to the program critical path.”

“Level of Effort tasks should have no discrete successors and should therefore never appear on critical/driving paths.”

  1. DOE Guide 413.3-24 Planning and Scheduling (April 2022). This document provides guidance for acceptable practices in a DOE contractual environment. The discussion on LOE can be found in Section 7 Planning and Scheduling Special Topics, 7.2 Level of Effort, and 7.3 Inclusion of Level of Effort in the Integrated Master Schedule. Excerpts and image from the Guide follow. 

“Overview: Activity-based methods either cannot, or impracticably can measure the performance of LOE WPs and activities. Include all activities, both discrete and LOE, in the IMS.”

“LOE is planned in the IMS so that it does not impact discrete work. Figure 6 shows the recommended linkages in the IMS for planning level of effort.”

Interpreting this DOE Guide diagram for the recommended modeling of LOE in the IMS, notice the inclusion of a “LOE Complete” milestone following the Critical Decision (CD) 4 milestone with no constraint. CD4 in this diagram represents the end of contract effort. The purpose of this LOE-complete milestone, with no constraint, is to provide a successor for all LOE tasks where one is needed. That will prevent generating issues where tasks have no successors.

This recommended modeling is done so that the LOE tasks are not linked to the end of the contract work and thus will not push it. The LOE tasks will also not appear on the critical path since they are not in the path that established the end date.

Also note that the LOE tasks in green are linked as successors to discrete work which is a logic linking approach intended to keep the LOE work aligned with the discrete work but off the critical path. Study the logic and you see that a movement to the right of a discrete task will drag along its related LOE task.

DOE requires the use of Primavera schedule tools so the relationships shown here can be accomplished in that tool. That may not be true of all tools. Know how your tools work before you generate any guidance.

Additional Relevant Guidance Search

H&A earned value consultants recently conducted a survey of the various government and non-government documents regarding the IMS and collected relevant guidance related to LOE among other things. The table below lists the results from a search for “LOE” wording. Note: this is a representative sample of typical government agency and industry IMS references. You should verify current references before you generate your own internal IMS guidance.

Source DocumentGuidance for Capturing all Activities, LOE in IMS
DCMA EVMS Compliance Metrics (DECM) Checks (version 6.0)
  • 06A210a: Do LOE tasks/activities have discrete successors? (0% threshold)
  • 12A101a: Are the contractor’s Level of Effort (LOE) WPs supportive in nature and/or do not produce technical content leading to an end item or product? (≤ 15% threshold)
  • 12A301a: Does the time-phasing of LOE WP budgets properly reflect when the work will be accomplished? (≤ 10% threshold)
IPMDAR DID DI-MGMT 81816CIf tasks/activities within an LOE work package are included in the Schedule, clearly identify them.
DOE Guide 413.3-24 Planning and Scheduling, Appendix A Schedule Assessment PrinciplesPrinciple 20. No LOE on critical path.
GAO Schedule Assessment Guide: Best Practices for Project Schedules (December 2015)Selected excerpts:
  • LOE activities should be clearly marked in the schedule and should never appear on a critical path.
  • LOE activities … derive their durations from other discrete work.
  • Best Practices for confirming the critical path is valid: Does not include LOE activities, summary activities, or other unusually long activities, except for future planning packages.
NDIA IPMD PASEG (version 5.0) (as noted above)
  • Tasks planned as LOE in the IMS should be easily and accurately identifiable.
  • LOE tasks should not be networked so that they impact discrete tasks.
  • Level of effort tasks should have no discrete successors and should therefore never appear on critical/driving paths.
PMI Practice Standard for Scheduling (Second Edition)Since an LOE activity is not itself a work item directly associated with accomplishing the final project product, service, or results, but rather one that supports such work, its duration is based on the duration of the discrete work activities that it is supporting.

Conclusion

Based on the various sources of guidance, it is possible to structure the IMS to include LOE in a way that provides cost/schedule integration and keeps all work correctly aligned yet does not cause issues with the critical path and the driving paths. From this guidance, it should be a straightforward effort to generate your own internal scheduling procedure defining how to handle LOE in the IMS if you choose to include it or if you are required to include it.

Need help producing a clear and concise scheduling procedure or tool specific work instructions? H&A earned value consultants and scheduling subject matter experts have worked with numerous clients to create easy to follow guides that help to ensure schedulers are following your company’s best practices using the scheduling tools of choice. Call us today at (714) 685-1730 to get started. 

Including Level of Effort (LOE) in the Integrated Master Schedule (IMS) Read Post »

Level of Effort (LOE) Best Practice Tips

, , ,
Level of Effort (LOE) Best Practice Tips

Clients are often seeking advice from our earned value consultants about implementing a practical approach in response to government customer requirements to proactively manage level of effort (LOE) tasks. The DoD EVMS Interpretation Guide (EVMSIG), NASA guidance, and DOE guidance such as the Compliance Assessment Governance (CAG) document clearly state the requirements for contractors related to planning, maintaining, and managing LOE. DOE also specifies a limit to the percentage of LOE allowed within a control account to avoid skewing performance measurement of the discrete work effort. In addition, both the DCMA and DOE EVMS data quality test metric specifications include manual and automated tests with thresholds specific to LOE.

Common accepted best practices for LOE include:

  • Reducing the amount of LOE to the lowest level possible to minimize the number of activities that need to be actively managed. Objective measures of performance are always preferred.
  • When LOE activities are included in the schedule, they should not drive the date calculations of discrete activities in the integrated master schedule (IMS). They should also not appear on the critical path.
  • LOE must be segregated from discrete work effort. In practice, this means a work package can only be assigned a single earned value method. The work package is one of three types. It is either 1) discrete effort with an assigned earned value technique such as the Milestone or Percent Complete technique, 2) apportioned effort, or 3) LOE. 
  • It must be verified it is truly LOE, i.e., it is management or sustainment type of activity that has no identifiable end products or established relationship to other measurable effort. It is clearly not discrete effort or apportioned effort. Remember that with LOE, the passage of time is the only measurement criteria. At the end of the performance month, the budget value for that month is earned. For this reason, LOE is the least desirable earned value method. 
  • The budget or estimate to complete the work effort is time phased and reflects the planned or forecast period of performance. The period of performance and resource requirements must be substantiated. Determining the basis of estimate for the LOE activity can also help to verify the work is truly LOE.

So, what is the problem? 

Common situations H&A earned value consultants run into are contractors where:

  • Managing the LOE is put on “auto pilot.” This might work for project management type of activities that span the duration of the project. It does not work so well when the LOE is associated with the occurrence of discrete work effort that is subject to change – i.e., the discrete work effort duration changes or the start date and/or the complete date changes. The result?
  • LOE tasks may incur actual cost of work performed (ACWP) with no budgeted cost for work performed (BCWP);
  • LOE tasks earn BCWP with no ACWP; or
  • The estimate at completion (EAC) is greater than the ACWP with BCWP equal to the budget at completion (BAC).

    Any one of these conditions would trip the DCMA and DOE test metrics and should be avoided. These types of situations were illustrated in a previous blog, “Level of Effort Decision Tree” that discusses how to properly replan LOE. 
  • Their EVM System Description doesn’t provide sufficient guidance to project personnel on what proactive management of LOE means. What are the rules for planning and maintaining LOE? How is LOE handled differently from discrete work packages?

    Some System Descriptions allow LOE replanning to occur within the “freeze period,” usually defined as the current reporting period and often plus one additional month. This is contrary to other best practice guidance about how to handle changes for open discrete effort work packages. For discrete effort work packages, changes within the freeze period are not allowed and the work package must be closed to replan the remaining work. What’s the process for handling that open LOE work package? What about retroactive changes when the LOE work occurs earlier or later than planned, or the duration is different than planned? Then what?

    When project personnel lack guidance, then arguments often ensue about what is the “correct” interpretation of the wording in governing documents or test metric specifications that are often inconsistent.
  • Validation checks are not routinely performed. This includes validation checks to ensure that control account managers (CAMs) are selecting the appropriate earned value method for a work package following the EVM System Description guidance during the work definition and planning phase. It also includes routine monthly data checks to identify common data anomalies typically associated with LOE such as ACWP and no BCWP or BCWP with no ACWP. The goal is to fix problems in the current reporting month and avoid making any retroactive changes. You should be catching and fixing avoidable DCMA or DOE EVMS test metric “triggers” every reporting period.

Best Practice Tips

Here is a short list of best practice tips that H&A earned value consultants have helped clients to implement over the years to ensure LOE is properly planned and proactively managed. The approach is tailored for each client to reflect the type of work the company typically performs. This is documented in their EVM System Description, related procedures, and recurring training to ensure project personnel have clear, specific guidance they can follow.

  • Consider using the Percent Complete earned value technique instead of LOE. A best practice is to identify quantifiable backup data (QBD) for a work package using the Percent Complete earned value technique. The QBD for the LOE type of work package could be the milestones identified for the discrete effort work package the LOE work package is supporting. This helps to ensure the work packages are reviewed and managed together.
  • Could the Apportioned Effort method be used instead of LOE? Is it possible to establish a direct relationship between the discrete effort and supporting effort? For example, is historical data available to document that the support number of hours is a given percentage of the discrete effort labor hours? If so, then using the Apportioned Effort method is a much better alternative. When the discrete work package is statused, the apportioned effort work package would be automatically statused as well. 
  • Consider shorter durations for the LOE when that LOE is supporting discrete effort. Should the first occurrence of the LOE trigger a data anomaly test metric, it can be proactively handled along with any future replanning. The remaining LOE would already be in one or more separate work packages so there won’t be any criticism for changing open work packages. Any adjustments can be made in the current reporting period avoiding any retroactive changes that would trigger other data metric tests. What is considered to be “short duration” should be defined in the EVM System Description. An example would be LOE work packages of 3 to 4 months in duration. Be sure to provide specific guidance to project personnel on how to process these types of current reporting period LOE replanning adjustments. The LOE work package breakpoints should be technically related. For example: “Phase I Support,” “Drawing Support,” and so forth instead of generic descriptions such as “April Support,” “May Support,” or “June Support.”
  • Use rolling wave planning. This is by far one of the better solutions. This helps to ensure the discrete tasks and any supporting LOE tasks are planned together before the work is authorized to begin. Shorter durations for the LOE tasks are often used to align with the forward planning window.
  • Incorporate LOE earned value method checks into your routine status and data analysis process. Identify any upcoming LOE activities (for example, the next 60 to 90 days), along with the CAM responsible for the work effort to verify they accurately reflect the current plan. It is always better to proactively replan future LOE when needed instead of defaulting to an “auto pilot” mode. The CAM should understand this is part of their responsibilities.

Does your EVM System Description or training materials need a refresh to include specific guidance for project personnel that documents the preferred approach for planning, maintaining, and managing LOE? H&A earned value consultants frequently help clients with EVM System Description content enhancements or creating specific procedures that reflect your unique business environment. Call us today at (714) 685-1730 to get started.

Level of Effort (LOE) Best Practice Tips Read Post »

Schedule Health Metrics

What are Schedule Health Metrics?

Schedule Health Metrics by Humphreys & AssociatesAt the heart of every successful Earned Value Management System (EVMS) is a comprehensive Integrated Master Schedule (IMS) that aligns all discrete effort with a time-phased budget plan to complete the project.  As such, the IMS must be complete and accurate to provide the necessary information to other EVMS process groups and users.  The IMS may be a single file of information in an automated scheduling tool, or a set of files that also includes subcontractor schedules.

For any medium to large project, the IMS may contain thousands of activities and milestones interconnected with logical relationships and date constraints to portray the project plan.  Schedule Health Metrics provide insight into the IMS integrity and viability.

Why are Schedule Health Metrics important?

For a schedule to be useable, both as a standalone product and as a component of the EVMS, standards have been developed to reflect both general scheduling practices and contractual requirements.  Schedule Health Metrics contain checks designed to indicate potential IMS issues.  Each check has a tolerance established to help focus on particular areas of concern.  The individual metrics should not be considered as a pass or fail score, but should be used as a set of indicators to guide questions into specific areas of the IMS.

For example, if there is an unusually large number of tasks with high total float properties, a review of the logic in the IMS is warranted.  At the end of the analysis, if the Control Account Manager (CAM) responsible for the work, with the help of the Planner/Scheduler, can explain why the high float exists, then the issue is mute.  Metrics are simply a method to help isolate issues in a large amount of data.  In this example, the analysis will continue to depict issues with this CAM’s data, but those issues are not indicative of failure.

What are the standards?

From the beginning of automated scheduling systems in the 1980’s, attempts have been made to take advantage of the scheduling databases for the purpose of metrical analysis.  The maturity of scheduling software tools has provided better access to metrics in both open architecture databases and with export capabilities to tools such as Microsoft’s Excel and Access products. With the availability of the new tools, new analysis techniques were developed and implemented.

Several years ago, the Defense Contract Management Agency (DCMA) reviewed the various Schedule Health Metrics being used within the US Government and selected 14 tests they believed to be the best tests of an IMS.  Because they support a wide variety of customers from the DOD, NASA, and DOE, they have developed these checks with thresholds that should be common to all types of programs, but not specific or restrictive to a particular one. The thresholds help bring focus to the issues in the schedule under review.  With agreement between the customer, the DCMA and the contractor, they may be altered in some cases to reflect the unique nature of a project.

Unless otherwise indicated, the DCMA Health Metrics apply only to incomplete activities or tasks in the IMS, not milestones, with baseline durations of 1 day or longer. This set also excludes Level of Effort (LOE) and Summary tasks because they should not be driving the network.  The DCMA 14 point Schedule Health Metrics are:

1.  Missing Logic

The test: The percentage of incomplete activities that do not have a predecessor or successor.

The threshold: 5%.

For a schedule to function correctly, the tasks must be logically linked to produce a realistic mathematical model that sequences the work to be performed.

2.  Activities with Leads

The test: The percentage of relationships in the project with lags of negative 1 day or less.

The threshold: 0%.

The project schedule should flow in time from the beginning to the end.  Negative lags, or leads, are counter to that flow and can make it more difficult to analyze the Critical Path.  In many cases this may also indicate that the schedule does not contain a sufficient level of detail.

3.  Activities with Lags

The test: The percentage of incomplete activities that have schedule lags assigned to their relationships.

The threshold: 5%.

An excessive use of lags can distort an IMS and should be avoided.

4.  Relationship Types

The test: The percent of Finish to Start relationships to all relationships.

The threshold: 90%.

A project schedule should flow from the beginning of the program to the end.  Finish to Start (FS) relationships are the easiest and most natural flow of work in the IMS, with the occasional Start to Start (SS) and Finish to Finish (FF) relationship as required.  Start to Finish relationships should not be used because they represent a backward flow of time and can distort the IMS, as do the overuse of SS and FF relationships.

5.  Hard constraints

The test: The current definition includes any date constraint that effects both the forward and backward pass in the scheduling engine.  These include any date constraint that says ‘Must’ or ‘Mandatory’, ‘Start On’ or ‘Finish On’, and ‘Start’ or ‘Finish Not Later Than’ date constraints.

The threshold: 5%.

Hard constraints limit the flexibility of the IMS to produce reliable Driving Paths or a Program Critical Path.  Techniques using soft constraints and deadlines can allow the schedule to flow and identify more issues with float values.

6.  High Float

The test: Percentage of tasks with High Total Float values over 44 days.

The threshold: 5%.

A well-defined schedule should not have large numbers of tasks with high total float or slack values.  Schedules with this condition may have missing or incorrect logic, missing scope or other structural issues causing the high float condition.  The DCMA default threshold of 44 days was selected because it represents two months of effort.  Individual projects may wish to expand or contract that threshold based on the length of the project and the type of project being scheduled; however, any changes in thresholds should be coordinated with the customer first to confirm the viability of the alternate measurement.

7.  Negative Float

The test: The percentage of activities that have a total float or slack value of less than zero (0) days of float.

The threshold: 0%.

When a schedule contains tasks with negative float, it indicates that the project is not able to meet one or more of its delivery goals. This is an alarm requiring redress with a corrective action plan.  Please see the Negative Float blog for additional discussion.

8.  High Duration

The test: A percentage of tasks in the current planning period with baseline durations greater than 44 days.  This check excludes LOE, planning packages and summary level planning packages.

The threshold: 5%.

Near term tasks should be broken down to a sufficient level of detail to define the project work and delivery requirements.  These tasks should be shorter and more detailed since more is known about the immediate scope and schedule requirements and resource availabilities.  For tasks beyond the rolling wave period, longer duration tasks in planning packages are acceptable, as long as the IMS can still be used to accurately develop Driving Paths to Event Milestones and a Program Critical Path to the end of the project.

9.  Invalid Dates

The test: Percentage of tasks with actual start or finish dates beyond the Data Date, or without actual start or finish dates before the Data Date.

The threshold: 0%.

The check is designed to ensure activities are statused with respect to the Data Date in the IMS.  Claiming actual start or finish dates in the future are not acceptable from a scheduling perspective, but can also create distortions in the EVM System by erroneously claiming Earned Value in the current period for future effort.  Alternately, if tasks are not statused with actual start or finish dates prior to the Data Date, then they cannot be logically started or finished until at least the day of the Data Date, if not later.  If the forecast dates are not moved to the Data Date or later, the schedule cannot be used to correctly calculate Driving Paths to an Event Milestone, or calculate the Program Critical Path.

10.  No Assigned Resources

The test: Percentage of incomplete activities that do not have resources assigned to them.

The threshold: 0%.

This is a complex check because of two basic factors: 1) resources are not required to be loaded on tasks unless directed by the contractor’s internal management requirements, and 2) some tasks such as Schedule Visibility Tasks (SVTs) and Schedule Margin tasks should not be associated with work effort.  If the contractor chooses not to load resources into the schedule the options are:

  1. Associate basic quantities of work with tasks and define in a code field, transfer those quantities to the EVM cost system and verify the traceability between the IMS quantities and the associated budgets in the cost system.
  2. Maintain the budgets entirely in the EVM cost system and provide a trace point from the activities in the IMS to the associated budgets in the cost system.  The trace points are usually in the form of control account and work package/planning package code values.

In either case, care must be exercised so that Schedule Visibility Tasks are reviewed and confirmed to ensure that work is not misrepresented to either the contractor or the customer.

11.  Missed Activities

The test: Percentage of completed activities, or activities that should have been completed based on their baseline finish dates, and failed to finish on those dates.

The threshold: 5%.

Many people view this as a performance metric.  That is true, but it is also used to review the quality of the baseline.  For example, if a project has a 50% failure rate to date, what level of confidence should the customer have in future progress?  Is the baseline a workable plan to successfully complete the project?  Does the EVM System reflect the same issues as the IMS?  If not, are they correctly and directly connected? These are questions that should be addressed by the contractor before the customer or other oversight entities ask them.

12.  Critical Path Test

The test: Select a task on the program Critical Path and add a large amount of duration to that task, typically 600 days.

The threshold: The end task or milestone should slip by as many days as the delay in the Critical Path task.

This is a test of the integrity of the schedule tool to correctly calculate a Critical Path.  If the end task or milestone does not slip by as many days as the artificial delay, there are structural issues inhibiting this slip.  These issues may be logic links, hard constraints or other impediments to the ability of the schedule to reflect the slip.  These issues should be addressed and corrected as the schedule data is to be relied upon to provide meaningful information to management.

13.  Critical Path Length Index (CPLI)

The test: The Critical Path length + the Total Float on the Critical Path divided by the Critical Path Length.  This formula provides a ratio that puts the Critical Path Float in perspective with the Critical Path length.

The threshold: .95 or higher.

If the program is running with zero (0) Total Float on the Program Critical Path, then the ratio is 1.00.  If there is negative float on the Program Critical Path, then the ratio will fall below 1.00 which indicates that the schedule may not be realistic and that project milestones may not be met.

14.  Baseline Execution Index

The test: The number of completed activities divided by the number of activities that should have been completed based upon the baseline finish dates.

The threshold: .95 or higher.

This check measures the efficiency of the performance to the plan.  As such, some people also dismiss this as a simple performance metric, but as in the case of Metric #11 (Missed Tasks), this is also a measurement of the realism of the baseline plan.  As in Metric #11, if the schedule performance is consistently not to the plan, how viable is the plan?  How viable is the EVMS baseline?  How accurate is the information from the baseline that Management is using to make key decisions?  Metrics #11 and #14 may reflect the result of the effort being performed on the contract, but also represent the quality and realism of the baseline plan.

What are additional metrics that help identify schedule quality issues?

The DCMA’s 14 point schedule assessment should be considered a basic check of a schedule’s health, but by no means is the only check that should be used to analyze an IMS.  More industry standard checks are identified in other documents, including the Planning and Scheduling Excellence Guide (PASEG) revision 2.0 (6/22/12). The PASEG is a National Defense Industrial Association (NDIA) product and was developed in cooperation between industry and the Department of Defense. Section 10.4, Schedule Execution Metrics, discusses in greater detail some of the Health Metrics identified above, as well as other metrics including the Current Execution Index (CEI) and the Total Float Consumption Index (TFCI).

In addition to these metrics, checks should be performed on activity descriptions, activity code field values, risk inputs, Earned Value Techniques and other tests to assure alignment of the IMS with its partner information systems.  These systems include, but are not limited to the MRP system, the cost system, program finance systems and the risk management system.  The IMS in an integral component of a company’s management system, therefore issues with the IMS data will be reflected in the other components of the EVMS.

All of the above health checks can be performed manually with the use of filters and grouping functions within the scheduling tool; however, they may take too much time and effort to be successfully sustained.  The marketplace has tools available to perform these and other checks within seconds, saving time and cost, allowing schedule analysts and management to devote valuable time to address and resolve the issues.  With the aid of these tools, a comprehensive schedule health check can be performed as part of the business rhythm instead of an occasional, time available basis.

Summary

Schedule Health Metrics are an important component of the schedule development and maintenance process.  While the DCMA has established some basic standards for schedule health assessments, the 14 metrics should not be considered the only checks, but just the beginning of the schedule quality process.

Schedule checks should be an integral part of the schedule business rhythm and when issues are identified, they should be addressed quickly and effectively. Significant numbers of tasks that trip the metrics, or persistent issues that are not resolved, may require a Root Cause Analysis (RCA) to identify the reasons for the problems and to develop a plan to address them.

Give Humphreys & Associates a call or send us an email if you have any questions about this article. 

Schedule Health Metrics Read Post »

Level Of Effort Decision Tree – Clarifying Source Articles

, , , , ,
Level Of Effort Decision Tree – Clarifying Source Articles

Updated January 20, 2021

 

Level of Effort Decision Tree – Introduction

If you have not read the LOE source articles, Level of Effort (LOE) Replanning and How to Avoid Corrective Action Requests Related to Level of Effort, it is necessary to read prior to these articles in order to have the context for the following subject matter.

Humphreys & Associates, Inc. prepared an article a couple of months ago in order to increase the awareness of Earned Value Management Systems (EVMS) reviews related to Level of Effort (LOE) replanning. This resulted in considerable attention because we did not adequately explain our intention.

We had hoped readers would recognize that there are many strong and diametrically opposed opinions on acceptable approaches to LOE replanning. An important point to remember is that the principal purpose of an EVMS is to provide adequate information from which to make logical, well-informed decisions based on the best data available.

Our article resulted in a request for the National Defense Industrial Association (NDIA) Integrated Program Management Division (IPMD) to address this topic in its EVMS Clearinghouse Working Group. The company that submitted the issue used one of the approaches that we listed, which led to a DCMA Discrepancy Report. Consequently, they were clearly concerned. To address that one issue would not have provided an intelligent approach – it would have resulted in even more concerns for other organizations. For that reason, we chose to provide an update to our article in the form of a “white paper.” We do not address the many approaches being employed, as some display thinking that is “way out of the box;” such as earning whatever the actual costs are – as opposed to the budget.

We chose to leave some of those approaches out of the options addressed below. One could almost conclude that we are observing the classic consultant response to some issues – “It depends.”

BACKGROUND

The distinctive feature of the Level of Effort (LOE) earned value technique is that it earns value through the passage of time with no consideration of any work being performed. Therefore, it can earn value with no incurrence of actual costs and incur actual costs without earning value. Both of these conditions are currently considered by some DCMA review teams as noncompliant to the EVMS Guidelines (#16 and/or #22) that could result in a DCMA issued Corrective Action Request (CAR).

This is usually not an issue for the typical LOE that is support to the entire project (e.g., project management, contract management, financial management, systems engineering, security, safety, etc.) because these efforts almost always start on time and only face a problem if the support extends past the contract baseline. However, it is frequently an issue for LOE that provides support to discrete efforts that could slip or be moved up for various reasons (e.g., test site availability, equipment failures, successes that eliminate future planned effort, etc.) if the LOE work is not allowed to be replanned to the time period where the discrete work is actually being performed.

The LOE baseline period of performance should match the discrete effort’s period of performance. While the discrete effort can occur early or late and have earned value and actual costs coincide, that is not necessarily true for the supporting LOE, because it earns its value as planned in the baseline regardless of when the work actually starts or when the actual costs are incurred. The examples below show the possible LOE conditions when discrete effort starts early, finishes early, starts late, and finishes late. Each condition trips a significant item of concern when the DCMA runs its diagnostics of a contractor’s EVMS data:

If the discrete effort starts early, and LOE is not allowed to replan, LOE incurs ACWP with no BCWP.

H&A 1 - LOE Decision Tree

If the discrete effort finishes early, the remaining months of LOE support earn BCWP with zero ACWP.

H&A 2 - LOE Decision Tree

If the discrete effort starts late, LOE earns value (BCWP) with no actual costs (ACWP).

H&A 3 - LOE Decision Tree

If the discrete effort finishes late, LOE incurs ACWP without accompanying BCWP because the BCWP now equals the BAC. However, when the support effort’s manager reports an EAC that includes the to-go LOE to report an accurate EAC, it creates the situation of EAC>ACWP with BCWP=BAC, again tripping a DCMA significant item of concern.

H&A 4 - LOE Decision Tree

These conditions have resulted in Corrective Action Requests (CARs) from some local DCMA representatives because they are identified as significant items of concern by the DCMA diagnostics. Unfortunately, the diagnostics applied to discrete work packages are also applied to LOE tasks. There is no consideration of the special circumstances associated with LOE in the diagnostic software being used by review teams.

It is important to note that LOE is often (erroneously) called a work package just like discrete effort is called a work package and, therefore, work package rules are automatically applied to LOE. But not all work package attributes apply to LOE. For example, LOE does not consist of discrete tasks, is not required to be of short duration, and does not measure performance. The special circumstances of LOE were recognized in 1991 by the Department of Defense issuance of the Performance Measurement Joint Executive Group (PMJEG)’s Supplemental Guidance to the Joint Implementation Guide (JIG) involving the Cost/Schedule Control Systems Criteria (C/SCSC). Section 3-6, Revisions, subsection b (Internal Replanning) specified special handling of LOE for the circumstances cited above. However, the JIG Supplemental Guidance has not been incorporated into current implementation guidance. Please note that some DCMA EVMS Center of Excellence personnel have stated that the 1991 JIG Supplemental Guidance is applicable to current guidance. This is the way it used to be and was understood by all. But that position has not been documented and distributed to DCMA field office personnel, resulting in different determinations as to which actions are allowable and which are not. Many DCMA field office EVMS personnel have never been exposed to the JIG Supplemental Guidance. Those that are aware of the 1991 JIG Supplemental Guidance or who would agree with the JIG Supplemental Guidance approach as being compliant tend not to create CARs for the same conditions, while, unfortunately, those who are not aware of the Guidance write CARs.

INTRODUCTION TO THE DECISION TREE

The following decision tree relies heavily on the JIG Supplemental Guidance for recommending actions to avoid CARs. It is organized in outline format with major sections being the four discrete effort status possibilities that can cause LOE to result in a CAR as shown above. The first sub-topic in each section is the supporting LOE condition that results in tripping a significant item of concern in the diagnostic software DCMA employs from the Data Call before arriving on-site. The second sub-topic provides a quotation from the PMJEG Supplemental Guidance to the C/SCSC JIG, Section 3-6 Revisions, Subsection b. Internal Replanning that applies to the identified condition. The third sub-topic provides suggestions on how to implement the guidance to avoid the condition. The following sub-topics provide the advantages, disadvantages, and reporting requirements for each avoidance action.

In presenting these actions we need to make the point that depending on the interpreter none of these or only some of these would be acceptable to a DCMA reviewer. We are merely attempting to bring forth the options observed so that many can consider which approach is best for them and then use simple examples to present their desires to their customers.

Note that JIG references to “cost account” apply to control accounts.

LEVEL OF EFFORT (LOE) DECISION TREE

OUTLINE

Discrete Effort Starts Early

  1. Condition that may result in a DCMA CAR
    1. The LOE BCWS does not start until a later period (cannot earn value in the current period).
    2. LOE has ACWP without BCWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(c).
      2. “Replan future LOE to correlate to the changes in work. LOE, whether planned in separate cost accounts or as part of predominantly discrete cost accounts, has additional flexibility and may be adjusted within the current accounting period without government approval, provided no actual costs (ACWP) have been charged to the LOE.”
      3. How to implement the Supplemental Guidance
        1. In the current accounting period, replan the LOE to begin in the current period.
        2. Determine whether the discrete effort’s early start will result in an early finish (length of the period of performance remains the same).
          1. If so, no BAC change should occur – only the shift in the BCWS.
          2. If not, either provide additional BAC from MR or re-spread the BAC over the revised future period of performance (often called the “peanut butter” approach).
  2. Advantage
    • Avoids the ACWP without BCWP condition.
  3. Disadvantage
    • Changes the baseline in the current period. If the local DCMA office is not aware of the Supplemental Guidance or knows about its existence but disagrees with it, a CAR may be issued. Also, some DCMA teams consider the stretching out of current budget over a longer period of time as creating “token budgets” – for which they have written CARs.
  4. Reporting requirement
    • Must be reported in Integrated Program Management Data and Analysis Report (IPMDAR) database for Format 5.

Discrete Effort Finishes Early

  1. Condition that may result in a DCMA CAR
    1. The discrete effort has finished early and if the LOE had not previously been replanned in anticipation of the early finish, no LOE support effort would be required for the remaining period(s) of the LOE BCWS that must still earn value.
    2. The LOE has BCWP without ACWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(b).
      2. “Replan incomplete future work and adjust the work package budget at completion (BAC) to reflect the change in accordance with normal replanning guidance…”
      3. How to implement the Supplemental Guidance
        1. Because the “incomplete future work” has been eliminated, close the LOE package. The BCWS will already be equal to the BCWP earned to date.
        2. Subtract the BCWP from the BAC and return the BCWR initially to the UB Log and subsequently to the MR Log.
        3. If this can be achieved in the period in which the discrete effort was completed, this is a change to the next accounting period, thus avoiding a change to the current period baseline.

        NOTE: There is another point to be made here. The LOE task was to support the discrete work scope no matter how long it took. If the discrete task finished early because its work scope was reduced, the LOE task requirement was also reduced and the above action is justified. If the discrete task simply finished early, this would be a cost variance in that it cost less to support the unchanged work scope. The above action would be done solely to avoid the BCWP without ACWP condition.

  2. Advantage
    • Avoids the BCWP without ACWP condition.
  3. Disadvantage
    1. If the change is made in the same period in which the discrete effort was completed (or a prior period), there is no disadvantage although some would argue that this approach would be “changing budgets based on performance” which is akin to using MR to hide true cost variances.
    2. If the change is made in the period subsequent to the completion of the discrete effort, the current period baseline will change. If this is a repetitive occurrence, it probably means that a contractor is constantly changing the baseline to avoid true cost variances; therefore, it may result in a DCMA CAR.
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5 (MR was increased).

Discrete Effort Starts Late

  1. Condition that may result in a DCMA CAR
    1. The discrete effort has not started (no ACWP or BCWP), hence no LOE was required. This results in zero ACWP for the LOE, but it does report BCWP because of the passage of time.
    2. The LOE has BCWP without ACWP, a significant item of concern condition.
    3. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(c).
      2. “Replan future LOE to correlate to the changes in work. LOE, whether planned in separate cost accounts or as part of predominantly discrete cost accounts, has additional flexibility and may be adjusted within the current accounting period without government approval, provided no actual costs (ACWP) have been charged to the LOE.”
      3. How to implement the Supplemental Guidance
        • In the current month replan the LOE to begin in the month that the discrete effort is currently scheduled to begin.
  2. Advantage
    • Avoids the BCWP without ACWP condition.
  3. Disadvantages
    1. Changes the baseline in the current period. If the local DCMA office is not aware of the Supplemental Guidance or disagrees with the Supplemental Guidance, a CAR may be issued.
    2. If the discrete effort recovers its schedule variance, the LOE will be put in the position of having BCWP yet to be earned with no LOE required (equivalent to the early finish condition presented below).
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5.

Discrete Effort Finishes Late

  1. Conditions that may result in a DCMA CAR
    1. The LOE incurs ACWP with no accompanying BCWP.
    2. The LOE incurs ACWP with no accompanying ETC, usually indicated by ACWP>EAC.
    3. Both of these are significant items of concern conditions.
    4. Applicable JIG Supplemental Guidance, Internal Replanning
      1. Paragraph (3)(b).
      2. “Replan incomplete future work and adjust the work package budget at completion (BAC) to reflect the change in accordance with normal replanning guidance…”
      3. How to implement the Supplemental Guidance
        1. In or before the last period of performance of the LOE, replan the LOE to cover the extended discrete effort.
        2. Use one of two methods to provide budget for the additional effort:
          1. If ACWP is less than BCWP, recover budget from the previously earned LOE BCWP by using the single point adjustment technique of setting BCWS and BCWP equal to ACWP and replan the recovered budget (BAC minus BCWP) into the future.
          2. If ACWP is equal to or greater than BCWP, but less than BAC, replan the unearned budget (BAC minus BCWP) into the future.

        NOTE: Alternative to 3) implementing the Supplemental Guidance

        1. Allow the LOE package to complete without replanning, which results in accepting the ACWP without BCWP condition.
        2. To mitigate the severity of this approach, be certain to provide an ETC for the periods beyond the LOE baseline period of performance. This action would avoid an ACWP>EAC condition.
  2. Advantages
    1. Avoids the ACWP without BCWP condition.
    2. Avoids the ACWP>EAC condition.
  3. Disadvantage
    • There will be a baseline change in the current period. Because ACWP has occurred, the LOE exception to be able to make a change in the current period if no ACWP has been recorded does not apply. Therefore, a DCMA CAR may be issued.
  4. Reporting requirement
    • Must be reported in IPMDAR database for Format 5.

Observations/RECOMMENDATIONS based on the foregoing:

  1. First and foremost, because many DCMA personnel are not familiar with the JIG Supplemental Guidance or may not agree with it (remember that the DCMA Center of Excellence has not formally confirmed that the JIG Supplemental Guidance remains in effect), contractors must determine the desired approach of the cognizant DCMA personnel for handling the LOE conditions noted above. Early discussions to determine acceptable approaches to the LOE special conditions will avoid many of the CARs/DRs being issued.
  2. Eternal vigilance is required. If a potential change in the performance period of the discrete effort becomes apparent sufficiently early, the change can be accomplished with little chance of incurring a DCMA CAR. This assumes that people recognize the right to change LOE in an “open LOE task”.
  3. The DCMA Center of Excellence must officially transmit additional guidance to the DCMA field offices to ensure consistent application of EVMS Guideline requirements to LOE.
  4. Some may suggest using the Apportioned Effort technique in lieu of LOE, but that would require that the supporting budget be estimated as a percentage of the discrete effort and its time-phasing be established at the same percentage as the time-phasing of the base. Usually, LOE budget is based on an average level of support that is inconsistent with or has a “loose” relation to the discrete package’s time-phasing.
  5. One alternative approach is to consider short duration (3-4 months) LOE for supporting discrete effort. An advantage to this approach is that while the first LOE in the series might incur a significant item of concern condition, the following efforts could be adjusted without penalty.
  6. Another alternative approach is to make the entire support effort a percent complete EVT work package with the Quantifiable Backup Data (QBD) being the milestones in the supported discrete effort.
  7. If the LOE has been reported as complete in the prior month, it has been suggested by some in the DCMA EVMS Center of Excellence that the LOE BCWP that has already been earned can be “harvested” to budget a continuation of the LOE past its original period of performance. This was not a consideration of the JIG Supplemental Guidance and most would argue that this approach is in direct conflict with Guideline 30. Contractors should not use this method unless it is formally approved by the DCMA EVMS Center of Excellence.

To contact Humphreys & Associates click here.

Level Of Effort Decision Tree – Clarifying Source Articles Read Post »

How to Avoid Corrective Action Requests Related to Level of Effort

,

Has DCMA issued you a Level III Corrective Action Request (CAR) because you have had repeat Level 2 CARs for having “BCWP with no ACWP(Budgeted Cost for Work Performed vs. Actual Cost of Work Performed) or “ACWP with no BCWP” that has not been corrected?

According to all the EVMS rules, this appears to be a legitimate finding. If left uncorrected, is a valid Level 3 CAR request that can have serious financial implications.

This would certainly be a valid finding for discretely measured tasks. However, what about level of effort (LOE) work? Because LOE earns value with the passage of time it may or may not align with actual accomplishment of the work planned in that LOE task.

This usually is not a problem for general support tasks that span the duration of the project (unless the project slips). The issue more often arises with shorter duration LOE tasks that are planned to support specific discretely measured tasks. Everything is fine if the discrete work task takes place as planned. But what happens when it doesn’t?

If you are not paying attention to the LOE tasks associated with the discrete work effort, e.g. the EVM system is on autopilot, and the associated discrete work starts early or late, the result for the LOE work effort is:

  • ACWP (Actual Cost of Work Performed) without BCWP
  • BCWS (Budgeted Cost for Work Scheduled) and BCWP without ACWP
  • Distortion in the system of when the support work is really happening

The issue is further compounded when contractors attempt to make previous period adjustments (something that should be avoided) for LOE work effort and do not explain to their customer why they made current or prior period adjustments to BCWS, BCWP, and ACWP.

How you do avoid these issues with LOE tasks? It takes proactive planning and management of LOE tasks.

Read our in-depth article on recommended practices for improving the planning and monitoring of LOE activities. The goal is to avoid changing past LOE data when the discrete work does not take place as planned and to avoid those repeat CARs for “BCWP with no ACWP” or “ACWP with no “BCWP”.

Need help with how you are handling LOE work tasks or need to develop guidance on how to use the various earned value techniques? Contact H&A today.

How to Avoid Corrective Action Requests Related to Level of Effort Read Post »

Earning Value for Material – The Correct Approach – Part 2

Recall from our blog in early October about earning value for material, in which Guideline 21 in the EIA-748 Standard for Earned Value Management Systems (EVMS) states that earned value is measured “…at the point in time most suitable for the category of material involved, but no earlier than the time of actual receipt of material.”

In that earlier blog, two high-level types of material categories were discussed for illustration purposes. A common follow on question is “When Guideline 21 mentions category of material (highlighted above), are there pre-set categories of material that companies should use?”

The answer: Material categories are unique to each company, though companies may have general similarities to others in the same line of business. It is also dependent on whether a company has non-production or production type contracts (or both). In the previous blog topic, Engineering Material and Production Material were used as generic examples for material categories assuming a company has some level of production activity.

Even if a company is not a production (or manufacturing) facility, if they have material that sits in inventory for an extended length of time (generally longer than two months), the earned value point should be different from that of engineering (or receipt) type material. Some companies describe their material categories as “receipt type material” and “inventory type material.”

A company’s Earned Value Management (EVM) System Description should describe the various categories of materials that are typical in their line of business. For example, many contractors include subcontractors, staff augmentation subcontractors, temporary services, office supplies, etc. as material categories that are planned and earned differently.

When dealing strictly with materials used for engineering and/or production related effort, a number of EV approaches may be needed. This is based on the products a company typically builds for their government customer. This could include bar stock, sheet stock, wire or cable reels, nuts and bolts, various types of subassemblies, purchased parts, or consumables such as lubricants, gases, coatings, paints, acids, etc. Various materials could also have different handling requirements, including bonded stores, with different rules for use, issue, transfer, borrow/payback and so forth. As a result, the various types of materials may have different methods for planning and use and could all use different earned value techniques.

Another consideration when determining the appropriate earned value techniques for production environments is the approach used to determine high dollar value and low dollar value material.

  • High dollar value material should be planned and earned using discrete earned value techniques
  • Low dollar value material may be planned and earned as apportioned effort or as level of effort (LOE), as well as being discretely measured
  • Low dollar material may be planned as items in aggregate, or in homogeneous groupings (e.g., lubricants, fastening hardware, bar stock, coatings, etc.).

H&A recommends ensuring your EVM System Description provides the appropriate guidance to projects on how to properly plan for the various material categories and acceptable earned value techniques that should be used as well as the appropriate earned value points (receipt or issue) for the category of material involved.

Do you need an independent review your EVM System Description to ensure you are providing the necessary guidance to your projects? Humphreys & Associates has the earned value management experts to assess your EVM System Description. Contact us today.

Earning Value for Material – The Correct Approach – Part 2 Read Post »

Scroll to Top