Performance Measurement Baseline (PMB)

Maximizing the Value from Integrated Baseline Review (IBR) Investments 

, , , , , , , ,

A previous blog, How Integrated Baseline Reviews (IBRs) Contribute to Project Success, provided an overview of the purpose and scope of IBRs as well as the benefits of conducting an IBR. This blog adds to the discussion on the benefits of conducting an IBR. It reflects observations gathered from our earned value consultants while assisting clients to prepare for IBR events

As a reminder, IBRs provide the opportunity to verify the:

  • Contractor and the customer have a common understanding of the scope of work, technical requirements, and accomplishment criteria. 
  • Contractor has established an executable performance measurement baseline (PMB) for the entire contractual scope of work that accurately reflects how they plan to accomplish the work within the contractual period of performance, negotiated contract cost, and funding profile. 
  • Required resources have been identified and assigned to the project to accomplish the project’s objectives. For example, the staffing plan accurately reflects the sequence of work as well as resource availability and demand.  
  • Technical, schedule, and cost risks/opportunities have been identified, assessed, and captured in a risk/opportunity register. Risk mitigation actions have been incorporated into the PMB to reduce known threats to an acceptable level. This is often the most valuable component of the IBR to ensure all parties have an understanding of the risks/opportunities, assumptions, and risk mitigation or opportunity capture plans. 

Factors that Contribute to a Successful IBR

Treating an IBR as just a contractual requirement limits its value to all parties. IBRs are essential to the successful execution of any project. IBRs require a focused mindset to clearly define as well as assess the measurable benefits gained for the time and effort invested in the IBR. From our observations, contractors that defined what they expected to gain from an IBR, whether the IBR was contractually required or not, made a measurable difference in the outcomes from the IBR. The effectiveness of an IBR is contingent upon management’s commitment to excellence in implementing their EVMS and their desire to ensure they have reliable and useful data for management visibility and control. And that begins with establishing an executable PMB. 

The following list of factors often influence the perceived value of an IBR and hence the approach a contractor takes to planning and conducting their IBRs. 

  • Recognizing the relative importance of the review.
  • Defining the value or measurable benefits they expect to gain from conducting the review.
  • Well defined risk/opportunity management process. 
  • Timely and sufficient review planning and preparation.
  • Joint or collaborative planning and preparation.
  • Well defined objectives as well as entrance and exit criteria. 
  • Tailoring the IBR approach to best accomplish the review objectives.
  • Communication and expectation management.

These factors were ultimately indicative of whether the IBRs were considered value-added (retrospective assessment by the participants) based on the level of understanding, investment in or attention to, or the degree of success in implementing these factors. Based on H&A earned value consultant’s observations, the single factor that tends to drive the IBR approach is clearly defining the value the contractor expects to gain beyond what is mandatory or contractually required. 

IBR Investment Value

The term “IBR investment value” is purposefully used here. The intent is to invite you to re-assess how IBRs are viewed apart from simply meeting government agency IBR requirements. “IBR investment value” is used to mean a qualitative assessment that encapsulates the value-add or measurable benefits teams often have difficulty defining as well as to help provide the impetus and guiding direction for conducting an IBR. It has both intrinsic and extrinsic properties. 

The intrinsic value of the IBR investment resides in those specific elements of information (as identified by the customer in the form of questions or concerns) that are either exchanged, clarified, or refined through the course of discussions between the customer and performing contractor teams. This intrinsic value can be measured by how well the exchanged information supports:

  • A complete, clear and mutual understanding of the work to be accomplished.
  • The resources needed to get the work done.
  • The detailed plan to perform the work.
  • What resources are available to support the plan.
  • What’s missing or unknown that is needed to complete the work correctly and on time.
  • What risks, issues, concerns, or opportunities are associated with contractor’s concept that need to be fully considered to make the plan work. 

The extrinsic value of the IBR Investment rests wholly in the quality of the exchanges (discussions), and the resulting actions generated from the discussions. This extrinsic IBR value addresses how appropriate, rich and comprehensive the information exchanges were, and answers to questions, such as:

  • Were the discussions responsive to a list of customer information requirements and concerns? 
  • Were the right discussions held? At the right level of detail?
  • Were the right people involved in each discussion? 
  • Did the discussions provide sufficient context? Were they comprehensive? Complete?
  • Did the discussions address associated risks, issues, opportunities or other concerns? Relationships to other discussions/elements?
  • Were all the customer’s questions or concerns answered to their satisfaction?
  • Were the discussions documented to support decisions? Alternatives? Changes? Studies?

The exchanges of essential information (intrinsic value) and the quality of those exchanges (extrinsic value) when combined directly translate to the investment value achieved from the IBR. It characterizes how well the information exchanged provides both teams with the necessary details to successfully define, schedule, budget, and manage the contracted effort relative to the investment into the IBR process. A realistic, risk adjusted PMB helps to prevent schedule delays and cost overruns during project execution that often impact a contractor’s profit margins and tarnishes their credibility with their customers. 

What are the characteristics of a value added IBR approach?  

A successful approach H&A earned value consultants have observed contractors implement is a structured process corporate management actively participates in to ensure they gain the most value from all IBR events. 

This is often an outgrowth from corporate initiatives to retain top project management talent and establishing an EVMS self-governance process. It is part of a corporate culture that is committed to excellence in project management and sustaining a best in class EVMS – becoming efficiently expert at EVM

What are some common characteristics of their IBR approach?

  • A chartered authority or corporate team responsible for assisting project personnel with IBR events in addition to EVMS implementation, self governance, and customer surveillance events. A good practice we have seen implemented is to establish rotating members on the IBR teams from different projects as a means to pollinate best practices across projects. It also provides an opportunity to mentor top talent on track to move up to higher management positions.  
  • A standard repeatable process with defined measurable outcomes that can be tailored to the unique project requirements or objectives. This includes maintaining a set of materials for the internal IBR team to effectively plan and execute an IBR as well as to close out any action items. Examples include training materials to prepare project personnel, process description with team member roles and responsibility assignments, data call list, role based interview question forms with assessment criteria, data quality assessment materials and tools, list of data traces to be performed, schedule risk assessment tools, risk/opportunity evaluation criteria, defined assessment criteria (technical, schedule, cost, resources), in-briefing and out-briefing templates, and template to capture action items to track to closure. The corporate team is often responsible for actively maintaining the content for the IBR teams and conducting training. 
  • They place an emphasis on two components that directly impact the quality of the schedule and cost data.  This includes:
    • Well-documented data driven basis of estimates (BOEs) that can be substantiated using historical or bench-marked data with the goal of reducing expert judgement cost estimates to the lowest level possible as a risk reduction strategy.  
    • The quality of the risk/opportunity management plan and the content in the risk/opportunity register. This content directly affects the ability of all parties to gain a better understanding of the risks/opportunities and best options to mitigate a risk or capture an opportunity. A well constructed schedule is required to be able to perform schedule risk assessments (SRAs). SRAs help to identify where duration risk exists in the schedule and to determine a level of confidence in meeting major project milestones as well as the project completion date.  
  • They perform internal IBRs as a standard practice on all projects regardless of contractual requirements. This is particularly important when subcontractors are performing a substantial percentage of the work effort. The corporate team often assists Project Managers with conducting a joint IBR with major subcontractors.  

Need help establishing a corporate IBR process?

H&A earned value consultants often help clients to establish a corporate EVM council or center of excellence with defined responsibilities to ensure project personnel effectively implement their EVMS, integrate risk/opportunity management into the EVMS, as well as define and implement a standard repeatable process for IBRs and self-governance. Clients often need assistance establishing a repeatable process for conducting schedule risk assessments, an essential component of the IBR process. A defined process that clearly articulates the expected measurable outcomes from conducting IBRs is one way to ensure all parties gain the most value from the event with the end objective of ensuring a realistic and executable PMB has been established.  

Call us today to get started.  

Maximizing the Value from Integrated Baseline Review (IBR) Investments  Read Post »

Performance Measurement Overview

,

In our second video in this series, we present an overview of Performance Measurement in an Earned Value Management System.

Video Contents

You can use the links below to jump to a specific part of the video.
0:05 – Earned Value Management Abbreviations used in Performance Measurement
0:39 – Variances in an Earned Value Management System
1:04 – What is Performance Measurement?
1:33 – Performance Measurement Objective
1:52 – Why is Communication the primary objective of Performance Measurement?
3:00 – The Problem of Too Much Data

More EVMS Training

If you liked this video you can purchase the entire course below. This video is an excerpt from the Department of Defense (DOD) version of this eLearning module. We also offer the same course customized for the Department of Energy’s (DOE) specific Earned Value Management (EVM) implementation/requirements, as well as a version of the course customized for NASA’s EVM implementation/requirements.  

— Purchase This Course —
EVMS DOD Virtual Learning Lab

— Purchase the DOE Version of this Course —
EVMS DOE Virtual Learning Lab

— Purchase the NASA Version —
EVMS NASA Virtual Learning Lab


EVMS Document Matrix

Not sure what the different requirements are between the DOE and NASA? Can’t remember if Cost and Software Data Reporting (CSDR) is required for an NSA contract? Check out our easy to read Earned Value Management Systems Document Matrix


All Online Courses

All Online Courses Available from Humphreys & Associates


Other Posts in this Series

Performance Measurement Overview Read Post »

Quality Cost Estimates

, ,
Quality Cost Estimates

The Foundation for a Realistic Performance Measurement Baseline (PMB)

If you have been involved in an Integrated Baseline Review (IBR), you can appreciate why a clear understanding of the project’s contractual scope of work and technical requirements is so important.  Without that understanding, it is impossible to create an executable Performance Measurement Baseline (PMB).  The intent of the IBR is to demonstrate to your customer you have created a realistic schedule and cost baseline plan that reflects a shared understanding of the work scope requirements as well as identified technical, schedule, cost, or resource risks that may impact the ability to execute the work as planned.

So, how do you demonstrate to your customer that your schedule and cost baseline plan is realistic for the agreed upon scope of work?  That’s where the quality of the cost estimate and related basis of estimate (BOE) information come into play.  The quality of the PMB is a direct reflection of how the project control team arrived at their cost estimate for the work scope along with documented BOE details that clearly communicates their rationale and assumptions.  The project control team needs this foundation to define the project’s sequence of activities, durations, and resources to do the work that reflects the known requirements and identified risks.

What are the characteristics of a quality cost estimate?

A quality cost estimate:

  • Reflects a shared understanding of the scope of work and technical requirements. This is often the root cause of an unrealistic cost estimate.  The IBR is a perfect opportunity for all parties to confirm the customer’s requirements and expectations.
  • Is data driven. That means the proposal or project control team has access to relevant historical actual costs for analogous tasks, parametric data, or other documented and substantiated basis for the cost estimate.  The source data for the cost estimate can be traced back to the system of record, internal standards for completing common repeatable tasks, or published industry standards.  Where possible, the use of engineering judgement cost estimating methods is minimized because they introduce a level of unknowns.  The risk of cost growth increases because objective facts and data aren’t available for other people to verify the cost estimate rationale or assumptions are reasonable.
  • Includes useful documented rationale with risk/opportunity assessment. The BOE should capture what source data was used for the cost estimate, why it was relevant, assumptions, what factors or other calculations were used to arrive at the cost estimate, what is included or excluded, identification and evaluation of likely risks and opportunities, and other details useful for explaining the cost estimate.  This is invaluable information the project control team needs to create a realistic schedule and cost baseline.  This rationale, or clearly documented rationale someone else can follow, is frequently the missing piece.  Lack of useful documented rationale can handicap the project control team during the planning phase right after contract award – and for the duration of the project.

How do quality cost estimates help improve the PMB?

The project control team, project manager, and the customer need quality cost estimates and useful documented rationale so they can verify:

  • The integrated master schedule (IMS) sequence of activities, resource assignments, and skill mix reflect how the project teams intend to do the work as well as handle identified risks and opportunities.
  • Sequence of schedule activities and resource assignments are the foundation for the time phased budget.
  • The appropriate level of schedule margin and management reserve are established for the project.
  • Useful earned value techniques are selected for the activities and work packages. In addition to technical requirements, the BOE documentation can often provide additional details that can help the project control team define accomplishment criteria or quantifiable backup data so it is easier to objectively measure completed work.

These cost estimates and documented rationale are also invaluable for:

  • Variance analysis and identifying why significant deviations from the baseline plan occurred – whether in work performance or actual costs incurred to do the work. Did an unexpected event occur?  Perhaps the risk assessment process needs a revisit.  Were the assumptions incorrect?  Why did that happen and what could be done differently to either capture or clearly communicate those assumptions?
  • When the project control team needs to process a baseline change request. They can review the source data, rationale, and assumptions to identify what was different from what actually occurred.  Or, in the case where there is a change in the scope of work, the project control team can identify the cost estimate and BOE factors they need to update to reflect the revised scope of work.  It provides a fact-based foundation to explain why the change was required and to determine what updates need to be made to the schedule activities, resource assignments, and time phased budget.
  • Providing fact-based information useful for maintaining a credible estimate to complete so it more accurately reflects the likely completion date and estimate at completion whether for interim deliverables or the entire project.
  • Rolling wave planning. As more becomes known about the future work requirements, the cost estimate and BOE can be refined to reflect the agreed upon statement of work, assumptions, risk and opportunity assessments, and other details needed to adequately plan, budget, and manage the work.

Cost estimate quality improves with each project. 

A realistic PMB reduces the likelihood of schedule and cost growth “surprises” that negatively impact a company’s bottom line or the customer’s program budget.  As work is completed, the performance and actual cost data become useful historical source data for the next proposal or project.  Each cycle improves the quality of the source data proposal or project control teams can use to substantiate their cost estimates and produce useful BOE documentation for the next project’s PMB.

Need help with preparing for an IBR or standardizing your process for producing cost estimates and BOE rationale? Contact us today.

Quality Cost Estimates Read Post »

Scroll to Top