Integrated Baseline Review (IBR)

How Integrated Baseline Reviews (IBRs) Contribute to Project Success

, , , ,

What is an Integrated Baseline Review or IBR?

An IBR is a formal review of a contractor’s performance measurement baseline (PMB) a customer conducts shortly after contract award or other project events to gain confidence in the contractor’s ability to deliver and meet contract objectives. Conducting an IBR helps to assure there is mutual agreement on the scope of work, schedule, resource requirements, and budget to meet the customer’s needs. It also assures there is a mutual understanding of the project’s risks and opportunities as well as how they will be managed.

Conducting an IBR is often a contractual requirement along with the requirement to implement an earned value management system (EVMS). Contractual documents specify the time frame for when the IBR must occur after contract award. This is typically within 90 to 180 calendar days. A customer may also conduct an IBR at critical milestones, funding gates, when transitioning to another project phase, or when significant changes are incorporated into a PMB.

What an IBR is Not

An IBR is not an EVMS compliance review. The intent of an IBR is not to devolve into a review of the contractor’s EVMS and whether it complies with the EIA-748 Standard for EVMS guidelines. That said, the contractor must be able to demonstrate they have a disciplined project control system in place. The contractor should be able to demonstrate to the customer that the project’s scope of work is properly planned, scheduled, resourced, budgeted, authorized, and managed using their project control system.

What are the benefits of conducting an IBR?

Conducting an IBR contributes to successful project execution because it helps to ensure a realistic PMB has been established.

IBRs provide the opportunity for the contractor and customer to verify:

  • There is shared understanding of the scope of work, technical requirements, and accomplishment criteria. As the work breakdown structure (WBS) is decomposed into manageable product-orientated work elements, it provides a common frame of reference for communication between the contractor and customer. The WBS dictionary should capture the technical requirements that must be met as well as expected deliverables and outcomes. The contractor must have a clear understanding of customer’s needs, assumptions, and expectations to be able to create a realistic schedule and budget plan. The IBR provides the opportunity for the contractor to verify the scope of work details with the customer before the project execution phase begins. In instances where the technical requirements evolve over time as work progresses, rolling wave planning is often used to detail plan the current work effort with more macro planning for future work effort to ensure the entire scope of work is included.
  • An executable PMB has been established for the entire contractual scope of work. The PMB should accurately reflect how the contractor plans to accomplish the work within the contractual period of performance and negotiated contract cost. The customer’s funding profile may also determine the timing of activities and when resources are required. The schedule and budget should be in alignment. The budget time phasing should reflect the schedule activities and resource requirements. It is also useful to verify appropriate earned value methods and techniques have been selected for the work packages to assure objective and meaningful project performance can be measured and reported as work progresses.
  • The required resources have been identified and assigned to the project. This contributes to producing an executable schedule and budget plan. The staffing plan should accurately reflect the sequence of work and skill mix as well as resource availability and demand to accomplish the project’s objectives. Flat loading labor hours may not accurately reflect common challenges of ramping up resources after contract award or the availability of critical resources for specific tasks. Other resource factors include the timing or availability of critical or high value materials as well as subcontractors responsible for performing work or providing services.
  • Project technical, schedule, and cost risks/opportunities have been identified and assessed. This also contributes to producing an executable schedule and budget plan. Where possible, risk mitigation actions have been incorporated into the PMB to reduce known risks to an acceptable level. For example, the timing or duration of activities as well as resource requirements may need to be adjusted. Schedule margin activities may be incorporated into the integrated master schedule (IMS). It also provides fact-based information to determine the amount of management reserve set aside to handle realized risks. This is often the most valuable component of the IBR. It is essential all parties have an understanding of the identified risks or opportunities, potential impact if they are realized, and risk mitigation or opportunity capture plans.

Why it is important to verify these details during an IBR?

A realistic schedule and budget plan helps to prevent cost growth surprises because of technical, schedule, or budget challenges. The better the up-front planning, the less the likelihood of cost growth during project execution. It also increases credibility with the customer. The contractor can demonstrate their ability to deliver to the customer needs and manage the work effectively.

Benefits of Preparing for an IBR

Establishing a project’s PMB is a significant and often formal event as it signals the transition from the planning to execution phase. It represents the culmination of the integrated planning, scheduling, budgeting, work authorization, and risk/opportunity management processes.

A common best practice is to conduct an internal baseline review regardless of whether a formal IBR with the customer is required prior to setting the PMB. Implementing a standard process to conduct an internal review of the complete set of project data and artifacts with the project personnel assures an executable schedule and budget plan has been established to accomplish the contractual scope of work within the contractual period of performance and negotiated contract cost in alignment with the contract’s funding profile.

These internal reviews help to ensure there is a common understanding of the scope of work, major project events, planned sequence of work, schedule of deliverables, resource requirements, time phased budget, funding profile, and project risks/opportunities. It also provides an opportunity to verify the quality of the integrated schedule and cost data as well as top down and bottom up traceability. 

Need help preparing for an IBR?

A common earned value consulting service H&A provides is conducting a mock IBR with project personnel to prepare for the formal customer IBR. The objective is to conduct a thorough assessment of the project’s PMB to verify it reflects the entire contractual scope of work and technical requirements as well as identified technical, schedule, cost, or resource risks that may impact the ability to execute the work as planned. This provides an opportunity to correct any issues with the PMB prior to the IBR event.

Another standard earned value consulting service we offer is conducting IBR training for project team members. H&A earned value consultants can help you to establish a standard internal process to verify an executable PMB is in place for a given project. Once again, the objective is to prevent cost growth surprises and management is aware of the project’s risks and opportunities that may impact profit margins. 

Call us today at (714) 685-1730 to get started. 

How Integrated Baseline Reviews (IBRs) Contribute to Project Success Read Post »

Updates to the Compliance Review Series of Blogs

,

Time Lapse of Freeway representing the progress of time.

2020 Update

Humphreys & Associates has posted a 2020 update to the series of blogs discussing the DCMA Compliance Review (CR) process. “Compliance Review” is the term used for the formal EVM System review DCMA performs to determine a contractor’s compliance with the EIA-748 Standard for EVMS guidelines. This can also include, as applicable, Surveillance Reviews and Reviews for Cause (RFC).

DCMA used to follow a 16 Step compliance review process. This changed to an 8 Step process with the release of the DCMA Instruction 208 (DCMA-INST 208) titled “Earned Value Management System Compliance Reviews Instruction.” This Instruction has been rescinded and replaced with a set of DCMA Business Practices (BP). These Business Practices split out topics that the old DCMA Instruction 208 covered in one document. Whether you are a contractor new to the EVM contracting environment or a seasoned veteran, if the Earned Value Management System (EVMS) compliance and acceptance authority is the Defense Contract Management Agency (DCMA), these new Business Practices apply to you.

The four updated blogs include:

  • EVMS Compliance Review Series #1 – Prep for the DCMA Compliance Review Process. This blog presents the set of DCMA Business Practices (BP) that define the EVMS and Review process and specifically discusses Business Practice 6 “Compliance Review Execution.” It also discusses what you can expect should you need to complete the DCMA Compliance Review process through the 5 phases and 23 Steps outlined in BP6. It is critical you are able to complete each step in the process successfully the first time through to prevent delays. The best way to make sure you are prepared is to conduct one or more internal EVMS Mock Reviews, the topic for the next blog.
  • EVMS Compliance Review Series #2 – Conducting Internal Mock Reviews (Self Assessments). This blog discusses the importance of conducting a thorough internal review of your EVMS. You may or may not have the expertise in-house to conduct this simulation of a Compliance Review. An independent third party can help you prepare for a DCMA compliance review. The objective is to conduct the EVMS Mock Review to simulate everything DCMA will do. DCMA also expects a thorough scrub of the schedule and cost data – data traceability and integrity is essential.
  • EVMS Compliance Review Series #3 – Using Storyboards to Depict the Entire EVMS. Do you need a refresher on the role of storyboards in a compliance review? Storyboards can make a difference in training your personnel and explaining to the DCMA personnel how your EVMS works. Storyboards can take many forms, and if you don’t have one in place, consider starting with the flow diagrams in your EVM System Description.
  • EVMS Compliance Review Series #4 – Training to Prepare for Interviews. This blog highlights the importance of conducting training for your personnel, particularly the control account managers (CAMs), so they are able to complete successful interviews with DCMA personnel. H&A recommends completing a three step training process to proactively address any issues.

Help Preparing for a Compliance Review

Do you need help preparing for a DCMA compliance or surveillance review? Download the set of DCMA Business Practices and read our updated blogs so you have an idea of what is ahead. Humphreys & Associates can help you conduct a Mock EVMS Review, perform a data quality assessment, create a storyboard, or conduct EVMS interview training and mentoring for your personnel. Call us today at (714) 685-1730 or email us.

Updates to the Compliance Review Series of Blogs Read Post »

Reviewing Authority Data Call – Not Just a Wish List

Authority Data Call

Data Call

One of the most important items needed to prepare for an Earned Value Management System (EVMS) review is the data call. This is not just a list of random data; the reviewing authorities have a defined set of data items they want to review so they can evaluate the EVMS implementation and compliance.

Required Artifacts

Over the years the reviewing authorities have fine-tuned the review process and created a very specific list of required artifacts. They use these items to pre-determine the review focus areas so they are prepared to get right to the soft spots in the system and processes.

Formal Review Notification

The process begins when the contractor receives a notification from the reviewing authority that they will conduct a formal review of a project. This could be a Compliance Review (CR); an Integrated Baseline Review (IBR); standard Surveillance; or one of many other reviews conducted to determine the implementation or continued compliance of the EVMS processes and reports. Regardless of the type of review, one of the key items is the data call request. The data call is used to request project information, and could consist of 12 reporting periods, or more, of data. This will vary by agency, type of program, and type of review. In most cases, a minimum of three months of project data will be required; typically, however, 6 to 12 months of data would be requested.

Basic Reports

Some of the basic reports requested are the Contract Performance Reports (CPRs), Integrated Program Management Reports (IPMRs), or similar time phased project performance reports produced from the earned value (EV) cost tool database. The data call request includes the detail source data from the EV cost tool as well as the Integrated Master Schedule (IMS) from the beginning of the program. This source data is often delivered electronically to a customer following the IPMR or Integrated Program Management Data and Analysis Report (IPMDAR) Data Item Description (DID) prescribed data formats. The Baseline Logs are often also requested.

Quality Data

It is essential to provide quality data in response to the Review Authority data call. The entire review process can be derailed when data call items are incomplete or inaccurate. Some of the things to consider are:

  1. Make sure the list of requested items is fully understood (some nomenclature issues could cause an issue).
  2. The data should be available in the format required in the call.
  3. Determine the best way to support the data call delivery if it is not specified in the request. The data can be provided using electronic media such as thumb drive, as attachments to emails (the size of the files may prohibit this), or possibly establishing a secure access cloud server to store the data for the reviewing authority to retrieve.
  4. Contact the requesting reviewing authority to establish a meeting to discuss the data call. This meeting should be used to resolve or clarify any issues regarding the requested information, negotiate potential equivalents of the project data if it does not exactly match the requested information, and establish a method to transmit all data files.
  5. Develop an internal plan to monitor the progress of data collection. Be sure to have non-project personnel review the data for accuracy and compliance with the specifics in the data call.
  6. Submit the data call to the requesting authority, follow-up with a phone call or meeting to verify the reviewing authority received the data, can open all the files, and agrees the complete set of data has been provided.
  7. Follow-up with another call a few weeks before the review to check if the reviewing authority has any issues or problems in evaluating and understanding the data call information. Be willing to work with them until the authority is comfortable with the data.

[NOTE: The number of items on the list depends on (1) the agency conducting the review and on (2) the type of review being conducted. The number of items requested could vary from around 30 to 100 or more.]

Typical Data Call

Some of the basic items typically requested in the data call are:

  1. Earned Value Management System Description including the matrix of the System Description and related system documentation mapped to the 32 guidelines in the EIA-748 Standard for Earned Value Management Systems as well as to the current version of the reviewing agency’s EVMS Cross Reference Checklist.
  2. EVMS related policies, processes, procedures, and desktop instructions. Examples include organizing the work, scheduling, budgeting, work authorization, details about earned value techniques and how each is applied, change control, material planning and control, subcontract management, and risk/opportunity management.
  3. Organization charts down to the Control Account Manager (CAM) level.
  4. Accounting calendar.
  5. Project directives including the Statement of Work (SOW) pertaining to Program Management or Statement of Objectives (SOO), EVM clauses, and EVM Contract Data Requirements List (CDRLs) or Subcontract Data Requirements List (SDRLs).
  6. Work Breakdown Structure (WBS) Index and Dictionary.
  7. Responsibility Assignment Matrix (RAM) including budget detail at the CAM level.
  8. Project and internal work authorization documents.
  9. Integrated Master Plan (IMP) or milestone dictionary.
  10. Contract Budget Base Log, Management Reserve Log, and Undistributed Budget Log.
  11. Risk/opportunity identification and assessments, risk/opportunity management plan.
  12. Cost performance reports (all applicable formats) or datasets. Provide the reports or dataset in the format provided to the customer such as PDF, Excel, UN/CEFACT XML, or JSON encoded data per the DID on contract such as the CPR, IPMR, or IPMDAR.
  13. Integrated Master Schedule (IMS) submissions and related native schedule file. This includes the IMS summary report if required.
  14. IMS Data Dictionary.
  15. Most recent Contract Funds Status Report (CFSR) or equivalent funding status report.
  16. Variance Analysis Reports (VARs) or equivalent progress narrative reports as well as the internal and external variance thresholds.
  17. List of subcontractors including value and type (such as cost reimbursable, firm fixed price, time and materials) including the applicable purchase orders. When EVM requirements are flowed down to the subcontractors, provide a copy of subcontractor EVM related contractual requirements (CDRLs and DIDs).
  18. Major subcontractor CPRs, IPMRs, or equivalent cost performance reports (all applicable formats) or IPMDAR datasets.
  19. Major subcontractor IMS submissions.
  20. Previous audit or surveillance findings, resulting reports, corrective action plans, and resolution and tracking Logs.
  21. List of specific software toolsets used for accounting, scheduling, cost management, resource management, risk/opportunity management, or performance analysis.
  22. EVMS Storyboard and flowcharts.
  23. Chart of accounts, including cost element definition.
  24. Staffing plans or weekly/monthly labor reports.
  25. List or copy of contract modifications.
  26. Cost Accounting Standards (CAS) disclosure statement or equivalent internal corporate procedures.
  27. Baseline Change Requests.
  28. Any other data previously provided to the customer as part of a data call.
  29. Basis of Estimates (BOE) or historical data/productivity rates and efficiency factors.
  30. Estimate to Complete (ETC) and Estimate at Completion (EAC) documentation.
  31. Budget reports or control account plans by element of cost (labor hours and dollars, material dollars, and other direct cost dollars) and associated burdens or overhead costs.
  32. Actual cost reports.
  33. Open commitment reports.
  34. Bill of material including cost detail.
  35. Quantifiable Backup Data for percent complete work packages including MRP/ERP Reports for production work packages.

Reacquaint Yourself

The list includes items that are used frequently, as well as items that are used only at specific times during the project, and will probably be less familiar to the review team. As the collection of the data call items progresses, be sure to establish quick refresher sessions on the less frequently used documents and any other items where the review team might be having difficulty. As part of the process of gathering the data call items, be sure internal reviews are conducted to verify accuracy and traceability, verify the users of the data are familiar with the data content so they can be prepared to answer questions, and current data are available to the review team.

NOTE: This Data Call List is intended for general guidance in preparation for any agency review (e.g., DCMA, DOE, FAA, etc.). For example, in the past, the DCMA Compliance Review Data Call item list contained 102 specific items, but this number varies from review to review and has changed over the years.  The number is not as important as the quality of the data items that are delivered to the review authority.

First Impressions

The data call items will provide the first look at the project’s EVM data and process for many of the review team members. The review team members will have the data several weeks prior to the on-site review. They will be performing multiple validation checks using various analytical software tools as well as hands-on analysis of the information. If the data is incomplete, contains errors, and does not trace well, the review team will form a more negative opinion of the EVMS application.

Double Check the Data Call

The data analysis results will be a basis for where attention is focused during the on-site review, as it emphasizes areas that contain anomalies or indicates a lack of system integrity. Significant emphasis should be devoted to the data call items to ensure accuracy and compliance with the review authority’s requests, as it is a very positive way to begin the data call review.

A Humphreys & Associates EVM specialist is always available to answer questions. Give us a call or send an email.

Reviewing Authority Data Call – Not Just a Wish List Read Post »

Exact or Accounting Dates For Baseline Planning & Forecasting to Estimates to Complete – A Survey

Exact or Accounting for Baseline ReviewThe EVMS Guidelines, and other guidance, are not specific as to whether exact dates must be used to demonstrate system integration between the Work Authorization Document (WAD), Integrated Master Schedule (IMS) and Control Account Plan (CAP), or whether the use of accounting month start and complete dates meets the spirit and intent of the EIA-748 requirement.

To determine the industry trend, a survey was conducted regarding which dates contractors are using in the authorization, schedule and cost systems.

Background 

Some organizations view the Work Authorization Document (WAD) as the most important EVMS related document in their business management system because it is absolute proof that technical/schedule/cost information comes together in one place. For that reason exact dates are placed on WADs so that charge numbers are not opened before their schedule requires them to be open.

Other organizations are not so precise. They merely enter the first day of the accounting month that an effort is scheduled to commence. Some customer review teams insist on exact dates or they cite noncompliance with EIA-748. Survey participants were asked which dates, exact or accounting month start and complete, are entered in the cost, schedule and work authorization documents to demonstrate system integration. Participants were also asked about exact dates versus accounting month dates for Estimates to Complete (ETC) forecasts, and whether Level of Effort (LOE) tasks were planned in the schedule to obtain full resource loading of their projects.

Results

Fifteen (15) contractors responded to the survey and the results are displayed in the table below.  For all 15, the IMS was populated with exact dates for the baseline and current forecast.

  • Eleven (11) contractors used exact dates in the WADs and cost tool baselines and forecasts, thus matching the IMS.
  • Three (3) contractors consistently used the accounting month start and complete dates for the WAD baseline and cost tool baseline and forecast dates.
  • One contractor (Contractor 4) populated the WADs with accounting month dates while exact dates were used in the schedule and cost tools.  This contractor indicated that the WADs are being changed to reflect exact actual dates to match the IMS and cost tool and that this was a resource consuming endeavor.

 Baseline Planning & Forecasting to Estimates to Complete

Conclusion

From comments received, the contractors surveyed which use exact dates believe doing so was necessary to demonstrate cost and schedule integration.  They also indicated that increased sophistication of cost and schedule tools has made using exact dates much easier than it may have been in the past.  Because most of the tools used are able to accommodate exact date integration, it is now recommended that wherever possible, those dates be used in the work authorization, schedule and cost systems.

It is also recommended that changing the WAD dates based on actual start and completion dates is not a logical use of resources in that the schedule and cost tools capture actual performance and the WAD is generally a document that represents the baseline.

For more information about utilizing exact or accounting dates for baseline planning and forecasting to ETC for your projects, call Humphrey’s & Associates today.

Humphreys & Associates 35+ years in the EVM community

Exact or Accounting Dates For Baseline Planning & Forecasting to Estimates to Complete – A Survey Read Post »

EVMS Compliance Review Series #4 – Training to Prepare for Interviews

, ,

Updated November 10, 2017
Updated December 15, 2020

DCMA Compliance Review Series

This is the fourth topic in a series discussing the DCMA Compliance Review (CR) process. It is the second update to the original series #4 Blog that was based on the instruction book from the DCMA Website that identified the “DCMA 16 Step (and then their 8-Step [UPDATE #2]) EVMS Compliance Review Process.” This change was documented in the DCMA “Earned Value Management System Compliance Reviews Instruction (DCMA-INST 208).” This Instruction has been rescinded and replaced with a set of DCMA Business Practices (BP). These Business Practices split out topics the old DCMA Instruction 208 covered in one document. Whether you are a contractor new to the EVM contracting environment or a seasoned veteran, if the Earned Value Management System (EVMS) compliance and acceptance authority is the Defense Contract Management Agency (DCMA), these new Business Practices apply to you.

This is a continuing discussion about the interviews that are part of the optional contractor self-assessments and as part of conducting any Compliance Review, Surveillance Review, or Review for Cause (RFC). The DCMA uses a standard set of interview forms for the control account managers (CAMs), project managers, integrated product team (IPT) leads, risk managers, business managers, and accounting. Contractors should use similar interview questionnaires to simulate the DCMA interview process as closely as possible to prepare the CAMs and others for the DCMA interviews.

CAM Interviews are Critical

While it is important to have successful interviews with everyone, the CAM interviews are critical. The CAMs are the primary interview subjects during a compliance review. The CAMs must be able to demonstrate they have a full understanding of their scope of work and show how they use the company’s EVMS artifacts to manage their work on a day-to-day basis, in addition to the normal weekly or monthly business rhythm. The CAMs need to have a good understanding of their role to provide acceptable responses to interview questions and to be comfortable with the interview process.

CAMs must be able to demonstrate a working knowledge of:

  • EVM,
  • The 32 guidelines in the EIA-748 Standard for Earned Value Management Systems,
  • The company’s EVMS,
  • How to perform the applicable data traces for their scope of work, and
  • How they fit into the grand scheme of the project.

The CAMs must also have a level of proficiency with the project control toolsets. Many companies use electronic CAM notebooks integrated into the EVMS Storyboard to assist the CAMs.

Three-Step Training for CAMs

Conducting training for the CAMs is an important preparation step. Based on our long history of successfully preparing CAMs, project managers, and others for compliance reviews, Integrated Baseline Reviews (IBRs), or surveillance reviews, we suggest a three-step training process for the CAMs.

Set Expectaions

Step 1. Conduct training sessions for the CAMs on what is expected during a DCMA interview. This training can include conducting an example group interview the CAMs and others can observe. The group interview session typically includes an open discussion at the end to critique the interview process.

  • What were the good techniques?
  • What could be improved?
  • What are some things to avoid?

This helps to set expectations and provides a preparation guide for the people to be interviewed.

White Hat Interview

Step 2. Conduct “white hat” interview sessions with the CAMs. These are more one-on-one mentoring sessions to help the CAMs through the interview process. Providing feedback at the end of each session reinforces the learning process and increases their level of proficiency. This dry run helps the CAMs to feel more comfortable with the interview process. It also helps to increase their confidence level and ability to think on their feet.

Black Hat Interview

Step 3. Conduct “black hat” interview sessions with the CAMs. For these sessions, the interviewers conduct the interview as if they were members of the DCMA review team. If the CAM is unable to undergo a thorough interview, the session evolves into a mentoring session to help them through the process. The “black hat” interview sessions should continue until each CAM is comfortable with the interview process.

Identify Deficiencies

A summary of the findings from the interviews can help a company to be proactive in addressing known issues. The goal is to identify any deficiencies whether in the EVMS design, implementation, end-user knowledge, or data quality. Deficiencies can be reported in self-assessment Discrepancy Report (DR) forms along with the corrective action plans that will be implemented to resolve the issue.

It is far better for the company to find and address any issues as part of the internal self-assessment process than to have DCMA find them during the formal Compliance Review. This can make a difference in whether or not DCMA issues Corrective Action Requests (CARs) or recommends moving to the next step in the compliance review process.

Contact H&A to help train your Control Account Manager (CAM) with one-on-one mentoring, conducting mock review interviews, or as part of preparing for an Integrated Baseline Review (IBR). We can be reached at (714) 685-1730 or email us.


EVMS Compliance Review Series


EVMS Compliance Review Series #4 – Training to Prepare for Interviews Read Post »

Scroll to Top