Monday 12 November 2018

W10_PieroAnticona_Monitoring and Managing Contingency in Public Project Estimates

1)    Step 1- Problem or Opportunity Statement
As most of the point estimates in projects will become accurate in time, it is necessary to assess with certain frequency if risk or opportunities remain after accomplishing certain milestones or a certain period of time passed. By consequence, Contingency should be always assessed to determine if we still need more or less money for certain risk or opportunities identified and tactical or strategical responses will perform accordingly.  
For Public Projects, Contingency is not allowed and based on the last post (W9_Piero_Anticona_Strategic/Tactical Response for Risk/Opportunities in Public Point Estimates), we can hide or create a buffer to add contingency in the point estimates. 
For that reason, we also require to analyze which best practice suggest a good tracking tool or technique for the Buffer and Contingency alternative if we expect to meet Public Projects objectives.
What are best practices for Monitoring Risk that can help to implement the best tool or technique to track and control Contingency in Public Project Point Estimates?

2)    Step 2 – Feasible Alternatives
Most common best practices are:
1.    Project Management Body of Knowledge (PMBOK) from Project Management Institute
2.    Total Cost Management Framework (TCM) from AACE International
We are going to add:
3.    Compendium and Reference (CaR) from Guild of Project Controls

As seen in post  W9_ Piero_Anticona_Strategic/Tactical Response for Risk/Opportunities in Public Point Estimates, the three of them offer Risk Management Process Maps. See maps below:

1.    PMBOK – PMI

PMBOK Risk Management Process


2.    TCM – AACE International

TCM Risk Management Process


3.    Guild of Project Controls

Guild of Project Controls Risk Management Process

3)    Step 3- Develop the outcomes for each alternative
The following tools and techniques are part of the monitoring risk process in the three best practices mentioned before:

Tools and Techniques for Risk Control


As we can see, TCM only suggests one tool for a similar process. If we look closer at its Risk Management Process, there is an Analysis of Contingency as an output of Risk Control Process that belongs to the Risk Assessment Process. Besides, it is part of the Risk Management Process, therefore we can consider this tool in this list because a similar tool is included in PMBOK. We can see a definition of the similar tool for both best practices:

Definition of Reserve Analysis and Analyze Contingency


 Let’s see the final list to be assessed:

Final List of Tools and Techniques for Risk Control


For an effective analyze, we are going to merge those tools or techniques that are similar in two or three groups. The main reason is that as they are similar, results will be the same in both or three groups. So, it will not produce a differentiator between them which might not add value to the analysis. We can compare this merged tools against other tools.
Therefore, we only are going to analyze the following list:

1
PMBOK – Technical Performance Analysis
PMBOK- TPA
2
PMBOK/GPC – Analyze Reserve / Contingency
PMBOK/GPC – A R/C
3
PMBOK - Audits
PMBOK – Aud
4
PMBOK/GPC - Meetings
PMBOK/GPC – M
5
GPC – Statistical Process Control Chart
GPC – SPCC
6
GPC – Pareto Analysis
GPC – PA
7
GPC – Process Capability Analysis
GPC – PCA
8
GPC – Accuracy vs Precision vs Reliable Data
GPC – A/P/R
9
GPC – Contingency Draw Down Graphs
GPC - CDDG


4)    Step 4- Selection of the acceptable criteria.
The following attributes will be considered for the selection criteria:
-       Mandatory to Quantify impacts when event occcurs
-       Mandatory to Create Tendency Charts
-       Can analyze accuracy against baseline
-       Can analyze precision against baseline

-       Can analyze reliability against baseline

5)    Step 5- Compare the outcomes from each alternative analysis done in Step 3 against the minimum acceptable criteria from Step 4.

Using Multiattribute Decision Making, we will analyze as follows:
           
Non Compensatory Models

1.    Dominance

Dominance Matrix
Conclusion
The Tools and Techniques that meet most the acceptable criteria are GPC - Accuracy vs Precision vs Reliable Data and GPC - Contingency Draw Down

2.    Satisfacing

Satisfacing Analysis
Conclusion
The Tools and Techniques that satisfy minimum acceptable criteria are GPC - Accuracy vs Precision vs Reliable Data and GPC - Contingency Draw Down. As the others do not meet minimum acceptable criteria, they can be discarded.

3.    Lexicography

Lexicography Analysis

Conclusion
GPC – A/P/R  and  GPC - CDDG meet acceptable criteria

Compensatory Models
1.    Non Dimensional Escaling

Non Dimensional Analysis

Conclusion
Best choices are GPC – A/P/R  and  GPC - CDDG

2.    The additive weighting technique

The Additive Weighting Technique Analysis


Conclusion
The best choices are GPC – A/P/R  and  GPC - CDDG

6)    Step 6- Selection of the “best”.
One of the main reasons that we want to monitor Buffer or Buried Contingency is because we want to meet Point Estimates and avoid cost overruns. For that reason, the best choices that meet all of the attribute criteria are GPC – Accuracy, Precision and Reliability and GPC Contingency Draw Down Graphs in the previous step. 5 positive results out of 5.
With these tools it is possible to Manage Contingency also in Public Projects.

7)    Step 7- How to plan on tracking/reporting on the recommended choice. 

Assuming that we are working on a Public Project and contingency is hidden or in a buffer, based on author experience a good way to determine if tools are supporting correctly Management Contingency is through Change Management Process. A short list of Change Orders should be submitted or a short list of Change Orders might be produced to request transfer budgets between accounts.


----------

8)    REFERENCES.
H. Lance Stephenson. (2015). Total cost management framework: An Integrated Approach to Portfolio, Program, and Project Management (2nd Ed.). Morgantown, WV: AACE International. Pages 206 - 209.
Guild of Project Controls. (2016, January 05). 04.6 risk_opportunity_monitoring_and_control-_rev1.00. Retrieved September 15, 2018, from http://www.planningplanet.com/guild/gpccar/risk_opportunity_responses_strategies_and_tactics
A Guide to the Project Management Body of Knowledge (PMBOK® Guide), 6th ed. Newton Square, Pa: Project Management Institute, Inc. 2017. Pages 453 - 458

Sullivan, W. G., Wicks, E. M., & Koelling, C. P. (2012). Decision making Considering Multiattributes. In Engineering Economy (15th ed.). Harlow, England: Pearson Education Limited.
Anticona, P. (2018, November 3). W8.1 Sensitivity Analysis and Contingency. Distance Learning Mode with PDG - 2018 / 2019 [Web log post]. Retrieved from https://pieroanticona-projectcontrol.blogspot.com

Anticona, P. (2018, November 9). W9_Piero_Anticona_Strategic/Tactical Response for Risk/Opportunities in Public Point Estimates. Distance Learning Mode with PDG - 2018 / 2019 [Web log post]. Retrieved from https://pieroanticona-projectcontrol.blogspot.com

5 comments:

  1. Very well done comparison but I want to focus on your opening statement that "As most of the point estimates in projects will become accurate in time". Where did you get this from? Based on several papers written by previous students, https://pmworldjournal.net/wp-content/uploads/2014/09/pmwj26-sep2014-Al-Awaid-Oman-oil-and-gas-cost-estimating-FeaturedPaper2.pdf and https://pmworldjournal.net/wp-content/uploads/2017/11/pmwj64-Nov2017-Ardiansyah-indonesian-cost-estimating-against-gao-and-nps-best-practices.pdf would indicate that based on the analysis shown here http://www.planningplanet.com/guild/gpccar/assessing-interpreting-progress-data Figure 9, that the estimate was not precise therefore it is neither accurate or reliable (Condition 2) or that the original estimate was PRECISE (Condition 4) which makes it ACCURATE only if the cost estimaing model is adjusted or factored to compensate for the over or under estimating.

    Both papers support the arguments for adopting the phase gate approach and including updated cost estimates and a core element in each of the Decision Support Packages to move from one Phase Gate to the next, with the objective of having the final estimate fall within +/-5% of the final approved for execution estimate.

    Other than these comments, the analysis itself was well done and is accepted as submitted. What you may want to consider if you have access to the data would be to write one of your Fellow papers using the same approach used by Musallam or Ardyansiah as the basis to analyze and evaluate how effective your cost estimating system is?

    BR
    Dr. PDG, Jakarta

    ReplyDelete
    Replies
    1. The statement came from Flyvbjerg. Estimates are different in different time points. It becomes accurate to the real true cost the closer to the final delivery investment is. (Five things you should know about cost overrun, Page 2. https://www.researchgate.net/publication/327751062_Five_things_you_should_know_about_cost_overrun).
      Maybe I was not precise on my statement. True cost will reveal with time and real true cost estimates will be more accurate to this real true cost.
      I will review those paper you mention and see if I can use that approach.
      BR
      Piero

      Delete
  2. OK, I know Flyvbjerg and I see eye to eye on almost all points. I think it was just how your phrased it. The key to remember is that cost estimates are not a one time responsibility. That at each phase gate, the cost estimate need to be updated by the cost engineer/cost estimator and then AFTER execution starts, then it becomes the project controller's responsibility under module 9.5, to do the forecasting.

    IF you can get access to at least 10 sets of both cost and duration data you can produce a very interesting and valuable paper along the lines of the two examples I showed you.

    BR,
    Dr. PDG

    ReplyDelete
    Replies
    1. I am not sure if I can get that information. We'll see.
      BR
      Piero

      Delete
  3. THANKS FOR SHARING SUCH A AMAZING WORK
    NICE WORK
    BIM Implementation UK

    ReplyDelete

W20_Dashboard with Business Intelligence 3

1)      Step 1- Problem or Opportunity Statement A BI dashboard is a tool that transforms information and displays Key Performance Indi...