The Spin Stops Here!
Decision-Making Under Severe Uncertainty  
Faqs | Help | @ | Contact | home  
voodoostan info-gap decision theory info-gap economics severe uncertainty mighty maximin robust decisions responsible decisions


Reviews of publications on Info-Gap decision theory

Last modified:

On this page I comment on publications dealing with Info-Gap decision theory. Although this commentary is intended primarily for the benefit of the authors and reviewers of these publications, it clearly lends support to and justifies the rationale behind my Info-Gap Campaign.

Requests for reviews of Info-Gap publications that are not currently on the list will be considered.

  Latest News  
       
Moshe's new book!

Table of contents:

New Arrivals

The following is a list of new info-gap publications. If you want to be on the list, send me the details of your info-gap publication.

Isn't it amazing that the flow of info-gap publications continues?

Let me know of any other publications that should be on this list.

Reviews

  1. Ben-Haim (2001, 2006): Info-Gap Decision Theory: decisions under severe uncertainty.

  2. Regan et al (2005): Robust decision-making under severe uncertainty for conservation management.

  3. Moilanen et al (2006): Planning for robust reserve networks using uncertainty analysis.

  4. Burgman (2008): Shakespeare, Wald and decision making under severe uncertainty.

  5. Ben-Haim and Demertzis (2008): Confidence in monetary policy.

  6. Hall and Harvey (2009): Decision making under severe uncertainty for flood risk management: a case study of info-gap robustness analysis.

  7. Ben-Haim (2009): Info-gap forecasting and the advantage of sub-optimal models.

  8. Yokomizo et al (2009): Managing the impact of invasive species: the value of knowing the density-impact curve.

  9. Davidovitch et al (2009): Info-gap theory and robust design of surveillance for invasive species: The case study of Barrow Island.

  10. Ben-Haim et al (2009): Do we know how to set decision thresholds for diabetes?

  11. Beresford and Thompson (2009): An info-gap approach to managing portfolios of assets with uncertain returns.

  12. Ben-Haim, Dacso, Carrasco, and Rajan (2009): Heterogeneous uncertainties in cholesterol management.

  13. Rout, Thompson, and McCarthy (2009): Robust decisions for declaring eradication of invasive species.

  14. Ben-Haim (2010): Info-Gap Economics: An Operational Introduction.

  15. Hine and Hall (2010): Information gap analysis of flood model uncertainties and regional frequency analysis.

  16. Ben-Haim (2010): Interpreting Null Results from Measurements with Uncertain Correlations: An Info-Gap Approach

  17. Wintle et al. (2010): Allocating monitoring effort in the face of unknown unknowns

  18. Moffitt et al. (2010): Securing the Border from Invasives: Robust Inspections under Severe Uncertainty

  19. Yemshanov et al. (2010): Robustness of Risk Maps and Survey Networks to Knowledge Gaps About a New Invasive Pest

  20. Davidovitch and Ben-Haim (2010): Robust satisficing voting: why are uncertain voters biased towards sincerity?

  21. Schwartz et al. (2010): What Makes a Good Decision? Robust Satisficing as a Normative Standard of Rational Decision Making

  22. Arkadeb Ghosal et al. (2010): Computing Robustness of FlexRay Schedules to Uncertainties in Design Parameters

  23. Hemez et al. (2002): Info-gap robustness for the correlation of tests and simulations of a non-linear transient

  24. Hemez et al. (2003): Applying information-gap reasoning to the predictive accuracy assessment of transient dynamics simulations

  25. Hemez, F.M. and Ben-Haim, Y. (2004): Info-gap robustness for the correlation of tests and simulations of a non-linear transient

  26. Ben-Haim, Y. (2007): Frequently asked questions about info-gap decision theory

  27. Sprenger, J. (2011): The Precautionary Approach and the Role of Scientists in Environmental Decision-Making

  28. Sprenger, J. (2011): Precaution with the Precautionary Principle: How does it help in making decisions

  29. Hall et al. (2011) : Robust climate policies under uncertainty: A comparison of Info-­‐Gap and RDM methods

  30. Ben-Haim and Cogan (2011) : Linear bounds on an uncertain non-linear oscillator: an info-gap approach

  31. Van der Burg and Tyre (2011) : Integrating info-gap decision theory with robust population management: a case study using the Mountain Plover

  32. Hildebrandt and Knoke (2011) : Investment decisions under uncertainty --- A methodological review on forest science studies.

  33. Wintle et al. (2011) : Ecological–economic optimization of biodiversity conservation under climate change.

  34. Ranger et al. (2010) : Adaptation in the UK: a decision-making process.

I shall expand the list as required as this project progresses. If you can't wait, send me a note about your very special Reader-type.

Let me know of any articles/books that you think should appear on this list.

In addition to a brief commentary on the Info-Gap content of the publications, I also provide TUIGF, SNHNSNDN and GIGO scores (%) (see below).

Overview

Over the past two years I have been asked, on several occasions, the following intriguing question:

Given that the flaws in Info-Gap decision theory are so obvious and grave, how do you explain the large number of publications on Info-Gap, particularly the significant number of articles published by refereed journals?

My usual answer to this question is as follows:

I'll be happy to discuss this matter with you over a cup of coffee (skinny latte, please!)

I do not plan to deviate from this answer here.

However, I believe that the reviews that I provide here will give you a good idea of what I may tell you over a cup of coffee so, try to read between the lines. And, for a fuller appreciation of one of the central points that I am making in this collection of reviews, read the discussion on fog, spin and rhetoric. Because, as you will see, whatever Info-Gap decision theory lacks in substance and rigor, is made up for, and covered up, by heavy fog, spin, and rhetoric.

I use the acronym TUIGF as shorthand for "The usual Info-Gap flaws". These flaws are discussed in detail in my compilation of FAQs about Info-Gap so there is no need to elaborate on them in these reviews. On the other hand, they will be used as benchmarks.

I also use the acronym SNHNSNDN as shorthand for "see nothing, hear nothing, say nothing, do nothing". This refers to authors who, for various reasons, choose to ignore my criticism of Info-Gap decision theory, particularly my theorems proving that Info-Gap's robustness model is a Maximin model (circa 1940) and Info-Gap's opportuneness model is a Minimin model (circa 1952). For your convenience and enjoyment these beauties are displayed at the bottom of the page.

So, recall that Info-Gap's two main fundamental flaws are:

The question therefore arises: how is it that so many Info-Gap papers have been published in refereed journals? Surely, the flaws are so obvious that any referee with a basic knowledge of decision-making under severe uncertainty should have been able to identify them.

Indeed, even more basic is the point that Info-Gap scholars who should know better continue to publish Info-Gap papers, repeating the same unsubstantiated claims, again and again and again.

The objective of my reviews is to show these publications for what they are.

Selection criteria

I do not have strict criteria for the selection of papers for review. For obvious reasons I prefer the more recent papers that were published in refereed journals. But I shall consider other papers, including working papers -- if they shed new light on on the failings of Info-Gap decision theory and its applications.

So the plan is to start with recently (2009) published papers, especially papers that attempt to deal with my criticism.

If you have come across a publication that you think ought to be reviewed, please send me a copy of it and I shall have a look at it to see if it is suitable for this project.

How to read the reviews

I realize that the potential readership of my reviews may be diverse with various interests and degrees of knowledge of decision theory in general and Info-Gap decision theory in particular.

My aim is to address my reviews, in the first instance, to the authors of the articles, the referees who reviewed them, the editors of the journals who accepted the papers for publication, and the bodies that provided the funds to support the work on which the articles are based. So, please read the reviews with this point in mind.

Any assessment of Info-Gap's contribution to the state of the art in decision theory must be made against these claims by Ben-Haim (2001, 2006) — the Father of Info-Gap:

Info-gap decision theory is radically different from all current theories of decision under uncertainty. The difference originates in the modeling of uncertainty as an information gap rather than as a probability. The need for info-gap modeling and management of uncertainty arises in dealing with severe lack of information and highly unstructured uncertainty.

Ben-Haim (2006, p. xii)

and
In this book we concentrate on the fairly new concept of information-gap uncertainty, whose differences from more classical approaches to uncertainty are real and deep. Despite the power of classical decision theories, in many areas such as engineering, economics, management, medicine and public policy, a need has arisen for a different format for decisions based on severely uncertain evidence.

Ben-Haim (2006, p. 11)

So my reviews address primarily the following two questions:

As indicated above, the fact of the matter is that Info-Gap decision theory fails on both counts. So, it should come as no surprise that my criticism of Info-Gap decision theory is very harsh indeed.

The following mini-guide may be useful to some readers.

Reader type Tips
Author Please, read the relevant FAQs cited in my reviews before you send me an angry letter. I'd be most happy to discuss your paper with you.
Referee If you were not vigilant enough, or not sufficiently au fait with the literature on decision-making under severe uncertainty, make sure that next time you are better prepared before you proceed to referee an Info-Gap paper. In any event, take note that Info-Gap's fundamental flaws cannot be smoothed over by fancy rhetoric.
Editor Make sure that you send Info-Gap papers to qualified referees. Please, do not send me Info-Gap papers for review.
Info-Gap aficionado Relax! You can ignore my criticism. This is in fact what Info-Gap scholars -- with some exceptions -- have done so far.
Inactive Info-Gap Critic Wake up! Join my campaign.
PhD Student Indeed, not everything that gets published in refereed journals is "correct". Also, PhD supervisors are not always well-versed in the subject matter and can fall victim to the adverse effects of spin and rhetoric. Therefore, study carefully the claims that are made in the Info-Gap literature.
Grantor of research funds Read carefully the research proposals. If a proposal is too good to be true, then rest assured that it is. In the case of decision-making under severe uncertainty, watch out for voodoo decision theories that are in violations of the GIGO Axiom, but are dressed up by spin.
Accidental tourist It would be a good idea to read the first 20 items in FAQs about Info-Gap decision theory before reading the reviews.

Welcome to Factland

This contribution is dedicated to the Info-Gap people at Wikipedia. They were searching for a formal proof that ....

 

Fact 1: Info-Gap is a simple instance of Wald's Maximin model [1945].


 

Fact 2: Info-Gap does not deal with severe uncertainty: it simply ignores it.


Recent Articles, Working Papers, Notes

Also, see my complete list of articles
    Moshe's new book!
  • Sniedovich, M. (2012) Fooled by local robustness, Risk Analysis, in press.

  • Sniedovich, M. (2012) Black swans, new Nostradamuses, voodoo decision theories and the science of decision-making in the face of severe uncertainty, International Transactions in Operational Research, in press.

  • Sniedovich, M. (2011) A classic decision theoretic perspective on worst-case analysis, Applications of Mathematics, 56(5), 499-509.

  • Sniedovich, M. (2011) Dynamic programming: introductory concepts, in Wiley Encyclopedia of Operations Research and Management Science (EORMS), Wiley.

  • Caserta, M., Voss, S., Sniedovich, M. (2011) Applying the corridor method to a blocks relocation problem, OR Spectrum, 33(4), 815-929, 2011.

  • Sniedovich, M. (2011) Dynamic Programming: Foundations and Principles, Second Edition, Taylor & Francis.

  • Sniedovich, M. (2010) A bird's view of Info-Gap decision theory, Journal of Risk Finance, 11(3), 268-283.

  • Sniedovich M. (2009) Modeling of robustness against severe uncertainty, pp. 33- 42, Proceedings of the 10th International Symposium on Operational Research, SOR'09, Nova Gorica, Slovenia, September 23-25, 2009.

  • Sniedovich M. (2009) A Critique of Info-Gap Robustness Model. In: Martorell et al. (eds), Safety, Reliability and Risk Analysis: Theory, Methods and Applications, pp. 2071-2079, Taylor and Francis Group, London.
  • .
  • Sniedovich M. (2009) A Classical Decision Theoretic Perspective on Worst-Case Analysis, Working Paper No. MS-03-09, Department of Mathematics and Statistics, The University of Melbourne.(PDF File)

  • Caserta, M., Voss, S., Sniedovich, M. (2008) The corridor method - A general solution concept with application to the blocks relocation problem. In: A. Bruzzone, F. Longo, Y. Merkuriev, G. Mirabelli and M.A. Piera (eds.), 11th International Workshop on Harbour, Maritime and Multimodal Logistics Modeling and Simulation, DIPTEM, Genova, 89-94.

  • Sniedovich, M. (2008) FAQS about Info-Gap Decision Theory, Working Paper No. MS-12-08, Department of Mathematics and Statistics, The University of Melbourne, (PDF File)

  • Sniedovich, M. (2008) A Call for the Reassessment of the Use and Promotion of Info-Gap Decision Theory in Australia (PDF File)

  • Sniedovich, M. (2008) Info-Gap decision theory and the small applied world of environmental decision-making, Working Paper No. MS-11-08
    This is a response to comments made by Mark Burgman on my criticism of Info-Gap (PDF file )

  • Sniedovich, M. (2008) A call for the reassessment of Info-Gap decision theory, Decision Point, 24, 10.

  • Sniedovich, M. (2008) From Shakespeare to Wald: modeling wors-case analysis in the face of severe uncertainty, Decision Point, 22, 8-9.

  • Sniedovich, M. (2008) Wald's Maximin model: a treasure in disguise!, Journal of Risk Finance, 9(3), 287-291.

  • Sniedovich, M. (2008) Anatomy of a Misguided Maximin formulation of Info-Gap's Robustness Model (PDF File)
    In this paper I explain, again, the misconceptions that Info-Gap proponents seem to have regarding the relationship between Info-Gap's robustness model and Wald's Maximin model.

  • Sniedovich. M. (2008) The Mighty Maximin! (PDF File)
    This paper is dedicated to the modeling aspects of Maximin and robust optimization.

  • Sniedovich, M. (2007) The art and science of modeling decision-making under severe uncertainty, Decision Making in Manufacturing and Services, 1-2, 111-136. (PDF File) .

  • Sniedovich, M. (2007) Crystal-Clear Answers to Two FAQs about Info-Gap (PDF File)
    In this paper I examine the two fundamental flaws in Info-Gap decision theory, and the flawed attempts to shrug off my criticism of Info-Gap decision theory.

  • My reply (PDF File) to Ben-Haim's response to one of my papers. (April 22, 2007)

    This is an exciting development!

    • Ben-Haim's response confirms my assessment of Info-Gap. It is clear that Info-Gap is fundamentally flawed and therefore unsuitable for decision-making under severe uncertainty.

    • Ben-Haim is not familiar with the fundamental concept point estimate. He does not realize that a function can be a point estimate of another function.

      So when you read my papers make sure that you do not misinterpret the notion point estimate. The phrase "A is a point estimate of B" simply means that A is an element of the same topological space that B belongs to. Thus, if B is say a probability density function and A is a point estimate of B, then A is a probability density function belonging to the same (assumed) set (family) of probability density functions.

      Ben-Haim mistakenly assumes that a point estimate is a point in a Euclidean space and therefore a point estimate cannot be say a function. This is incredible!


  • A formal proof that Info-Gap is Wald's Maximin Principle in disguise. (December 31, 2006)
    This is a very short article entitled Eureka! Info-Gap is Worst Case (maximin) in Disguise! (PDF File)
    It shows that Info-Gap is not a new theory but rather a simple instance of Wald's famous Maximin Principle dating back to 1945, which in turn goes back to von Neumann's work on Maximin problems in the context of Game Theory (1928).

  • A proof that Info-Gap's uncertainty model is fundamentally flawed. (December 31, 2006)
    This is a very short article entitled The Fundamental Flaw in Info-Gap's Uncertainty Model (PDF File) .
    It shows that because Info-Gap deploys a single point estimate under severe uncertainty, there is no reason to believe that the solutions it generates are likely to be robust.

  • A math-free explanation of the flaw in Info-Gap. ( December 31, 2006)
    This is a very short article entitled The GAP in Info-Gap (PDF File) .
    It is a math-free version of the paper above. Read it if you are allergic to math.

  • A long essay entitled What's Wrong with Info-Gap? An Operations Research Perspective (PDF File) (December 31, 2006).
    This is a paper that I presented at the ASOR Recent Advances in Operations Research (PDF File) mini-conference (December 1, 2006, Melbourne, Australia).

Recent Lectures, Seminars, Presentations

If your organization is promoting Info-Gap, I suggest that you invite me for a seminar at your place. I promise to deliver a lively, informative, entertaining and convincing presentation explaining why it is not a good idea to use — let alone promote — Info-Gap as a decision-making tool.

Here is a list of relevant lectures/seminars on this topic that I gave in the last two years.


Disclaimer: This page, its contents and style, are the responsibility of the author (Moshe Sniedovich) and do not represent the views, policies or opinions of the organizations he is associated/affiliated with.


Last modified: