Book Review: Superforecasting by Philip E. Tetlock and Dan Gardner

Benjamin Franklin on a $100 bill

Most experts are terrible at predicting the future — and the most confident are the worst of all. Superforecasting (2015) is Philip Tetlock and Dan Gardner’s account of a decade-long experiment that found the exceptions: ordinary people who consistently beat CIA analysts at forecasting world events, and the habits of mind that make them so good. For investors, whose entire game is betting on an uncertain future, it is essential reading.

Book Summary

The story begins with Tetlock’s earlier, humbling finding: in a twenty-year study of expert political predictions, the average expert barely beat dart-throwing chance, and the most famous experts did worst of all. Then came the second act. From 2011 to 2015, the U.S. intelligence community’s IARPA ran the Good Judgment Project — a forecasting tournament open to volunteers — and Tetlock’s team of amateurs crushed the competition, eventually outperforming professional intelligence analysts with access to classified information by roughly 30 percent.

The standouts were dubbed “superforecasters,” and Superforecasting distills what they do differently. They break big questions into smaller ones (Fermi-izing). They start from base rates — the outside view — before considering specifics. They update their beliefs in small, frequent Bayesian steps as evidence arrives, treating a forecast as a living probability rather than a position to defend. They keep score, seek out disconfirming evidence, and learn from mistakes without ego. And they think in shades of maybe: the best forecasters rarely say 100% or 0%.

Tetlock’s famous fox-versus-hedgehog distinction — borrowed from Isaiah Berlin — runs through the book: hedgehogs know one big thing and force the world into it; foxes know many small things and adapt. The superforecasters are foxes. Superforecasting is optimistic where Tetlock’s earlier work was bleak: judgment about the future is not fixed; it is a skill, and it can be trained.

Buy Superforecasting on Amazon

Who are Philip E. Tetlock and Dan Gardner?

Philip E. Tetlock is a psychologist and professor at the University of Pennsylvania’s Wharton School whose life’s work is the study of expert judgment — how good it is, why it fails, and whether it can improve. His 2005 book Expert Political Judgment delivered the bad news about experts; Superforecasting delivers the good news about everyone else. Dan Gardner is a Canadian journalist and author of Risk and Future Babble, whose reporting gives the research its narrative drive.

Together they make a case that should unsettle anyone who pays for predictions: the forecasting skill that matters is not domain expertise or confidence — it is a set of learnable habits. Tetlock went on to co-found the Good Judgment Project’s commercial successor and remains the central figure in the science of prediction.

Lessons From Superforecasting

Start with the base rate. Before asking “will this stock double?”, ask “how often do stocks like this double?” The outside view is the investor’s cheapest edge: most forecasts fail because they overweight the vivid specifics of the case and ignore the boring statistics of the category. Daniel Kahneman’s Thinking, Fast and Slow makes the same point from the psychology side; Tetlock shows it working in practice.

Update in small steps, and keep score. Superforecasters revise probabilities constantly — 60% becomes 65%, then 58% — without treating a revision as an admission of failure. Investors should do the same: a thesis is a probability, not an identity. And score your predictions. Nassim Taleb’s Fooled by Randomness warns that without a record, you will remember your wins and forget your losses; Tetlock shows that with a record, you actually improve.

Be a fox, not a hedgehog. The market punishes hedgehogs — the perma-bulls, the gold bugs, the one-big-idea investors — because reality keeps refusing to fit the theory. Foxes survive: they hold many small models, borrow across disciplines, and change their minds when the evidence changes. Diversification of models matters as much as diversification of assets.

Distrust confidence, including your own. The book’s most robust finding is the inverse relationship between confidence and accuracy among pundits. When an analyst is certain, be skeptical; when you are certain, be more skeptical. Calibrated uncertainty — “I’m 65% on this” — beats false precision every time.

Buy Superforecasting on Amazon

Criticisms of the Book

Superforecasting studies short-horizon geopolitical questions — will oil prices exceed a level by March? — and skeptics note that markets are a different beast: adversarial, reflexive, and priced by participants who read the same research. Some also argue the book undersells how much of forecasting success is selection — finding the talented — versus training. And the habits, while learnable, are genuinely hard: updating beliefs without ego is easy to describe and brutal to practice.

Who is This Book For?

For every investor who has ever made a prediction — which is every investor. Superforecasting is the practical manual for the probabilistic thinking that investing demands: base rates, Bayesian updating, calibrated confidence, scorekeeping. If behavioral finance taught you what goes wrong in your head, this book teaches you what to do instead.

Final Thoughts

The future is uncertain, but uncertainty is not the same as helplessness. Superforecasting proves that judgment improves with the right habits — and that the habits are available to anyone willing to be humble, numerate, and honest about being wrong. In a market full of confident hedgehogs selling certainty, the quiet fox with a spreadsheet and a scorecard has a genuine, durable edge.

Buy Superforecasting on Amazon