Members get a snapshot view of new Long Now content with easy access to all their member benefits.
Published quarterly, the member newsletter gives in-depth and behind the scenes updates on Long Now's projects.
Special updates on the 10,000 Year Clock project are posted on the members only Clock Blog.
Filmed on Friday January 26, 02007
Philip Tetlock is author of Superforecasting: The Art and Science of Prediction and Expert Political Judgment: How Good Is It? How Can We Know?. He is a professor at the University of Pennsylvania and co-creator of The Good Judgment Project; a multi year study on crowd forecasting of world events.
Why are so many experts so wrong, yet people keep listening to them? Who really is worth listening to about the future? The author of Expert Political Judgement builds on Isaah Berlin's characterization of judgment modes into Hedgehogs (who know one big thing) and Foxes (who know many things). Hedgehogs don't notice and don't care when they're wrong; that's why they're so compelling. Foxes learn.
“What is it about politics that makes people so dumb?”
From his perspective as a psychology researcher, Philip Tetlock watched political advisors on the left and the right make bizarre rationalizations about their wrong predictions at the time of the rise of Gorbachev in the 1980s and the eventual collapse of the Soviet Union. (Liberals were sure that Reagan was a dangerous idiot; conservatives were sure that the USSR was permanent.) The whole exercise struck Tetlock as what used to be called an “outcome-irrelevant learning structure.” No feedback, no correction.
He observes the same thing is going on with expert opinion about the Iraq War. Instead of saying, “I evidently had the wrong theory,” the experts declare, “It almost went my way,” or “It was the right mistake to make under the circumstances,” or “I’ll be proved right later,” or “The evilness of the enemy is still the main event here.”
Tetlock’s summary: “Partisans across the opinion spectrum are vulnerable to occasional bouts of ideologically induced insanity.” He determined to figure out a way to keep score on expert political forecasts, even though it is a notoriously subjective domain (compared to, say, medical advice), and “there are no control groups in history.”
So Tetlock took advantage of getting tenure to start a long-term research project now 18 years old to examine in detail the outcomes of expert political forecasts about international affairs. He studied the aggregate accuracy of 284 experts making 28,000 forecasts, looking for pattern in their comparative success rates. Most of the findings were negative— conservatives did no better or worse than liberals; optimists did no better or worse than pessimists. Only one pattern emerged consistently.
“How you think matters more than what you think.”
It’s a matter of judgement style, first expressed by the ancient Greek warrior poet Archilochus: “The fox knows many things; the hedgehog one great thing.” The idea was later expanded by essayist Isaiah Berlin. In Tetlock’s interpretation, Hedgehogs have one grand theory (Marxist, Libertarian, whatever) which they are happy to extend into many domains, relishing its parsimony, and expressing their views with great confidence. Foxes, on the other hand are skeptical about grand theories, diffident in their forecasts, and ready to adjust their ideas based on actual events.
The aggregate success rate of Foxes is significantly greater, Tetlock found, especially in short-term forecasts. And Hedgehogs routinely fare worse than Foxes, especially in long-term forecasts. They even fare worse than normal attention-paying dilletantes — apparently blinded by their extensive expertise and beautiful theory. Furthermore, Foxes win not only in the accuracy of their predictions but also the accuracy of the likelihood they assign to their predictions— in this they are closer to the admirable discipline of weather forecasters.
The value of Hedgehogs is that they occasionally get right the farthest-out predictions— civil war in Yugoslavia, Saddam’s invasion of Kuwait, the collapse of the Internet Bubble. But that comes at the cost of a great many wrong far-out predictions— Dow 36,000, global depression, nuclear attack by developing nations.
Hedgehogs annoy only their political opposition, while Foxes annoy across the political spectrum, in part because the smartest Foxes cherry-pick idea fragments from the whole array of Hedgehogs.
Bottom line… The political expert who bores you with an cloud of “howevers” is probably right about what’s going to happen. The charismatic expert who exudes confidence and has a great story to tell is probably wrong.
And to improve the quality of your own predictions, keep brutally honest score. Enjoy being wrong, admitting to it and learning from it, as much as you enjoy being right.
(Iraq footnote. I asked Tetlock to opine on which experts were most right about how things have gone in the Iraq War. He said the most accurate in this case were the regional experts, who opposed the invasion, and what they are predicting now is a partition of Iraq into Kurdish, Shia, and Sunni areas.)--Stewart Brand
Condensed ideas about long-term thinking summarized by Stewart Brand
(with Kevin Kelly, Alexander Rose and Paul Saffo) and a foreword by Brian Eno.
We would also like to recognize George Cowan (01920 - 02012) for being the first to sponsor this series.Would you like to be a featured Sponsor?
Seminars About Long-term Thinking is made possible through the generous support of The Long Now Membership and our Seminar Sponsors. We offer $5,000 and $15,000 annual Sponsorships, both of which entitle the sponsor and a guest to reserved seating at all Long Now seminars and special events. In addition, we invite $15,000 Sponsors to attend dinner with the speaker after each Seminar, and $5,000 Sponsors may choose to attend any four dinners during the sponsored year. For more information about donations and Seminar Sponsorship, please contact firstname.lastname@example.org. We are a public 501(c)(3) non-profit, and donations to us are always tax deductible.
The Long Now Foundation • Fostering Long-term Responsibility • est. 01996 Top of Page