No. 3. Acknowledge inherent biases: Bloomberg Businessweek recently noted how poorly economists do at forecasting recessions. As a group, “they’re more likely to miss recessions than to predict ones that never occur.” But it wasn't because the economists were necessarily bad at economics, but rather, because of basic game theory. Career risk for being wrong is very real. “There’s not much incentive to stick one’s neck out,” as the article noted.
Groupthink tends to push forecasters to try to hide in the middle of the pack, making them more likely to be wrong when the consensus is wrong, but also less likely to suffer negative consequences when that occurs. Everybody being wrong can offer a lot of protection.
Perhaps this helps to explain a recent finding in an International Monetary Fund research paper: During a 22-year period (1992 to 2014), private-sector economists managed to forecast only five recessions out of 153 economic contractions across 63 countries.
No. 4. Use errors to make better forecasts: Most of us learn too little from our successes, but we might learn even less from our failure. Investors such as Ray Dalio, business leaders like Jeff Bezos and others have acknowledged the significance of failure as a key aspect to their process.
All models do is take a series of data inputs, sprinkle a little fairy dust on them, and then generate an output. But even if the model does OK, how has the forecaster used its output? Can they make money for clients with it? Alternatively, do they anchor themselves to these predictions, regardless of subsequent data?
There is a specific skill to adjusting to errors and failures in order to improve. It is a skill used too little by economists and financial analysts.
5. Learn from the pros: Perhaps the foremost academic expert on why so many forecasts fail is University of Pennsylvania professor Philip Tetlock. His 2006 book "Expert Political Judgment" studied thousands of forecasts, and came to the conclusion that people simply are not good at making predictions about much of anything .
With one caveat: Buried within Tetlock’s huge dataset of failed forecasts was a surprising subset of superforecasters. Those in this group stood out for their ability to make more accurate predictions than others. They did it in a variety of ways: they incorporated multiple sources of information and used an array of analytical tools. They broke problems down into small, manageable pieces. Perhaps most important, they were not afraid to change their forecasts when the data changed.
None of these methodologies are out of reach for economists or other Wall Street seers. They should try them. They certainly couldn’t yield results any worse than those the prognosticators now have on offer.
This column was provided by Bloomberg News.