You're listening to Book Insights, brought to you by Memode, finding and simplifying the world's most powerful ideas to fit into your lifestyle. Each episode is a deep dive into a non-fiction bestseller that can change your life or make you think. In around 30 minutes, you'll learn all about a book that offers wisdom for your life, career, or business. So get ready to live and work smarter, better, and happier with Book Insights.
Johannes Gutenberg invented the printing press in 1440. Europe was producing only a few thousand books a year then. But a century later, around two million books were being produced annually and their cost plummeted. The dispersal of knowledge helped spark the industrial revolution and set the stage for the European enlightenment. But the printing revolution had other effects. Society became filled with inflammatory religious tracks that ramped up heresy. Sudo-scientific titles were popular, and errors in original texts were now multiplied by the thousands. A little knowledge became a dangerous thing. Pamphlets like Martin Luther's famous 95 Theses got printed over and over, and sewed the seeds for centuries of religious war. Masks did the mass printing of Bibles. On the plus side, thinkers like Galileo were able to spread their ideas beyond the reach of authority. The works of Shakespeare could be enjoyed by millions. And it's doubtful that the French and American revolutions would have happened without the fast dissemination of ideas that printing brought.
The printing press also brought a huge amount of trivial information into the mind of the average person. There was now a ton more noise to sift through. Today's printing press is, of course, the internet. More data is produced each year than in the entirety of human history. Does this data automatically translate into greater wisdom and better decisions? Probably not. As Nate Silver argues in his 2012 bestseller, The Signal and the Noise, increases in information actually make it harder to identify what's important. Just because we have more data, it doesn't mean we can make better forecasts of where a terrorist attack may happen, or when an economy will go into recession. The more points of information there is, the more crucial it becomes to have filters and to be aware of our own biases. Humans are expert at seeing patterns where none exist.
The subtitle of The Signal and the Noise is, The Art and Science of Prediction. Successful prediction is an art because it requires human imagination and context. It's a science because it involves the objective use of statistics as much as possible. Why is prediction important? Because it's not just the realm of forecasters, we predict outcomes every day and make decisions based on them. This can be deciding on a second date or assessing the economy because it impacts on whether we take out a mortgage. There's such a thing as objective truth and we're all trying to get closer to it. Failure to see truth has big costs.
The Signal and the Noise is a fascinating journey into the field of prediction making across several fields. In this book insight, we'll look more in-depth at Nate Silver and his highly successful forecasting approach. Second, see how his approach is applied in poker, baseball and politics. Third, learn about forecasting things with very complex causes and inputs such as housing crises and hurricanes. And finally, we'll discover how some areas are so complex that no methods are able to accurately predict outcomes. Examples include stock markets, earthquakes, climate change and terrorism.
Silver was born in 1978 and grew up near Detroit. After completing an economics degree at the University of Chicago in 2000, he got a job with a countancy firm KPMG. Board by the work, he started developing a baseball prediction program while his boss wasn't looking. His PCODA or Player Empirical Comparison and Optimization Test Algorithm turned out to be an excellent system for identifying great players. He sold it to baseball prospectus, a baseball website and prediction company, and continued to manage PCODA for a few years. Then, from 2004 to 2005, Silver used his talents in a very different field. While still in his 20s, his skill at online poker netted him $400,000.
Silver started getting more interested in politics and political forecasting and began building another prediction model. He gained fame when, in the 2008 US election, he famously called the result of 49 of 50 states. Actually, he didn't provide firm calls but probabilities. Still, the feat won him a place on Time Magazine's World's 100 Most Influential People List the following year. He did the same thing in the 2012 election and his website, 538.com, became legendary for its forecast and analysis. Though Silver did not predict Trump's victory in 2016, he did give him a much higher chance of victory than other pollsters and he was criticized for that forecast leading up to Election Day.
So what Silver's secret? Actually, there is no magic to it. It's a combination of numbers crunching and taking into account tiny details for which you build up a picture of trends and likelihoods.
Before reviewing each area of prediction in the book, let's first summarize the first five aspects of Silver's method. The first thing you have to identify your biases. We are naturally overconfident in our knowledge. Silver admits that it's hard for any of us to recognize how much our relatively narrow range of experience can color our interpretation of the evidence.
Humans are awesome at pattern recognition but in our information age, this creates a big problem. Because the more data we have, the greater the likelihood that we'll read stories into things. Therefore, before we demand more of our data, Silver says, we need to demand more of ourselves.
The second aspect of better prediction is simply to get better at the odds. We face two main sources of uncertainty. One is the quality of the information we have. The other is our assessment of its meaning. A good clue that we don't know something, in other words, that we are biased, is when we think the probability of something happening is either 0% or 100%.
There are a few absolute certainties, and the law of averages means that even things with very long odds routinely happen. Just because we know what's happened in the past and have data in the present, it isn't a guarantee that our odds will be accurate. Therefore, the better we understand how probability itself works, the more accurate our predictions can become.
Here is Silver himself speaking with the Royal Society in London. When I said, for example, Obama, say on September 1st, was a 70-30 favorite. A lot of people thought that he was sure to win. It's like, no, I meant, you know, Ramley is going to win 310 times if you could somehow randomize the world from that point forward. That's quite a lot. If you had woke up in the morning with a 3-10 chance of being stabbed, you wouldn't really want to take those chances. Take that quite seriously.
Silver's third approach of forecasting is to understand methods of handling uncertainty. Forecasters need a baseline of what they know and some certainty in this knowledge. This becomes the foundation of better prediction. Silver's chief inspiration is the 18th century English minister statistician and philosopher Thomas Bayes, of the famed Bayes theorem.
Bayes believed that the best way to get to the truth of an idea involved admitting your assumptions, then changing your understanding appropriately when you receive new information. This approach, however, requires some understanding of the basic scientific structure behind the area being predicted or understood.
The problem with many expert predictions is that the expert's knowledge of their field comes with too many unarticulated assumptions or ideological baggage. It is only the experts who fully admit these and actually look at the data in front of them. Silver says, who can make accurate predictions.
The fourth aspect of forecasting is to test your predictions. Without this step, you can't learn and get more accurate. The prediction could be tested in chunks. For example, at first you may not be able to predict a hurricane, but you can start by predicting a change of temperature, then seeing if that change occurs. At the other extreme, there can be over-zealous testing.
Silver points the finger at 20th century philosopher of science, Karl Popper. For Popper, no hypothesis was scientific unless you could falsify it. This strictness, however, tends to reduce imagination. The forecaster needs to entertain all possibilities, not just prove what is wrong. For instance, a popperian approach would never have led to a prediction of the Japanese attack on US ships at Pearl Harbor or 9-11.
Finally, Silver says that the sensible forecaster realizes that their personal predictions or data are never the full story. To get closer to the truth, they must aggregate all available data. Aggregating multiple forecasts into a single one is a humble and effective technique. Silver never claims to be a forecasting savant or genius, and in fact, stresses repeatedly that good prediction is a shared enterprise.
Much of his political forecasting success has come from pulling together all available polls and making sense of them. Combined forecasts such as these, he says, nearly always outperform individual forecasts.
In this part, we began our exploration into statistician and writer Nate Silver's bestseller, The Signal and the Noise. We learned about Silver as a forecaster of baseball statistics before starting 538.com, a political and sports analysis website. We've also learned the five key aspects to Silver's forecasting method. Identify your biases, get better at the odds, understand methods of handling uncertainty, test your predictions, and aggregate all available data.
Next time, we'll learn how Silver applied these approaches in poker, baseball, and politics. Then we'll go into forecasting with complex causes and inputs. Enjoying this episode of Book Insights? If so, keep listening and learning. There's a collection of over 100 titles you can read or listen to now at memodeapp.com slash insights. That's m-e-m-o-d-a-p-p.com slash insights.
In his bestselling book, The Signal and the Noise, statistician and writer Nate Silver noted our brains are machines that are always simplifying and approximating. Focusing on some detail that takes our eye. Those details may be important, but we are only a brain within a vast universe, and our biases often lead us to bad predictions.
Last time in this book insight, we learned about Silver's methods of forecasting. In this part, we'll look at how he applied them to particular areas. Then we'll discuss forecasting with complex systems.
Poker
People mistakenly believe that poker is a psychological game. In fact, Silver says it's an incredibly mathematical game that depends on making probability judgments amid uncertainty. Coming up with probabilities involves humility, whereas most players are overconfident. Professional poker players, such as Tom Duan, agree with Silver's method. Duan stresses the importance of having in mind probabilities for each hand played, rather than going on a simple yes or no or gut feel. In general, Silver says that to win money at poker, it's best to be a big fish operating in a small pond. You don't have to be the very best. He advises spending time getting up the learning curve until you are at about 80% there. There is a law of diminishing returns whereby you spend a lot of time getting more accurate or advancing your skill, but not making additional money for the effort. In other words, it's worth being better than a good number of your competitors, but not all of them. Is Silver's insight here something we can all apply to our careers? Again, it's an example of how we are all making constant forecasts, little and big, about our chances of success, which lead to decisions on whether or not to commit resources.
Baseball
As mentioned earlier, it was the creation of his predictive baseball spreadsheet, Pacota, that originally got Silver noticed. He gives some idea of how the system worked. For example, even though the nation's baseball scouts did not rate Dustin Pradroya very highly, partly because he was only 5'7", Silver's system singled out the Red Sox second basement for success. The scouts tended to have a preset idea of potential greatness and often made selections based on gut feel. But as legendary baseball analyst Billy Bean, the subject of the film Moneyball pointed out, first impressions of one player can mean that you let a statistically good one through the cracks. You can easily miss the potential of players who don't fit the usual mold.
Silver's system took the qualitative measures of players into consideration, not just the usual quantitative ones. These include work, ability to concentrate and focus, a drive to compete, ability to humbly manage their stress, and being good learners. Pradroya had all these features in spades and it helped him achieve fame just as Pacota predicted, despite what the scouts had estimated. The last couple of decades have seen a battle between the nerdy statisticians of baseball and the scouts who are often former players. A good forecaster combines the numbers obsession of a baseball nerd with the whileness of a scout, Silver says. He recommends aggregating the analysis and predictions of each. It's a good example of his ability to look at the big picture, but also focus on fundamental details. Predictive innovators typically think very big and they think very small, Silver says.
Politics
Every country has television shows where a host brings on experts to hash out the latest developments in politics. These shows make for good TV. But as political scientists, Philip Tetlock demonstrated in his 2005 book, Expert Political Judgment. Predictions made by these talking heads have a wouful record. In fact, no better than flipping coins. Part of the problem is that the experts tend to be part of political camps so they cannot objectively assess information. Some even actively make bold predictions just to get noticed in the media. Tetlock found that the only people who were better than average in political forecasting tended to have no ideological position. They were able to gather up many little ideas and take into account uncertainties in their predictions.
This kind of forecast or silver notes is more like the Fox of the ancient Greek fable, who knows a lot of little things. In contrast to the hedgehog, who knows one big thing. Here is silver speaking with the Royal Society.
The Fox personality type tends to be scrappy and scrounged around for different ideas. They're not hidey ideological. They don't have one big theory. The hedgehog would say that I have a big theory. The theory that explains everything, capital E, is a very hedgehog mentality. If you have a pristine theory or what you think is pristine theory, then you have absolute certainty. But in fact, the people who demonstrate that overconfidence actually do a worse job of making predictions.
The Foxy forecasters are more successful because they are capable of making connections between diverse bits of data to arrive at a measured judgment. This bottom-up approach to prediction is a lot more trustworthy than most political prediction, which is simply the projection of the mind of the so-called expert.
Housing crises and the economy Silver reflects on the 2006-2007 housing bubble that preceded the financial crisis. He notes, we ignore the risks that are the hardest to measure, even when they post the greatest threats to our well-being. In other words, it's tempting to simply focus on what we prefer to happen, or that we could at least understand happening.
Oftentimes, multiple risks can occur that seem very independent from one another. Various signals taken separately don't seem too worrisome, but when considered as a whole and in retrospect, the outcome is not surprising. The upward movement in house prices in the mid-2000s may not have seemed that dramatic at the time. Yet as part of a 100-year graph of house prices adjusted for inflation, it's clear that there had been a sudden ramping up of values. It should have sent up warning flags that something unrealistic was happening. Samultaneously, home lending had become irresponsible. Defaults were increasing at a pace, and the rating agencies were incorrectly labeling risky subprime mortgage securities as triple-A rated.
Join the dots on these things, and it's clear the housing boom was a house of cards. But the fact that the economy seemed to be very strong acted like a veil to these deep problems. The group of prominent Federal Reserve economists was saying that there was a one-in-five hundred chance of a recession. They were so taken in by rising asset prices that they were blind to the various signals. Silver attributes some of these negligence to simple fear and greed, which overwhelmed healthy skepticism and judgment.
A lot of the time, people fail to make accurate predictions because they don't want to see where current conditions are leading.
很多时候,人们无法做出准确的预测,因为他们不愿意看清当前情况所导致的结果。
Hurricanes. Silver is happy to say that the prediction of weather has made dramatic strides. Chaos starts to kick in when prediction is attempted over periods longer than a week, but day-to-day forecasting has become pretty reliable. Case in point? We are 30 times less likely to be struck by lightning today than in 1940, thanks to improvements in forecasting. And in the even more frightening case of hurricanes, we now tend to get at least a couple of days notice before one hits land. Plus, we now know within 100 miles of exactly where it will hit.
When it came to Hurricane Katrina, which he discusses at length, the true disaster was not in forecasting, but in responding. Silver attributes the success of hurricane prediction and weather prediction to three federal agencies, the National Center for Atmospheric Research, the National Oceanic and Atmospheric Administration, and the National Weather Service.
The NWS costs each citizen only $3 per year. Such great prediction at low cost is the gold standard for forecasters, Silver says, and should be our model. In general, Silver argues that politics, personal glory, and economic gain are the three sins of forecasting. They have stopped the science and art of prediction from advancing to where it should be.
In this part, we continued our dive into Nate Silver's The Signal and the Noise. We looked into three areas where Silver applied his methods of forecasting. Poker, baseball, and politics. In poker, knowledge of probability and humility serve better than understanding of psychology. In baseball, Silver suggests a combination of money-ball statistics and gut-level shrewdness. In politics, the smartest forecasters take in knowledge from all sides of the political spectrum instead of clinging to one dogma.
We also looked into Silver's methods approaching complex inputs and causes. In the housing market, clear minds were clouded by fear and greed rather than looking at rising defaults and falsely labeled risky subprime mortgage securities.
When it comes to weather forecasting, we're more advanced than ever thanks to three federal agencies, the National Center for Atmospheric Research, the National Oceanic and Atmospheric Administration, and the National Weather Service. We simply need to improve our preparedness and responses to disasters.
Next time, we'll conclude our book insight on the signal and the noise by looking at examples where predictions start to break down. We'll wrap up with a consideration of the book's legacy. Enjoying this episode of book insights? If so, keep listening and learning. There's a collection of over a hundred titles you can read or listen to now at memodeapp.com slash insights. That's memodeapp.com slash insights.
According to statistician and writer Nate Silver, it's human nature to view the admission of uncertainty as weakness, but it's often the most boastful predictions that tend to be wrong. In his best-selling book, The Signal and the Noise, Silver notes that only forecasting which arises from many data points and tries to take account of all biases is likely to be correct. Here is Silver being interviewed by the Royal Society. We are our own constraint, basically. The idea is to build a computer program and solve everything. If you put it in the code, the computer will replicate that silly instruction and will reproduce that bug millions of times over. We should be humble about our own ability to perceive the world, especially complex matters like forecasting earthquakes or the economy or what have you.
In this part, we're concluding our book insight into The Signal and the Noise by looking at examples where predictions start to break down. We'll review everything we learned, then look at the wider implications of Silver's work.
Stock markets and the economy. The stock market is a classic, complex system, subject to chaos. Despite what people may claim, no one is really capable of predicting movements in the market. Silver makes the point that even if insider information was available to traders, their predictions would be stronger, but not perfect. There are just too many variables happening in real time, and each new piece of information, even if small, changes the picture. The same is true for the economy as a whole. Economists want to be seen as accurate in their forecasting, so they give very specific forecasts on employment, the rate of growth, etc. But at the risk of appearing vague, it's better to present a range of likely probabilities. Economists have historically been way too confident in their forecasts. They're wrong by a significant degree, both by underestimating actual growth in the economy, or by discounting risk to the economy. Economists frequently don't even know a country is in recession. Jan Hatsius, Goldman Sachs chief economist, told Silver, nobody has a clue. It's hugely difficult to forecast the business cycle. Understanding an organism as complex as the economy is very hard.
Earthquakes. In contrast to the weather, the field of earthquake prediction does not fare very well. In 2009, an earthquake in Laquia, Italy, caused 300 deaths. The town had a history of earthquakes, but after a time complacency set in. Why? The span of a human life is so much shorter than geological timeframes, people simply become less worried as time marches on. The sensors measuring the Earth's crustal movements put out millions of readings. It's easy to mistake this noise for a credible signal of an earthquake. Like weather systems and the stock market, earthquakes sit in the realm of great complexity. Silver praises the US geographical survey for coming straight out and stating that they cannot predict the date and time of an earthquake. There is a relationship over long periods of time between the magnitude and the frequency of occurrence of historical earthquakes. But largely, earthquakes are still unpredictable.
Climate change. One of the most crucial predictions facing the planet relates to the future of climate change. Bias is definitely play an important role here. As outlined earlier, it's important to have a baseline in order to incrementally work towards the truth. The International Panel on Climate Change, or IPCC, tries to provide this foundation with the body of facts. First, the greenhouse effect is a solid scientific fact and is what keeps the Earth's temperature in check. Second, emissions from human activities increase greenhouse gases. Third, as water vapor goes up, temperatures tend to rise. But the big question is, what are the outcomes of such facts and to what extent? The wrong way to see climate change, Silver says, is as a free for all, where stakeholders get to cherry pick facts to suit their argument. This is a case where wrong predictions are extremely dangerous. Assessing climate is pretty complex compared to weather forecasting. Factors which come into play include El Niño effects, Sunspot activity, volcanic eruptions, levels of CO2 which cause warming, and levels of sulfur which cool the atmosphere. In short, there is no way to avoid the layers of uncertainty in climate change forecasting. The only thing we can do is keep feeding back new data into our models to get more accurate.
Terrorism. When it comes to predicting acts of terrorism, it's not so much about seeking physical or statistical signals, but rather understanding and tracking terrorist intentions. With all the noisy information on tips and conflicting leads on potential terrorist attacks, it's no wonder that conspiracy theories abound. Conspiracy theories, Silver says, are an irresistible method of labor saving. They're a hack for those faced with overwhelming complexity but who have an inability to sift through the facts. He says, a conspiracy theory might be thought of as the laziest form of signal analysis. Silver interviewed former US Secretary of Defense during the 9-11 attacks, Donald Rumsfeld. Rumsfeld recounted the history of terrorism, starting with Pearl Harbor, and recalled that even back then there were early signs. The biases clouded everything. The US was expecting some type of sabotage or subterfuge from Japan, but not a huge planned act of war. Similarly, with the 9-11 attacks, the problem was not data or information, but the ability to see the forest for the trees and understand the true scope of the terrorist intentions. There is a deep human bias towards avoiding what is unfamiliar, improbable, and unknown. More often than not, big shocks involve a failure in our imagination. We didn't see it coming for any number of reasons. We didn't want to, or we didn't have the intellectual scope to do so.
A quick recap. We first took a look at the author, Nate Silver, and his highly successful forecasting approach. It involves being aware of your biases, getting better at understanding the probabilities for any event, getting smarter when faced with situations of uncertainty, always testing your predictions, and using the power of aggregation of results. Second, we saw how Silver has applied this approach with success in poker, baseball, and politics. We then learned about the art and science of forecasting when it involves very complex causes and inputs, such as for housing bubbles and hurricanes. Finally, we learned that some areas are so complex that no methods are able to accurately predict outcomes. Examples include stock markets, earthquakes, climate change, and terrorism. With over a thousand carefully cited references and interviews with the most respected names in prediction, it's hard to argue against the ideas in the signal and the noise. That said, after Silver published it, philosopher and author of the Black Swan, Nassim Taleb, publicly challenged Silver's work on technical reasons. He argued that some of the data or points of information that Silver was taking into account shouldn't even be considered, and that it's easy to impute meaning from them after the fact. For Taleb, the only prediction that matters is the one made just before an event, which takes in all available information. In 2016, Silver's failure to predict the outcome of the US election showed that people claiming to be accurate forecasters might just get lucky some of the time. Taleb may be right, but if anyone is able to make predictions that are better than even odds, it's people like Nate Silver. Despite recent controversies, the signal and the noise is an authentic, transparent look at the prediction industry from a practicing expert in the field.
We can all borrow something of Silver's approach in making predictions in our own lives, but we must proceed with caution. Although we're in the age of big data, Silver says there's a risk that we become too starry-eyed about what it can do for us. He says, there is no reason to conclude that the affairs of men are becoming more predictable. The opposite may well be true.
The same science is that uncover the laws of nature are making the organization of society more complex. He says the book isn't so much about what we know, but the gap between what we think we know and what we actually do. Closing that gap means adopting a Bayesian approach to prediction under uncertainty.
This means being a bit more humble and thinking in probabilities given our many strong biases. It's human nature to view the admission of uncertainty as weakness, but as we've learned, it's often the most prideful predictions that tend to be wrong. Only forecasting that arises from many points of data, both quantitative and qualitative, and that tries to take account of all biases, has any chance of being correct.
According to Silver, the only way to become better at forecasts is to make more of them. It's the only way you can test your hypothesis of how the world works. This doesn't mean refining your models so that they become more elegant, but doing constant real world tests, in the same way that companies like Google and Facebook do A-B testing. Silver says, forget models.
Constant testing of our own hypothesis is the only way we ever get closer to truth. Thank you for listening to Book Insights. Check out the rest of our content at memo.com. Please keep in mind that the information provided in or through our Book Insights episodes is for educational and informational purposes only.
不断测试我们自己的假设是接近真理的唯一方式。谢谢您收听 Book Insights。请在 memo.com 上查看我们其余的内容。请记住,在我们的 Book Insights 集数中提供的信息仅用于教育和信息目的。
It's not intended to be a substitute for advice given by qualified professionals and should not be relied upon to disregard or delay seeking professional advice.