13 min
The test it hasn't seen
The bakery's new forecast was perfect on last month and way off on Monday. Here's why you never grade a model on its own homework.
Ticket 01 · The guess
The forecast that kept guessing high
Words to know
Sources and every number (1)
Sources
- The Parable of Google Flu: Traps in Big Data Analysis (Science 343(6176): 1203–1205, March 14, 2014) · Science (David Lazer, Ryan Kennedy, Gary King, Alessandro Vespignani), 2014
Every number
- 108 weeks
science.org ·2014 · Weeks checked against the CDC's counts, starting August 2011 (Lazer and others, Science, 2014). - 100 weeks
science.org ·2014 · Weeks, of those checked from August 2011, in which Google Flu Trends guessed too high (Lazer and others, Science, 2014). - 50 million search terms
science.org ·2014 · How many search terms the first version of Google Flu Trends picked its best matches from (Lazer and others, Science, 2014). - 1,152 data points
science.org ·2014 · How many data points of past flu levels the first version was fitted to (Lazer and others, Science, 2014).