14 min
Biased data, biased predictions
Amazon built a résumé-scoring tool that taught itself to mark down the word "women's". Nobody programmed that. It came from the data.
Ticket 01 · The guess
Who does the voice app understand?
Words to know
Sources and every number (1)
Sources
- Racial disparities in automated speech recognition (PNAS 117(14): 7684–7689) · PNAS (Allison Koenecke and others), 2020
Every number
- 19%
doi.org ·2020 · Average word error rate for white speakers across five companies' speech-to-text systems, shown as a percent of words (PNAS, 2020). - 35%
doi.org ·2020 · Average word error rate for Black speakers across the same five systems, shown as a percent of words (PNAS, 2020).