Overview of Freakonomics Radio Episode 686: Why Is It So Hard to Find an NFL Quarterback?
This episode examines why identifying a future NFL quarterback is such a notoriously difficult task, even with modern scouting, combine data, and advanced analytics. Through the stories of Kurt Warner, Peyton Manning, Ryan Leaf, Brock Purdy, and others, the episode shows that quarterback success depends on far more than arm strength or college stats. It blends sports history, psychology, and data science to explain how teams are trying to better measure the mental side of the position—processing speed, decision-making, resilience, coachability, and performance under pressure.
Main Theme: Why Quarterback Evaluation Is So Uncertain
The episode argues that quarterback scouting is one of the hardest prediction problems in professional sports because:
- The position is extremely complex and context-dependent.
- College performance doesn’t reliably translate to NFL success.
- Many important traits are hard to observe directly, especially under real game pressure.
- Physical tools matter, but mental traits often determine the ceiling.
The core idea: NFL teams are not just drafting past performance, they’re betting on future potential in a highly volatile environment.
Kurt Warner as the Classic “Overlooked” Quarterback
Kurt Warner’s story is used as the strongest example of how badly teams can miss on quarterbacks:
- He was ignored in the NFL Draft, wasn’t invited to the Combine, and even worked stocking shelves at Hy-Vee after being cut.
- He eventually found his way through the Arena Football League and NFL Europe before getting his shot with the St. Louis Rams.
- Warner explains that once defenses tried to speed him up, he benefited from his ability to process quickly, stay calm, and anticipate coverage.
- His success came from mental sharpness, practice habits, and confidence under pressure—not prototypical size or draft hype.
Warner’s takeaway is that quarterbacks are often judged too much by where they came from and not enough by how they actually process the game.
What Makes a Great Quarterback, According to the Guests
Kurt Warner’s view
Warner emphasizes:
- Fast decision-making
- Reading defenders
- Handling pressure
- Learning from practice
- Self-belief and adaptability
He also argues that most of life is “practice,” so how a player performs in training often matters more than people realize.
Dan Hatman’s scouting view
Dan Hatman, from the Scouting Academy, explains that drafting a quarterback is difficult because football is an “N-body problem”:
- A quarterback operates amid many interacting variables: teammates, coaches, defenses, scheme, and game context.
- Scouts have to infer not only what the player did, but what he was supposed to do and whether the result reflects good process or just good/bad luck.
His framework for quarterback evaluation:
- Physical traits set the floor
- Mental traits set the ceiling
Mental traits include:
- Processing speed
- Decision-making
- Toughness
- Intelligence
- Coachability
The Limits of Traditional Metrics
The episode revisits the long-running skepticism around pre-draft testing:
- College stats and combine numbers have limited predictive value for quarterback success.
- The Wonderlic test, used for years as an IQ-style filter, was never very predictive.
- Even NFL teams know that a high score or strong college production doesn’t guarantee professional success.
A key point: teams can identify obvious red flags, but they still struggle to distinguish between “good college quarterback” and “future NFL star.”
Scott Goldman and the AIQ Approach
Sports psychologist Scott Goldman explains a newer method for evaluating quarterback potential: the Athletic Intelligence Quotient (AIQ).
What AIQ measures
AIQ focuses on four domains:
- Physical: size, strength, speed
- Knowledge/experience
- Personality/character
- Intelligence
For quarterbacks, the intelligence component includes:
- Visual-spatial processing
- Reaction time
- Decision-making
- Learning efficiency
- Ability to scan the field and handle rapid changes
How the test works
- Administered on an iPad
- Looks like a series of short games/puzzles
- Takes about 35 minutes
- Produces a standardized score around 100 as average
Goldman says the test is meant to be descriptive, not magical or all-knowing: it helps explain how a player processes information and what type of coaching or system best fits him.
Why AIQ Matters More Than Traditional Testing
Goldman argues that cognitive testing can reveal traits that are often invisible in box scores:
- Two quarterbacks can produce similar college stats but have very different processing abilities.
- A player may have a good result with poor process, or bad results despite good process.
- Quarterback success depends heavily on how quickly a player can translate complex information into action.
The episode notes that research on AIQ found meaningful correlations with NFL outcomes such as:
- Quarterback rating
- Turnover rates
- Passing yards
- Passing touchdowns
- Career longevity
Kitman Labs and the Data-Driven Future of Talent Evaluation
Stephen Smith of Kitman Labs offers a broader, data-platform perspective.
Kitman’s philosophy
Kitman Labs tries to reduce uncertainty by combining:
- Physical and physiological data
- Match performance data
- Biographical information
- Psychological and behavioral indicators
Smith says the goal is not perfect prediction, but better understanding of the long-term traits associated with success.
What the model is finding
Across sports, the strongest signals increasingly include:
- Processing speed
- Resilience
- Coachability
- Ability to absorb and apply new information
For quarterbacks specifically, this means the future may depend less on raw physical dominance and more on:
- How fast they read defenses
- How well they progress through reads
- How they respond to adversity
- How quickly they learn and adapt
Brock Purdy and the Undervalued Quarterback Archetype
The episode repeatedly returns to Brock Purdy as a modern example of an underestimated quarterback:
- Drafted last, widely overlooked
- Yet ultimately one of the best quarterbacks from his class
- His success reinforces the idea that some of the most important traits are easy to miss in traditional scouting
The broader lesson is that great quarterbacks often look “ordinary” by conventional measures until they are tested in the right environment.
Broader Implications Beyond Football
The episode also draws parallels to other high-pressure fields:
- Military recruitment
- Special forces
- Firefighting
- Police work
- Airline piloting
The same principles apply:
- Measure not just skill, but performance under pressure
- Focus on learning speed and adaptability
- Match the person to the system and environment
- Use data to support decisions, not replace judgment entirely
Key Takeaways
- NFL quarterback evaluation remains highly uncertain because the job is cognitively and contextually complex.
- Physical traits matter, but mental traits often determine whether a player succeeds at the highest level.
- Traditional scouting metrics and IQ-style tests have limited predictive power on their own.
- New tools like AIQ and broader athlete-intelligence platforms aim to measure processing, resilience, and coachability.
- The best evaluations combine data, context, and system fit rather than relying on a single “can’t-miss” profile.
- The episode suggests the NFL may eventually get better at this problem, but it will never be easy.
Notable Insight
“The physical sets the floor. The mental sets the ceiling.”
That line captures the episode’s central argument: quarterbacks are not just athletes; they are rapid-fire decision-makers operating in constant chaos.