Book review

Super Crunchers Review

This Super Crunchers review evaluates Ian Ayres's approach to data-informed decision-making with attention to reader fit, analytical limits, and safer comparisons.

Author
Ian Ayres
First published
2007
Cover image for Super Crunchers
Cover image served by Open Library; edition artwork may differ from the reviewed text.
View source https://openlibrary.org/works/OL4089450W

Super Crunchers review: what prediction can and cannot replace

This Super Crunchers review takes Ian Ayres at his most persuasive when he shows that a modest statistical model can outperform confident professionals, and at his least persuasive when prediction is allowed to stand in for explanation. The book's recurring drama sets expert intuition against regression, large datasets, and randomized trials. That opposition is productive because it exposes how easily experience becomes anecdote. It is also too clean at times: a forecast may improve a choice while leaving the causal mechanism, the quality of the input data, and the human cost of an error unresolved.

Ayres writes for readers who enjoy practical examples more than mathematical derivation. He turns quantitative comparison into narrative contest: the credentialed judge enters with authority, the formula enters with fewer variables, and the result embarrasses the judge. The pattern gives the book momentum, but it can also make heterogeneous cases look more alike than they are. Wine prices, medical treatment, hiring, credit, and consumer behavior do not share identical stakes merely because each can be modeled.

The Ashenfelter wine equation and the appeal of a clean forecast

Orley Ashenfelter's Bordeaux wine equation is an ideal opening emblem for Ayres. Weather variables and vintage conditions challenge the language of connoisseurship by producing a price forecast without tasting the wine. The example is memorable not because it proves taste irrelevant, but because it separates two questions that experts often blur: what will a bottle command in the market, and what does a critic experience in the glass? A model can be good at the first while remaining silent about the second.

That distinction reveals the book's central strength. Super Crunchers asks readers to define the outcome before celebrating accuracy. If the target is future price, variables should be judged against price. If the target is clinical recovery, a convenient proxy may be inadequate. Ayres repeatedly demonstrates the discipline of specifying an outcome, comparing predictions, and accepting an embarrassing result. He is less sustained on the political decision of who chooses the outcome and whose loss is counted when a system is wrong.

The wine example also displays Ayres's brisk explanatory style. He prefers the surprise of a result to a technical tour through model construction. That makes the argument accessible, yet readers seeking instruction in regression design, overfitting, or uncertainty intervals will need another book. The point here is cultural: quantitative evidence should be allowed to compete with prestige.

Randomized trials, evidence-based decisions, and local validity

Ayres treats randomized experimentation as a way to learn rather than merely predict. Businesses can test offers, websites can test presentation, and institutions can compare interventions. Random assignment matters because it can break the link between a choice and the characteristics that led someone to receive it. The book is right to distinguish that logic from simply collecting more observations. More rows do not automatically repair biased selection.

The caution is external validity. A test can be well designed for one population and still travel badly. A result from willing customers, a particular hospital, or a narrow period does not become universal through sample size alone. Super Crunchers sometimes lets the rhetoric of scale outrun this limit. Its examples reward readers who pause over the population, treatment, comparison group, and measured outcome rather than taking “data driven” as a certificate of truth.

This is where the book connects usefully with philosophy and psychology. The argument is not only about calculation; it concerns bias, authority, and the discomfort of allowing a procedure to contradict judgment. Ayres's best position is not that humans should leave the room. It is that judgment should become answerable to recorded performance.

Experts after the model: override, interpretation, and responsibility

One recurrent temptation in the book is to ask whether experts or algorithms should win. The better question is what each is responsible for. A model can rank risks consistently, while a clinician, teacher, lender, or manager still interprets missing information and bears obligations to the person affected. Expert override may reintroduce bias, but prohibiting override can conceal a model's blind spot behind procedural obedience.

Ayres is strongest when he treats prediction as a check on intuition. He is weaker when institutional incentives recede. An organization may deploy a score because it is accurate, because it is cheap, or because it creates a defensible record; those motives are not equivalent. Readers should therefore distinguish demonstrated predictive improvement from the broader claim that a system is fair or wise.

The contrast with business and growth is helpful. Commercial settings often provide rapid feedback and measurable outcomes, while public decisions may involve rights and harms that cannot be optimized as conversion rates. Super Crunchers opens the quantitative question but cannot settle the normative one.

Style, structure, and the repeated upset

The book is organized as a procession of upsets. A familiar domain appears, an expert convention is introduced, and a numerical alternative produces a better forecast or a cleaner test. Ayres's prose is energetic and explanatory, with little interest in cultivating statistical mystique. That makes the book effective for skeptical general readers and potentially frustrating for specialists who want assumptions exposed at greater depth.

Repetition is both method and limitation. It builds confidence that the expert-versus-formula problem is not confined to one industry. Yet the same rhythm can flatten differences among domains and encourage a victory-lap interpretation. The most responsible reading resists the applause line and asks what information the winning model used, what it omitted, and whether its success persisted after behavior changed in response to it.

The book also predates the present scale of machine-learning deployment. Its core warning about intuition remains relevant, but contemporary readers must add concerns about feedback loops, data provenance, opaque features, and automated discrimination. Ayres provides a useful foundation rather than a complete ethics of algorithmic decisions.

Reader fit, limitations, and useful comparisons

Super Crunchers best suits readers who want an accessible case for testing professional intuition against outcomes. It does not teach enough mathematics to build the systems it describes, and it should not be treated as proof that every large dataset yields knowledge. Its practical achievement is to make refusal to measure look less respectable.

Readers interested in commercial application can compare the book with A New Introduction to Trade and Business to see how the available evidence and institutional vocabulary have changed. Certain Success offers a contrasting style of prescriptive confidence; placing that confidence beside Ayres makes the demand for measurable performance sharper.

The decisive reader-fit question is whether one enjoys arguments built from many short cases rather than a single sustained study. Ayres's breadth is stimulating, but it gives each domain limited room. Readers concerned with medicine, lending, or employment will need field-specific evidence before applying his general lesson.

Final assessment

The durable insight of Super Crunchers is not that regression is infallible. It is that intuition should not receive immunity from comparison simply because it belongs to an experienced person. The Ashenfelter wine equation, randomized trials, and the repeated contests between judgment and prediction make that insight vivid.

Its limits are equally instructive. Accuracy depends on an outcome definition, data quality, population, and institutional use; prediction does not automatically explain, justify, or distribute harm fairly. Ayres gives readers a strong reason to demand evidence, but the reader must add the questions of governance and consequence. Used that way, the book remains a lively introduction to quantitative humility rather than a manifesto for replacing judgment with a score.

Related reading

Continue the shelf