
2026/Free online book · Points of View
The Cost of Being Confidently Wrong
Points of View, Volume IV
Access
Free
Chapters
11
Read time
130 min
A model that is wrong and sure is more dangerous than one that is wrong and uncertain. Designing for calibrated doubt.
This edition is free to read onsite. Each chapter has its own URL, so readers can bookmark, share, and return to the exact section they need.
Table of contents
INTIntroduction: The Answer That Sounded FinishedThe dangerous AI failure is not being wrong, it is being wrong in a form that makes people stop checking.8 min01Why Fluency Feels Like CompetenceHumans read smoothness, structure, and tone as evidence of correctness, and AI produces those signals for free.10 min02Accuracy, Confidence, Calibration, and AuthorityFour properties get collapsed into one in casual conversation, and the collapse is where AI products fail.10 min03Where Wrong Answers Get ExpensiveThe Confidence-Cost Matrix maps apparent confidence against cost of error so you spend your doubt budget where it pays.10 min04Why Showing Sources Is Not EnoughCitations add authority without adding verification, and weak retrieval lets a system cite a real document for a false claim.10 min05Designing the Calibrated AnswerThe Calibrated Answer Contract specifies what every high-stakes answer must carry: source, scope, freshness, confidence behavior, actionability, and an escalation rule.10 min06Doubt as a Product FeatureThe Doubt UX Ladder gives you graded ways to express uncertainty, from a subtle cue to human escalation, without crying wolf.10 min07Abstention and EscalationSelective prediction and conformal methods let a system decline to answer with a controlled error rate, and escalation routes the abstained cases to where they get resolved.11 min08Measuring Calibration in AI ProductsReliability diagrams, ECE, and proper scoring rules turn confidence into something you can audit, and each has a trap that lets you fool yourself.11 min09Retrieval Quality as a Confidence SignalIn a RAG system the retrieval step often knows the answer is shaky before the model speaks, and that signal is usually thrown away.10 min10Human Review Theater Versus Real ReviewA human in the loop who rubber-stamps fluent output reduces no risk and adds the dangerous illusion that risk was reduced.11 min11The Economics of DoubtCalibrated doubt is an expected-value decision, and the rare confident wrong answer usually dwarfs the value of the marginal answers you decline to give.11 minENDConclusion: Doubt Is an Interface for TruthA confident answer borrows trust from the interface before it earns it from the evidence, and the whole job is to make confidence honest.8 min
