ANAlpesh Nakrani
SolutionsBlogBooksPraiseAboutWork with me
All books
In Defense of Small Models cover
Cover preview Page 1 of 87
Free PDF/Points of View

In Defense of Small Models

Points of View, Volume VI

A book by Alpesh Nakrani

Subscribe to get the complete book. Your PDF downloads immediately.

Pages
87
Chapters
11
Format
PDF · 15.7 MB
01/Overview

What's in the book

The frontier gets the headlines; the small model gets the margin. Why most production value lives below the state of the art.

InferenceStrategy
02/Inside the PDF

Table of contents

PDF page
  1. INTIntroduction: The Demo Was a Lie9
  2. 01What Small Actually Means15
  3. 02Capability Waste in Production AI21
  4. 03Making the Task Smaller27
  5. 04The Workhorse Tasks: Classify, Extract, Route, Search33
  6. 05Adapting Small Models: Fine-Tuning and Distillation39
  7. 06Quantization and the Cost of Compression45
  8. 07Latency as a Product Feature51
  9. 08Privacy, Local Inference, and Data Residency57
  10. 09Routing: Small First, Large When Needed62
  11. 10Proving Good Enough With Evals68
  12. 11When Small Models Are Wrong74
  13. ENDConclusion: A Sign of Maturity, Not a Lack of Ambition79

The full chapters, illustrations, and reference material are included in the downloadable PDF.

Read it at your own pace

Your next read, ready to download.

87 pages. The complete edition. Free with your subscription.

Download free PDF

Ask AI about In Defense of Small Models — Free PDF