ANAlpesh Nakrani
SolutionsBlogBooksPraiseAboutWork with me
All books
A Field Guide to Evals cover
Cover preview Page 1 of 60
Free PDF/Field Manuals

A Field Guide to Evals

Measuring what will actually break in production

A book by Alpesh Nakrani

Subscribe to get the complete book. Your PDF downloads immediately.

Pages
60
Chapters
6
Format
PDF · 14.5 MB
01/Overview

What's in the book

An eval that only passes is not telling you anything. This manual builds an evaluation harness from production traffic up: what to sample, how to label without lying to yourself, and how to read a number you can defend in a review. Code, not philosophy.

Most eval suites measure the wrong thing and pass right up until launch. The harness I trust before I ship.

EvalsEngineering
02/Inside the PDF

Table of contents

PDF page
  1. 01Why Evals Fail in Production9
  2. 02Building the Reference Set16
  3. 03Graders, Rubrics, and Human Review25
  4. 04Regression Gates and Release Decisions34
  5. 05Operating Cadence42
  6. 06The First Ninety Days of Eval-Led Delivery49

The full chapters, illustrations, and reference material are included in the downloadable PDF.

Read it at your own pace

Your next read, ready to download.

60 pages. The complete edition. Free with your subscription.

Download free PDF

Ask AI about A Field Guide to Evals — Free PDF