One HR handbook, thirteen chunks, five questions with known correct sources — a golden set. The pipeline below is set to naive defaults and it answers none of them correctly. Turn the knobs until all five pass. Each question is broken by a different thing.
Pipeline controls—
RECALL@5
—
is the right chunk even there?
FAITHFULNESS
—
did the answer actually use it?
Golden set · 5 questionsTAP A ROW FOR THE RETRIEVAL LOG
0 of 5 passing
Module 02 · Diagnosis
The retrieval call
Six RAG systems in production, six complaints. You get the symptom — a wrong answer, a dashboard, a user on Slack. Name the fix. Every one of these is found by reading the retrieval log, not by swapping the model.