AI Foundations & Concepts · Advanced
Evaluating LLM Applications: Golden Sets, Judges & Regression Tests
Build the measurement layer: task metrics, curated golden sets, LLM-as-judge with calibration, and RAG-specific diagnostics.
- 1 hours lesson
- advanced level
- Engineering Track
- Narrated presentation
What you’ll learn
- Golden sets built from real traffic
- Deterministic vs. model-graded metrics
- LLM-as-judge rubrics and bias calibration
- Human agreement as ground truth
- Faithfulness and answer relevance for RAG
- Incidents converted into regression cases
Inside this lesson
A narrated, slide-by-slide presentation with 1 prediction exercise, 1 knowledge check, 4 videos. You answer as you go, and the platform checks your work.