Ep4 - Diana Pfeil on Evals
CTO Lunches · 45:10 · Watch on YouTube
Diana File explains that AI evals are the testing discipline for non-deterministic LLM systems: they let teams answer whether an app works, what its failure modes are, how often they occur, and whether a change caused...