Ep4 - Diana Pfeil on Evals

CTO Lunches · 45:10 · Watch on YouTube

Diana File explains that AI evals are the testing discipline for non-deterministic LLM systems: they let teams answer whether an app works, what its failure modes are, how often they occur, and whether a change caused...

Read the full summary on retube