Why Your LLM Evals Are Missing Critical Failures
The TWIML AI Podcast with Sam Charrington · 52:49 · Watch on YouTube
Scott Clark, co-founder and CEO of Distributional (and previously SigOpt), argues that teams running AI agents in production need analytics on top of logging and monitoring. Analytics here means using unsupervised lea...