How to Evaluate Coding Agents

0:00 · Watch on YouTube

Evaluating coding agents is closer to testing foundation models than to shipping a finished product: a cheap score can look decisive, but task design, hidden context, sandbox leaks, and how you aggregate runs routinel...

Read the full summary on retube