Why AI Compute Comes in Rectangles — Erik Bernhardsson, Modal

Latent Space · 85:33 · Watch on YouTube

Erik Bernhardsson describes Modal as AI infrastructure for bursty GPU work: serverless functions that are mostly inference, plus sandboxes for running model-written code, together about two-thirds and one-third of rev...

Read the full summary on retube