The Strange Economics of LLM Inference-as-a-Service
bycloud · 23:01 · Watch on YouTube
Inference platforms can reach very large revenue without training models because “inference as a service” is a utilization business: after a model is trained, the profit sits in the gap between GPU cost and tokens act...