"Stop Rate Limiting! Capacity Management Done Right" by Jon Moore
Strange Loop Conference · 42:20 · Watch on YouTube
Rate limiting by requests-per-second fails under backend overload and wastes capacity, so API gateways should limit concurrent requests using Little's Law (N = X × R) plus adaptive AIMD discovery and quota-borrowing t...