Multi-node Serving · Part 6

Operations, Economics, and the Frontier

How the fleet is deployed and kept alive, how to size it from published numbers, and what the field has not yet settled.

14Kubernetes Deployment Topologies and Operations at Fleet Scale35 min15Capacity Planning and Economics: Goodput, Tokens/s/$, and Little's-Law Reasoning at Rack Scale30 min16The Research Frontier: Live Migration, Fused Megakernels, and What Is Still Unsettled30 min