Multi-node Serving · Part 5
The Open-Source Serving Stack
Project by project: Dynamo, llm-d, vLLM, SGLang, and TensorRT-LLM/Triton, contrasted mechanism by mechanism against the generic patterns established in Parts 1-4.
09NVIDIA Dynamo: Router, Planner, KV Block Manager, and Disaggregation Orchestration35 min10llm-d: The Inference Scheduler, Endpoint Picker, and Kubernetes Gateway API Inference Extension30 min11vLLM Multi-Node: Distributed Serving, Disaggregated Prefill, and the Production Stack30 min12SGLang: Router, PD Disaggregation, and Wide-EP Deployment Patterns30 min13TensorRT-LLM and Triton: Disaggregated Serving on GB20025 min