Multi-node Serving · Part 7

Contrasting Hardware: AMD and TPU

What transfers from the NVIDIA-centric course and what is a hard substitution, on AMD Instinct and Google TPU.

17AMD MI300X/MI355X Multi-Node Serving: RCCL, InfiniBand/RoCE, and vLLM-ROCm30 min18TPU Multi-Host Serving: ICI, Pathways, and JetStream35 min