MLsys · Part 4

Server-Grade CPU Inference

Intel Xeon & AMD EPYC inference optimization

11Why CPU Inference Matters & When It Wins25 min12CPU Inference Engine Internals40 min13GEMM Optimization for CPU Inference45 min14Attention Implementation for CPU35 min15Full LLM Inference Pipeline on CPU45 min