MLsys · Part 1

Inference Optimization Fundamentals

Hardware-agnostic principles that apply everywhere

01The Inference Systems Mental Model25 min02Quantization — Complete Systems Perspective40 min03Sparsity — Structured & Unstructured35 min04Knowledge Distillation — Systems Perspective30 min05Graph Optimization & Compilation40 min