Course · Computer Science
ML Systems Engineering
Production inference systems engineering — from fundamentals to specialized hardware deployment. Covers quantization, transformers, distributed inference, CPU/GPU/Apple Silicon/Edge AI, fine-tuning, voice AI, and RAG infrastructure.
39 modules10 parts5 appendices≈ 21 h reading
Inference Optimization Fundamentals
Hardware-agnostic principles that apply everywhere
01The Inference Systems Mental Model25 min02Quantization — Complete Systems Perspective40 min03Sparsity — Structured & Unstructured35 min04Knowledge Distillation — Systems Perspective30 min05Graph Optimization & Compilation40 minTransformer Inference Architecture
The algorithms that make LLM inference fast
06Attention Mechanism — Systems Optimization45 min07KV-Cache Management Systems35 min08Inference Serving Systems Architecture40 minDistributed Inference
Multi-device, multi-node inference at scale
09Parallelism Strategies for Inference35 min10Communication Primitives & Collective Operations35 minFine-Tuning Systems
Infrastructure for adapting trained models
26Fine-Tuning Infrastructure35 min27LoRA & Parameter-Efficient Fine-Tuning30 min28RLHF & Alignment Systems35 minFast Voice AI Systems
Streaming architecture, sub-100ms TTFA
29Voice AI Pipeline Architecture40 min30VAD (Voice Activity Detection) Systems25 min31Streaming ASR30 min32LLM Integration in Voice Pipeline30 min33TTS (Text-to-Speech) Systems Engineering30 min34Audio Processing & Codec Systems25 min35End-to-End Voice AI Optimization30 minRAG & AI Systems Infrastructure
Retrieval-augmented generation and production toolchain
36RAG Systems Architecture40 min37Deployment Toolchain30 min38Multimodal Inference30 min39Observability & Monitoring25 min