Course · Computer Science

Intel & AMD CPU Architecture

Deep dive into CPU design, performance engineering, and CPU-specific optimization for ML inference. Covers x86 architecture, Xeon Scalable, AMD EPYC, and production inference engines.

27 modules7 parts5 appendices≈ 14 h reading

Part 1

Computer Systems Foundations

The CS:APP + OS layer — execution model, memory hierarchy, consistency, OS internals

01Execution Model30 min02Memory Hierarchy35 min03Memory Consistency Model & Synchronization30 min04Operating System Internals for Performance Engineers30 min
Part 2

Computer Architecture Deep Dive

The Hennessy-Patterson + Mutlu layer — pipelining, OOO execution, branch prediction, SIMD

05Pipelining & Hazards30 min06Out-of-Order Execution35 min07Branch Prediction25 min08Instruction-Level Parallelism30 min09SIMD & Vector Computing — AVX-512 Mastery35 min10Caches in Microarchitectural Detail30 min11Memory Subsystem — DRAM to DIMM to Controller30 min
Part 3

Parallelism & Concurrency Architecture

Multi-core design, thread-level parallelism, coherence protocols, interconnects

12Multi-Core & Thread-Level Parallelism30 min13Coherence, Consistency, and Interconnects30 min
Part 4

Performance Engineering Methodology

Systematic performance analysis, profiling tools, compiler optimization

14Performance Engineering Framework25 min15Profiling Tools Mastery30 min16Compiler Optimization & Code Generation30 min
Part 5

Intel Xeon Scalable: Complete Deep Dive

Microarchitecture evolution, Sapphire Rapids deep dive, memory subsystem, optimization

17Intel Xeon Microarchitecture Evolution30 min18Sapphire Rapids (SPR) Microarchitecture In Depth35 min19Intel Xeon Memory Subsystem30 min20Intel-Specific Performance Optimization Techniques30 min
Part 6

AMD EPYC: Complete Deep Dive

Zen microarchitecture evolution, Genoa deep dive, chiplet design, optimization

21AMD Zen Microarchitecture Evolution30 min22Zen 4 (Genoa) Microarchitecture In Depth35 min23AMD EPYC Memory Subsystem30 min24AMD-Specific Optimization Techniques30 min
Part 7

Systems Design for ML Inference Engines

CPU inference engine architecture, kernel implementation, end-to-end optimization

25CPU Inference Engine Architecture35 min26Kernel Implementation for CPU Inference35 min27End-to-End Performance Optimization Workflow30 min

Appendices

AInstruction Latency & Throughput Reference TablesBHardware Performance Counter ReferenceCCPUID Feature Detection CodeDNUMA Topology InterrogationEBenchmark Baselines