System Design: From Classical Internet Systems to AI Inference and Training Platforms · Appendix

Bibliography

Every source cited across the 39 modules, deduplicated (222 entries), ordered by source type: official documentation and standards first, then papers, textbooks, repositories, talks, blogs, third-party analyses.

222 sources39 modulesGenerated 2026-09-17

All sources

  1. officialAmazon Web Services. Amazon S3 Storage Classes. Live documentation. https://aws.amazon.com/s3/storage-classes/. Accessed 2026-09-17. Cited in: Module 7.
  2. officialAmazon Web Services. Caching strategies for Memcached. Amazon ElastiCache User Guide, live documentation. https://docs.aws.amazon.com/AmazonElastiCache/latest/dg/Strategies.html. Accessed 2026-09-17. Cited in: Module 2.
  3. officialAmazon Web Services. What is Amazon S3? Amazon S3 User Guide, live documentation. https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html. Accessed 2026-09-17. Cited in: Module 7.
  4. officialAnthropic. API and data retention. platform.claude.com docs. https://platform.claude.com/docs/en/manage-claude/api-and-data-retention. Accessed 2026-09-18. Cited in: Module 30.
  5. officialAnthropic. Code execution tool. Claude Developer Platform docs, 2026. https://platform.claude.com/docs/en/agents-and-tools/tool-use/code-execution-tool. Accessed 2026-09-18. Cited in: Module 27, Module 30.
  6. officialAnthropic. How long do you store my data? Privacy Center. https://privacy.claude.com/en/articles/10023548-how-long-do-you-store-my-data. Accessed 2026-09-18. Cited in: Module 30.
  7. officialAnthropic. Pricing. Live documentation. https://platform.claude.com/docs/en/about-claude/pricing. Accessed 2026-09-18. Cited in: Module 23, Module 30.
  8. officialAnthropic. Prompt caching (Claude API). Live documentation. https://platform.claude.com/docs/en/build-with-claude/prompt-caching. Accessed 2026-09-17. Cited in: Module 28.
  9. officialAnthropic. Rate limits (Claude API). platform.claude.com documentation, 2026. https://platform.claude.com/docs/en/api/rate-limits. Accessed 2026-09-17. Cited in: Module 10, Module 21, Module 22, Module 23, Module 28, Module 39.
  10. officialAnthropic. Streaming Messages. Live documentation. https://platform.claude.com/docs/en/build-with-claude/streaming. Accessed 2026-09-18. Cited in: Module 23, Module 26.
  11. officialAnyscale (Ray project). Deploying on Slurm. docs.ray.io, 2026. https://docs.ray.io/en/latest/cluster/vms/user-guides/community/slurm.html. Accessed 2026-09-18. Cited in: Module 38.
  12. officialAnyscale (Ray project). Placement Groups. docs.ray.io, live documentation. https://docs.ray.io/en/latest/ray-core/scheduling/placement-group.html. Accessed 2026-09-18. Cited in: Module 34.
  13. officialAnyscale (Ray project). Ray Core Walkthrough. docs.ray.io, live documentation. https://docs.ray.io/en/latest/ray-core/walkthrough.html. Accessed 2026-09-17. Cited in: Module 34, Module 38.
  14. officialApache Kafka. Broker Configuration. AK 4.3.x documentation. https://kafka.apache.org/43/configuration/broker-configs/. Accessed 2026-09-17. Cited in: Module 8.
  15. officialApache Kafka. Consumer Configuration. AK 4.3.x documentation. https://kafka.apache.org/43/configuration/consumer-configs/. Accessed 2026-09-17. Cited in: Module 8.
  16. officialApache Kafka. Design. AK 4.3.x documentation. https://kafka.apache.org/43/design/design/. Accessed 2026-09-17. Cited in: Module 8.
  17. officialApache Kafka. Implementation: Log. AK 4.3.x documentation. https://kafka.apache.org/43/implementation/log/. Accessed 2026-09-17. Cited in: Module 8.
  18. officialApache Kafka. Tiered Storage. AK 4.3.x Operations documentation. https://kafka.apache.org/43/operations/tiered-storage/. Accessed 2026-09-17. Cited in: Module 8.
  19. officialApache Software Foundation. HDFS Architecture Guide. Apache Hadoop documentation, live. https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html. Accessed 2026-09-17. Cited in: Module 7.
  20. officialApple. Differential Privacy Overview. Apple privacy technical whitepaper. https://www.apple.com/privacy/docs/Differential_Privacy_Overview.pdf. Accessed 2026-09-18. Cited in: Module 30.
  21. officialAWS. What is a Network Load Balancer? Elastic Load Balancing User Guide (Network Load Balancers), live documentation, 2026. https://docs.aws.amazon.com/elasticloadbalancing/latest/network/introduction.html. Accessed 2026-09-17. Cited in: Module 1.
  22. officialAWS. What is an Application Load Balancer? Elastic Load Balancing User Guide (Application Load Balancers), live documentation, 2026. https://docs.aws.amazon.com/elasticloadbalancing/latest/application/introduction.html. Accessed 2026-09-17. Cited in: Module 1.
  23. officialBerriAI / LiteLLM contributors. Life of a Request (LiteLLM Proxy architecture). docs.litellm.ai live docs, 2026. https://docs.litellm.ai/docs/proxy/architecture. Accessed 2026-09-17. Cited in: Module 21, Module 22, Module 23, Module 24, Module 30, Module 31, Module 39.
  24. officialBerriAI / LiteLLM contributors. Virtual Keys. docs.litellm.ai live docs, 2026. https://docs.litellm.ai/docs/proxy/virtual_keys. Accessed 2026-09-18. Cited in: Module 21.
  25. officialCloudflare. AI Gateway. developers.cloudflare.com, live documentation, 2026. https://developers.cloudflare.com/ai-gateway/. Accessed 2026-09-18. Cited in: Module 21.
  26. officialCloudflare. Caching. AI Gateway features docs, live documentation, 2026. https://developers.cloudflare.com/ai-gateway/features/caching/. Accessed 2026-09-18. Cited in: Module 21.
  27. officialCloudflare. Content Delivery Network (CDN) Reference Architecture. Live documentation, 2026. https://developers.cloudflare.com/reference-architecture/cdn-reference-architecture. Accessed 2026-09-17. Cited in: Module 1, Module 2, Module 16, Module 21.
  28. officialCloudflare. Rate limiting (Cloudflare AI Gateway). developers.cloudflare.com, 2026. https://developers.cloudflare.com/ai-gateway/features/rate-limiting/. Accessed 2026-09-17. Cited in: Module 10, Module 21, Module 22.
  29. officialE2B. E2B Documentation. docs.e2b.dev, 2026. https://docs.e2b.dev/. Accessed 2026-09-18. Cited in: Module 27.
  30. officialE2B. E2B homepage. e2b.dev, 2026. https://e2b.dev/. Accessed 2026-09-18. Cited in: Module 27.
  31. officialEnvoy AI Gateway project (rebranded "Agent Router" in v0.1 docs). Usage-based Rate Limiting. v0.1 docs, 2026. https://aigateway.envoyproxy.io/docs/0.1/capabilities/usage-based-ratelimiting/. Accessed 2026-09-17. Cited in: Module 21, Module 22, Module 23, Module 24, Module 31, Module 39.
  32. officialEnvoy Proxy project. External Processing Filter (ext_proc). envoyproxy.io, latest docs, 2026. https://www.envoyproxy.io/docs/envoy/latest/configuration/http/http_filters/ext_proc_filter. Accessed 2026-09-18. Cited in: Module 21.
  33. officialEricsson AB / Erlang OTP team. Processes. Erlang System Documentation, erlang.org. https://www.erlang.org/doc/system/eff_guide_processes.html. Accessed 2026-09-17. Cited in: Module 17.
  34. officialFreeBSD Foundation. Maintaining the World's Fastest Content Delivery Network at Netflix on FreeBSD. Case study, 2024, quoting Gleb Smirnoff (FreeBSD Vendor Summit, November 2023) and Drew Gallatin (OpenFest Bulgaria, November 2023). https://freebsdfoundation.org/wp-content/uploads/2024/05/netflix-CASE-STUDY-1.pdf. Accessed 2026-09-17. Cited in: Module 14.
  35. officialGoogle / gVisor project. Introduction to gVisor security (architecture guide). gvisor.dev docs, 2026. https://gvisor.dev/docs/architecture_guide/intro/. Accessed 2026-09-18. Cited in: Module 27.
  36. officialGoogle Search Central. In-Depth Guide to How Google Search Works. Live documentation, 2026. https://developers.google.com/search/docs/fundamentals/how-search-works. Accessed 2026-09-17. Cited in: Module 12.
  37. officialGoogle. Introduction to GGC. Google Interconnect Help, support.google.com, 2026. https://support.google.com/interconnect/answer/9058809. Accessed 2026-09-17. Cited in: Module 13.
  38. officialH3 Project (Uber Technologies, Inc.). H3Index Representation / Bit layout of H3Index. h3geo.org documentation, v4.x. https://h3geo.org/docs/core-library/h3Indexing/. Accessed 2026-09-17. Cited in: Module 19.
  39. officialH3 Project (Uber Technologies, Inc.). Tables of Cell Statistics Across Resolutions. h3geo.org documentation, v4.x. https://h3geo.org/docs/core-library/restable/. Accessed 2026-09-17. Cited in: Module 19.
  40. officialHazelcast. Building a Cache with MapStore and Configuring a MapStore. Hazelcast Documentation, v5.7, live documentation. https://docs.hazelcast.com/hazelcast/5.7/mapstore/configuration-guide. Accessed 2026-09-17. Cited in: Module 2.
  41. officialIstio contributors. Istio / Concepts / Security. istio.io documentation, 2026. https://istio.io/latest/docs/concepts/security/. Accessed 2026-09-17. Cited in: Module 10.
  42. officialKerrisk, Michael. pthread_create(3) — Linux manual page. man7.org, Linux man-pages project. https://man7.org/linux/man-pages/man3/pthread_create.3.html. Accessed 2026-09-17. Cited in: Module 17.
  43. officialKleppmann, M. Designing Data-Intensive Applications [1st edition]. martin.kleppmann.com, O'Reilly Media, 2017-03-27. https://martin.kleppmann.com/2017/03/27/designing-data-intensive-applications.html. Accessed 2026-09-18. Cited in: Module 39.
  44. officialKleppmann, M., Riccomini, C. Designing Data-Intensive Applications, 2nd Edition [author's own publication page]. martin.kleppmann.com, O'Reilly Media, 2026-03-24. https://martin.kleppmann.com/2026/03/24/designing-data-intensive-applications-2e.html. Accessed 2026-09-18. Cited in: Module 39.
  45. officialKong Inc. Kong AI Gateway. developer.konghq.com, live docs, 2026. https://developer.konghq.com/ai-gateway/. Accessed 2026-09-18. Cited in: Module 21.
  46. officialkubernetes-sigs contributors (Red Hat, Google Cloud, IBM Research, CoreWeave, NVIDIA). Introduction (Kubernetes Gateway API Inference Extension). Kubernetes SIGs, live docs, 2026. https://gateway-api-inference-extension.sigs.k8s.io/. Accessed 2026-09-17. Cited in: Module 21, Module 24, Module 25.
  47. officialKubernetes. Pod Lifecycle. kubernetes.io documentation, live docs, 2026. https://kubernetes.io/docs/concepts/workloads/pods/pod-lifecycle/. Accessed 2026-09-18. Cited in: Module 25.
  48. officialMetronome. Get the net balance of a customer. API reference. https://docs.metronome.com/api-reference/credits-and-commits/get-the-net-balance-of-a-customer. Accessed 2026-09-18. Cited in: Module 23.
  49. officialMetronome. How Metronome works. Live documentation. https://docs.metronome.com/guides/get-started/how-metronome-works. Accessed 2026-09-17. Cited in: Module 18.
  50. officialMicrosoft. AI gateway capabilities in Azure API Management. Microsoft Learn, updated 2026-06-25. https://learn.microsoft.com/en-us/azure/api-management/genai-gateway-capabilities. Accessed 2026-09-18. Cited in: Module 21.
  51. officialMicrosoft. Cache-Aside pattern. Azure Architecture Center, Microsoft Learn, updated 2025-12-09. https://learn.microsoft.com/en-us/azure/architecture/patterns/cache-aside. Accessed 2026-09-17. Cited in: Module 2.
  52. officialModal. Networking and security. Modal Docs, 2026. https://modal.com/docs/guide/sandbox-networking. Accessed 2026-09-18. Cited in: Module 27.
  53. officialModal. Sandboxes. Modal Docs, 2026. https://modal.com/docs/guide/sandboxes. Accessed 2026-09-18. Cited in: Module 27.
  54. officialModal. VM Sandboxes. Modal Docs, 2026. https://modal.com/docs/guide/vm-sandboxes. Accessed 2026-09-18. Cited in: Module 27.
  55. officialNetflix Open Connect Partner Help Center. Fill patterns. https://openconnect.zendesk.com/hc/en-us/articles/360035618071-Fill-patterns. Accessed 2026-09-17. Cited in: Module 14.
  56. officialNetflix, Inc. Open Connect Appliances. Live documentation. https://openconnect.netflix.com/en/appliances/. Accessed 2026-09-17. Cited in: Module 14.
  57. officialNetflix, Inc. Open Connect Overview. PDF, © 2016, 2019, 2026. https://openconnect.netflix.com/Open-Connect-Overview.pdf. Accessed 2026-09-17. Cited in: Module 14.
  58. officialNGINX (F5). Reverse Proxy. NGINX Admin Guide, docs.nginx.com, 2026. https://docs.nginx.com/nginx/admin-guide/web-server/reverse-proxy/. Accessed 2026-09-17. Cited in: Module 1.
  59. officialNGINX (F5). Terminating SSL/HTTPS. NGINX Admin Guide (Security Controls), docs.nginx.com, 2026. https://docs.nginx.com/nginx/admin-guide/security-controls/terminating-ssl-http/. Accessed 2026-09-17. Cited in: Module 1.
  60. officialNGINX. Module ngx_http_upstream_module. nginx.org documentation, 2026. https://nginx.org/en/docs/http/ngx_http_upstream_module.html. Accessed 2026-09-17. Cited in: Module 1.
  61. officialNGINX. Using nginx as HTTP load balancer. nginx.org documentation, 2026. https://nginx.org/en/docs/http/load_balancing.html. Accessed 2026-09-17. Cited in: Module 1, Module 16, Module 21.
  62. officialNVIDIA. Async GRPO. NeMo-RL documentation, docs.nvidia.com, 2026. https://docs.nvidia.com/nemo/rl/latest/guides/async-grpo.html. Accessed 2026-09-18. Cited in: Module 38.
  63. officialNVIDIA. Metrics Reference, AIPerf documentation. https://docs.nvidia.com/aiperf/reference/ai-perf-metrics-reference. Accessed 2026-09-18. Cited in: Module 30.
  64. officialOpenAI. Agent approvals & security. Codex docs, 2026. https://learn.chatgpt.com/docs/agent-approvals-security (redirected from developers.openai.com/codex/agent-approvals-security). Accessed 2026-09-18. Cited in: Module 27.
  65. officialOpenAI. Background mode (OpenAI API). Live documentation. https://developers.openai.com/api/docs/guides/background. Accessed 2026-09-18. Cited in: Module 26.
  66. officialOpenAI. Chat Completions streaming events. API reference, live documentation. https://developers.openai.com/api/reference/resources/chat/subresources/completions/streaming-events. Accessed 2026-09-18. Cited in: Module 23.
  67. officialOpenAI. Code Interpreter. OpenAI API docs, 2026. https://developers.openai.com/api/docs/guides/tools-code-interpreter. Accessed 2026-09-18. Cited in: Module 27.
  68. officialOpenAI. Moderation (API guide). Live documentation. https://developers.openai.com/api/docs/guides/moderation. Accessed 2026-09-18. Cited in: Module 29.
  69. officialOpenAI. Preparedness Framework. Version 2, last updated 15 April 2025. https://cdn.openai.com/pdf/18a02b5d-6b67-4cec-ab64-68cdfbddebcd/preparedness-framework-v2.pdf. Accessed 2026-09-18. Cited in: Module 29.
  70. officialOpenAI. Pricing. OpenAI API docs, 2026. https://developers.openai.com/api/docs/pricing. Accessed 2026-09-18. Cited in: Module 27.
  71. officialOpenAI. Prompt caching (OpenAI API). Live documentation. https://developers.openai.com/api/docs/guides/prompt-caching. Accessed 2026-09-17. Cited in: Module 28.
  72. officialOpenAI. Rate limits (OpenAI API). developers.openai.com documentation, 2026. https://developers.openai.com/api/docs/guides/rate-limits. Accessed 2026-09-17. Cited in: Module 22, Module 28.
  73. officialOpenAI. Realtime API. Live documentation. https://developers.openai.com/api/docs/guides/realtime. Accessed 2026-09-18. Cited in: Module 26.
  74. officialOpenAI. Streaming API responses (Responses API guide). Live documentation. https://developers.openai.com/api/docs/guides/streaming-responses. Accessed 2026-09-18. Cited in: Module 26, Module 29.
  75. officialOpenRouter. API Streaming (stream cancellation reference). Live documentation. https://openrouter.ai/docs/api-reference/streaming. Accessed 2026-09-18. Cited in: Module 23, Module 26.
  76. officialOracle / MySQL. MySQL 8.0 Reference Manual: 10.12.3.1 How MySQL Uses Memory. 2026. https://dev.mysql.com/doc/refman/8.0/en/memory-use.html. Accessed 2026-09-17. Cited in: Module 13.
  77. officialOracle / MySQL. MySQL Bugs: Bug #71045, wrong default value displayed for "thread_stack" option on 64-bit OS. bugs.mysql.com, 2026. https://bugs.mysql.com/bug.php?id=71045. Accessed 2026-09-17. Cited in: Module 13.
  78. officialPortkey. Virtual Keys. portkey.ai/docs, live docs, 2026. https://portkey.ai/docs/product/ai-gateway/virtual-keys. Accessed 2026-09-18. Cited in: Module 21.
  79. officialPostgreSQL Global Development Group. PostgreSQL 18 Documentation, §13.2 Transaction Isolation. Live documentation. https://www.postgresql.org/docs/current/transaction-iso.html. Accessed 2026-09-17. Cited in: Module 4.
  80. officialprinciplesofchaos.org (Netflix Chaos Team and community). Principles of Chaos Engineering. v1, 2019. https://principlesofchaos.org/. Accessed 2026-09-17. Cited in: Module 11, Module 15.
  81. officialRabbitMQ. AMQP 0-9-1 Model Explained. Live documentation. https://www.rabbitmq.com/tutorials/amqp-concepts. Accessed 2026-09-17. Cited in: Module 8.
  82. officialSchedMD. Slurm Workload Manager Overview. Live documentation. https://slurm.schedmd.com/overview.html. Accessed 2026-09-17. Cited in: Module 34, Module 38.
  83. officialSkyRL documentation. Async Training (one-step-off). docs.skyrl.ai, 2026. https://docs.skyrl.ai/docs/tutorials/one_step_off_async. Accessed 2026-09-18. Cited in: Module 38.
  84. officialSkyRL documentation. System Overview. docs.skyrl.ai, 2026. https://docs.skyrl.ai/docs/getting-started/overview. Accessed 2026-09-18. Cited in: Module 38.
  85. officialStripe. Best practices for preventing fraud. Live documentation. https://docs.stripe.com/disputes/prevention/best-practices. Accessed 2026-09-18. Cited in: Module 23.
  86. officialStripe. How Metronome works with Stripe. Live documentation. https://docs.stripe.com/billing/how-metronome-works-with-stripe. Accessed 2026-09-17. Cited in: Module 18.
  87. officialStripe. Idempotent requests. API reference, live documentation. https://docs.stripe.com/api/idempotent_requests. Accessed 2026-09-17. Cited in: Module 8, Module 18.
  88. officialStripe. Place a hold on a payment method. Live documentation. https://docs.stripe.com/payments/place-a-hold-on-a-payment-method. Accessed 2026-09-18. Cited in: Module 23.
  89. officialStripe. Rate limits. Live documentation. https://docs.stripe.com/rate-limits. Accessed 2026-09-17. Cited in: Module 18.
  90. officialStripe. Receive Stripe events in your webhook endpoint. Live documentation. https://docs.stripe.com/webhooks. Accessed 2026-09-17. Cited in: Module 18.
  91. officialStripe. Usage-based billing. Live documentation. https://docs.stripe.com/billing/usage-based. Accessed 2026-09-17. Cited in: Module 18, Module 23.
  92. officialThe Apache Software Foundation. DataStream API — Anatomy of a Flink Program. Apache Flink 1.19 docs. https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/dev/datastream/overview/. Accessed 2026-09-17. Cited in: Module 9.
  93. officialThe Apache Software Foundation. Structured Streaming Programming Guide. Apache Spark v3.5.6 docs. https://spark.apache.org/docs/3.5.6/structured-streaming-programming-guide.html. Accessed 2026-09-17. Cited in: Module 9.
  94. officialverl documentation. Recipe: Fully Async Policy Trainer. verl.readthedocs.io, 2026. https://verl.readthedocs.io/en/latest/advance/fully_async.html. Accessed 2026-09-18. Cited in: Module 38.
  95. officialverl documentation. Recipe: One Step Off Policy Async Trainer. verl.readthedocs.io, 2026. https://verl.readthedocs.io/en/latest/advance/one_step_off.html. Accessed 2026-09-18. Cited in: Module 38.
  96. officialVitess contributors. Concepts: Keyspace. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/concepts/keyspace/. Accessed 2026-09-17. Cited in: Module 13.
  97. officialVitess contributors. Concepts: Shard. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/concepts/shard/. Accessed 2026-09-17. Cited in: Module 13.
  98. officialVitess contributors. Concepts: Tablet. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/concepts/tablet/. Accessed 2026-09-17. Cited in: Module 13.
  99. officialVitess contributors. Concepts: Topology Service. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/concepts/topology-service/. Accessed 2026-09-17. Cited in: Module 13.
  100. officialVitess contributors. Concepts: VSchema. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/concepts/vschema/. Accessed 2026-09-17. Cited in: Module 13.
  101. officialVitess contributors. Concepts: VTGate. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/concepts/vtgate/. Accessed 2026-09-17. Cited in: Module 13.
  102. officialVitess contributors. History. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/overview/history/. Accessed 2026-09-17. Cited in: Module 13.
  103. officialVitess contributors. Overview: Scalability Philosophy. Vitess documentation, v24.0, 2026. https://vitess.io/docs/24.0/overview/scalability-philosophy/. Accessed 2026-09-17. Cited in: Module 13.
  104. officialVitess contributors. What is Vitess?. Vitess (CNCF graduated project) documentation, 2026. https://vitess.io/docs/overview/whatisvitess/. Accessed 2026-09-17. Cited in: Module 10, Module 13, Module 17.
  105. officialWebAssembly Community Group. Security. webassembly.org docs, 2026. https://webassembly.org/docs/security/. Accessed 2026-09-18. Cited in: Module 27.
  106. officialYouTube. Press. blog.youtube, 2026. https://blog.youtube/press/. Accessed 2026-09-17. Cited in: Module 13.
  107. standardIETF. RFC 5861: HTTP Cache-Control Extensions for Stale Content. M. Nottingham, 2010. https://www.rfc-editor.org/rfc/rfc5861.html. Accessed 2026-09-17. Cited in: Module 2.
  108. standardIETF. RFC 8446: The Transport Layer Security (TLS) Protocol Version 1.3. 2018. https://datatracker.ietf.org/doc/html/rfc8446. Accessed 2026-09-17. Cited in: Module 1.
  109. standardIETF. RFC 9111: HTTP Caching. R. Fielding, M. Nottingham, J. Reschke, eds., 2022. https://www.rfc-editor.org/rfc/rfc9111.html. Accessed 2026-09-17. Cited in: Module 2.
  110. standardIETF. RFC 9293: Transmission Control Protocol (TCP). 2022. https://datatracker.ietf.org/doc/html/rfc9293. Accessed 2026-09-17. Cited in: Module 1.
  111. standardLinux man-pages project. sendfile(2). https://man7.org/linux/man-pages/man2/sendfile.2.html. Accessed 2026-09-17. Cited in: Module 8.
  112. standardOpenTelemetry. Semantic Conventions for Generative AI Metrics. semantic-conventions-genai repository, docs/gen-ai/gen-ai-metrics.md. https://github.com/open-telemetry/semantic-conventions-genai/blob/main/docs/gen-ai/gen-ai-metrics.md. Accessed 2026-09-18. Cited in: Module 30.
  113. standardOpenTelemetry. Semantic Conventions for Generative AI Systems (spans). semantic-conventions-genai repository, docs/gen-ai/gen-ai-spans.md. https://github.com/open-telemetry/semantic-conventions-genai/blob/main/docs/gen-ai/gen-ai-spans.md. Accessed 2026-09-18. Cited in: Module 30.
  114. standardPantos, R., May, W. RFC 8216: HTTP Live Streaming. IETF, August 2017. https://www.rfc-editor.org/rfc/rfc8216. Accessed 2026-09-17. Cited in: Module 13.
  115. standardW3C. Trace Context. W3C Recommendation. https://www.w3.org/TR/trace-context/. Accessed 2026-09-18. Cited in: Module 30.
  116. standardWHATWG. HTML Living Standard — §9.2 Server-sent events. Living standard. https://html.spec.whatwg.org/multipage/server-sent-events.html. Accessed 2026-09-18. Cited in: Module 26.
  117. paperAbadi, D.J. Consistency Tradeoffs in Modern Distributed Database System Design: CAP is Only Part of the Story. IEEE Computer 45(2), February 2012, pp. 37-42. http://www.cs.umd.edu/~abadi/papers/abadi-pacelc.pdf. Accessed 2026-09-17. Cited in: Module 5.
  118. paperAgache, A., Brooker, M., Florescu, A., Iordache, A., Liguori, A., Neugebauer, R., Piwonka, P., Popa, D-M. Firecracker: Lightweight Virtualization for Serverless Applications. 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI '20), 2020, pp. 419-434. https://www.usenix.org/system/files/nsdi20-paper-agache.pdf. Accessed 2026-09-18. Cited in: Module 27.
  119. paperBarroso, L.A., Dean, J. & Hölzle, U. Web Search for a Planet: The Google Cluster Architecture. IEEE Micro, vol. 23, no. 2, March-April 2003, pp. 22-28. https://barroso.org/publications/ieeemicro_google.pdf. Accessed 2026-09-17. Cited in: Module 12.
  120. paperBerenson, H., Bernstein, P., Gray, J., Melton, J., O'Neil, E., O'Neil, P. A Critique of ANSI SQL Isolation Levels. ACM SIGMOD 1995 / Microsoft Research Technical Report MSR-TR-95-51. https://arxiv.org/abs/cs/0701157. Accessed 2026-09-17. Cited in: Module 4.
  121. paperBrewer, E. CAP Twelve Years Later: How the "Rules" Have Changed. IEEE Computer 45(2), February 2012, pp. 23-29. https://sites.cs.ucsb.edu/~rich/class/cs293b-cloud/papers/brewer-cap.pdf. Accessed 2026-09-17. Cited in: Module 5.
  122. paperBrin, S. & Page, L. The Anatomy of a Large-Scale Hypertextual Web Search Engine. Computer Networks and ISDN Systems, vol. 30, 1998, pp. 107-117. http://infolab.stanford.edu/pub/papers/google.pdf. Accessed 2026-09-17. Cited in: Module 12.
  123. paperBurrows, M. The Chubby Lock Service for Loosely-Coupled Distributed Systems. Google, OSDI 2006. https://static.googleusercontent.com/media/research.google.com/en//archive/chubby-osdi06.pdf. Accessed 2026-09-17. Cited in: Module 6.
  124. paperChang, F. et al. Bigtable: A Distributed Storage System for Structured Data. Proceedings of OSDI '06, 2006. https://www.usenix.org/legacy/event/osdi06/tech/chang/chang.pdf. Accessed 2026-09-17. Cited in: Module 2, Module 3, Module 4, Module 5, Module 6, Module 7, Module 12.
  125. paperCooper, B.F., Ramakrishnan, R., Srivastava, U., Silberstein, A., Bohannon, P., Jacobsen, H.A., Puz, N., Weaver, D., Yerneni, R. PNUTS: Yahoo!'s Hosted Data Serving Platform. Proceedings of the VLDB Endowment 1(2), VLDB 2008, pp. 1277-1288. https://people.mpi-sws.org/~druschel/courses/ds/papers/cooper-pnuts.pdf. Accessed 2026-09-17. Cited in: Module 5.
  126. paperCorbett, J.C., Dean, J., Epstein, M., et al. Spanner: Google's Globally-Distributed Database. OSDI '12, 2012. https://research.google.com/archive/spanner-osdi2012.pdf. Accessed 2026-09-17. Cited in: Module 3, Module 4, Module 5, Module 6, Module 12, Module 13, Module 17, Module 20, Module 39.
  127. paperCovington, P., Adams, J., Sargin, E. Deep Neural Networks for YouTube Recommendations. Proceedings of the 10th ACM Conference on Recommender Systems (RecSys '16), 2016. https://doi.org/10.1145/2959100.2959190. Accessed 2026-09-17. Cited in: Module 13.
  128. paperDas, A., Gupta, I., Motivala, A. SWIM: Scalable Weakly-consistent Infection-style Process Group Membership Protocol. Proceedings of the International Conference on Dependable Systems and Networks (DSN), 2002. https://www.cs.cornell.edu/projects/Quicksilver/public_pdfs/SWIM.pdf. Accessed 2026-09-17. Cited in: Module 19.
  129. paperDean, J., Ghemawat, S. MapReduce: Simplified Data Processing on Large Clusters. OSDI 2004. https://research.google.com/archive/mapreduce-osdi04.pdf. Accessed 2026-09-17. Cited in: Module 9.
  130. paperDeCandia, G., Hastorun, D., Jampani, M., et al. Dynamo: Amazon's Highly Available Key-value Store. SOSP '07, 2007. https://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf. Accessed 2026-09-17. Cited in: Module 3, Module 4, Module 5, Module 11, Module 17, Module 20, Module 39.
  131. paperFu, W., Gao, J., Shen, X., Zhu, C., Mei, Z., He, C., Xu, S., Wei, G., Mei, J., Wang, J., Yang, T., Yuan, B., Wu, Y. AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning. arXiv:2505.24298, 2025 (v2, 2026). https://arxiv.org/abs/2505.24298. Accessed 2026-09-18. Cited in: Module 38.
  132. paperGarcia-Molina, H., Salem, K. Sagas. Proceedings of the 1987 ACM SIGMOD International Conference on Management of Data, pp. 249-259. https://www.cs.princeton.edu/techreports/1987/070.pdf. Accessed 2026-09-17. Cited in: Module 18.
  133. paperGhemawat, S., Gobioff, H., Leung, S-T. The Google File System. SOSP '03, 2003. https://research.google.com/archive/gfs-sosp2003.pdf. Accessed 2026-09-17. Cited in: Module 3, Module 6, Module 7, Module 12, Module 33.
  134. paperGilbert, S., Lynch, N. Brewer's Conjecture and the Feasibility of Consistent, Available, Partition-Tolerant Web Services. ACM SIGACT News 33(2), June 2002, pp. 51-59. https://www.cs.princeton.edu/courses/archive/spr22/cos418/papers/cap.pdf. Accessed 2026-09-17. Cited in: Module 5.
  135. paperGray, J., Lamport, L. Consensus on Transaction Commit. Microsoft Research Technical Report MSR-TR-2003-96, published in ACM Transactions on Database Systems 31(1), 2006. https://lamport.azurewebsites.net/video/consensus-on-transaction-commit.pdf. Accessed 2026-09-17. Cited in: Module 4.
  136. paperHaldar, Malay, Mustafa Abdool, Prashant Ramanathan, Tao Xu, Shulin Yang, Huizhong Duan, Qing Zhang, Nick Barrow-Williams, Bradley C. Turnbull, Brendan M. Collins, and Thomas Legrand. Applying Deep Learning To Airbnb Search. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD '19), pp. 1927-1935; arXiv:1810.09591v2. https://arxiv.org/abs/1810.09591. Accessed 2026-09-17. Cited in: Module 20.
  137. paperHaldar, Malay, Prashant Ramanathan, Tyler Sax, Mustafa Abdool, Lanbo Zhang, Aamir Mansawala, Shulin Yang, Bradley Turnbull, and Junshuo Liao. Improving Deep Learning For Airbnb Search. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD 2020); arXiv:2002.05515v1. https://arxiv.org/abs/2002.05515. Accessed 2026-09-17. Cited in: Module 20.
  138. paperHerlihy, M.P., Wing, J.M. Linearizability: A Correctness Condition for Concurrent Objects. ACM Transactions on Programming Languages and Systems 12(3), July 1990, pp. 463-492. https://cs.brown.edu/people/mph/HerlihyW90/p463-herlihy.pdf. Accessed 2026-09-17. Cited in: Module 5.
  139. paperHu, J., Wu, X., Shen, W., Liu, J. K., Zhu, Z., Wang, W., Jiang, S., Wang, H., Chen, H., Chen, B., Fang, W., Xianyu, Cao, Y., Xu, H., Liu, Y. OpenRLHF: An Easy-to-use, Scalable and High-performance RLHF Framework. arXiv:2405.11143v6, 2025. https://arxiv.org/abs/2405.11143. Accessed 2026-09-18. Cited in: Module 36, Module 37.
  140. paperHunt, P., Konar, M., Junqueira, F.P., Reed, B. ZooKeeper: Wait-free Coordination for Internet-scale Systems. USENIX ATC 2010. https://www.usenix.org/legacy/event/atc10/tech/full_papers/Hunt.pdf. Accessed 2026-09-17. Cited in: Module 5, Module 6, Module 19.
  141. paperJeon, Myeongjae, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, Fan Yang. Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloads. USENIX ATC '19. https://www.usenix.org/system/files/atc19-jeon.pdf. Accessed 2026-09-18. Cited in: Module 34.
  142. paperJiang, Z., Lin, H., Zhong, Y., et al. MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs. 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI '24), 2024, pp. 745-760. https://www.usenix.org/system/files/nsdi24-jiang-ziheng.pdf. Accessed 2026-09-17. Cited in: Module 33, Module 35.
  143. paperKreps, J., Narkhede, N., Rao, J. Kafka: a Distributed Messaging System for Log Processing. LinkedIn, NetDB '11 workshop, 2011. https://notes.stephenholiday.com/Kafka.pdf. Accessed 2026-09-17. Cited in: Module 8, Module 17.
  144. paperKwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J. E., Zhang, H., Stoica, I. Efficient Memory Management for Large Language Model Serving with PagedAttention. SOSP 2023. arXiv:2309.06180. https://arxiv.org/abs/2309.06180. Accessed 2026-09-18. Cited in: Module 36, Module 37.
  145. paperLlama Team, Meta AI. The Llama 3 Herd of Models. arXiv:2407.21783, 2024. https://arxiv.org/abs/2407.21783. Accessed 2026-09-17. Cited in: Module 35, Module 36, Module 39.
  146. paperLlama Team, Meta AI. The Llama 3 Herd of Models. arXiv:2407.21783, 2024. https://arxiv.org/pdf/2407.21783. Accessed 2026-09-17. Cited in: Module 7, Module 32, Module 33, Module 34.
  147. paperNarayanan, A., Shmatikov, V. Robust De-anonymization of Large Sparse Datasets (How to Break Anonymity of the Netflix Prize Dataset). IEEE Symposium on Security and Privacy, 2008. https://arxiv.org/abs/cs/0610105. Accessed 2026-09-18. Cited in: Module 30.
  148. paperNishtala, R. et al. Scaling Memcache at Facebook. Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI '13), pp. 385–398, 2013. https://www.usenix.org/system/files/conference/nsdi13/nsdi13-final170_update.pdf. Accessed 2026-09-17. Cited in: Module 2.
  149. paperO'Neil, P., Cheng, E., Gawlick, D., O'Neil, E. The Log-Structured Merge-Tree (LSM-Tree). Acta Informatica, 1996. https://www.cs.umb.edu/~poneil/lsmtree.pdf. Accessed 2026-09-17. Cited in: Module 4.
  150. paperOngaro, D., Ousterhout, J. In Search of an Understandable Consensus Algorithm (Extended Version). Stanford University, 2014. https://raft.github.io/raft.pdf. Accessed 2026-09-17. Cited in: Module 6, Module 12.
  151. paperOsborn, Barclay, Justin McWilliams, Betsy Beyer, and Max Saltonstall. BeyondCorp: Design to Deployment at Google. USENIX ;login:, vol. 41, no. 1, Spring 2016, pp. 28-33. https://research.google.com/pubs/archive/44860.pdf. Accessed 2026-09-17. Cited in: Module 10, Module 22.
  152. paperPan, S., Stavrinos, T., Zhang, Y., et al. Facebook's Tectonic Filesystem: Efficiency from Exascale. 19th USENIX Conference on File and Storage Technologies (FAST '21), 2021, pp. 217-231. https://www.usenix.org/system/files/fast21-pan.pdf. Accessed 2026-09-17. Cited in: Module 7.
  153. paperPang, Ruoming et al. Zanzibar: Google's Consistent, Global Authorization System. USENIX ATC '19. https://www.usenix.org/system/files/atc19-pang.pdf. Accessed 2026-09-17. Cited in: Module 10, Module 13, Module 22.
  154. paperPenedo, G., Kydlíček, H., Ben Allal, L., Lozhkov, A., Mitchell, M., Raffel, C., Von Werra, L., Wolf, T. The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale. arXiv:2406.17557, 2024 (v2, Oct. 2024). https://arxiv.org/abs/2406.17557. Accessed 2026-09-18. Cited in: Module 32.
  155. paperPenedo, G., Malartic, Q., Hesslow, D., Cojocaru, R., Cappelli, A., Alobeidli, H., Pannier, B., Almazrouei, E., Launay, J. The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only. arXiv:2306.01116, 2023. https://arxiv.org/abs/2306.01116. Accessed 2026-09-18. Cited in: Module 32.
  156. paperPeng, D. & Dabek, F. Large-scale Incremental Processing Using Distributed Transactions and Notifications. OSDI 2010. https://www.usenix.org/legacy/event/osdi10/tech/full_papers/Peng.pdf. Accessed 2026-09-17. Cited in: Module 12.
  157. paperSheng, G., Zhang, C., Ye, Z., Wu, X., Zhang, W., Zhang, R., Peng, Y., Lin, H., Wu, C. HybridFlow: A Flexible and Efficient RLHF Framework. arXiv:2409.19256, EuroSys '25, 2024. https://arxiv.org/pdf/2409.19256. Accessed 2026-09-17. Cited in: Module 37, Module 38, Module 39.
  158. paperSheng, G., Zhang, C., Ye, Z., Wu, X., Zhang, W., Zhang, R., Peng, Y., Lin, H., Wu, C. HybridFlow: A Flexible and Efficient RLHF Framework. arXiv:2409.19256; EuroSys '25. 2024/2025. https://arxiv.org/abs/2409.19256. Accessed 2026-09-18. Cited in: Module 36.
  159. paperStewart, R., Long, S. (Netflix, Inc.). Improving High–Bandwidth TLS in the FreeBSD Kernel. AsiaBSDCon 2016. https://openconnect.netflix.com/publications/asiabsd_tls_improved.pdf. Accessed 2026-09-17. Cited in: Module 14.
  160. paperVerma, A., Pedrosa, L., Korupolu, M., Oppenheimer, D., Tune, E., Wilkes, J. Large-scale cluster management at Google with Borg. EuroSys '15. https://research.google.com/pubs/archive/43438.pdf. Accessed 2026-09-17. Cited in: Module 24.
  161. paperVerma, Abhishek et al. Large-scale cluster management at Google with Borg. EuroSys '15. https://research.google.com/pubs/archive/43438.pdf. Accessed 2026-09-17. Cited in: Module 10, Module 11, Module 12, Module 20, Module 25, Module 27, Module 31, Module 34, Module 35, Module 39.
  162. paperYu, G.-I., Jeong, J. S., Kim, G.-W., Kim, S., Chun, B.-G. Orca: A Distributed Serving System for Transformer-Based Generative Models. 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22), 2022. https://www.usenix.org/conference/osdi22/presentation/yu. Accessed 2026-09-18. Cited in: Module 37.
  163. paperZaharia, M., Chowdhury, M., Das, T., Dave, A., Ma, J., McCauley, M., Franklin, M. J., Shenker, S., Stoica, I. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. USENIX NSDI 2012. https://www.usenix.org/system/files/conference/nsdi12/nsdi12-final138.pdf. Accessed 2026-09-17. Cited in: Module 9.
  164. textbookJones, C., Wilkes, J., Murphy, N., Smith, C. (ed. Beyer, B.) Site Reliability Engineering, Chapter 4: Service Level Objectives. Google / O'Reilly, 2016. https://sre.google/sre-book/service-level-objectives/. Accessed 2026-09-17. Cited in: Module 11, Module 30.
  165. textbookKleppmann, M., Riccomini, C. Designing Data-Intensive Applications. 2nd ed., O'Reilly Media, 2026. https://www.oreilly.com/library/view/designing-data-intensive-applications/9781098119058/. Accessed 2026-09-17. Cited in: Module 1, Module 2, Module 3, Module 5, Module 9, Module 39.
  166. repoinclusionAI (AReaL contributors). AReaL README. GitHub, main branch AReaL 2.0, 2026. https://github.com/inclusionAI/AReaL. Accessed 2026-09-17. Cited in: Module 37, Module 38, Module 39.
  167. repokubernetes-sigs/gateway-api-inference-extension contributors. Model Server Protocol (design proposal 003). GitHub repository, docs/proposals/003-model-server-protocol/README.md, main branch. https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/docs/proposals/003-model-server-protocol/README.md. Accessed 2026-09-18. Cited in: Module 25.
  168. repokubernetes-sigs/gateway-api-inference-extension. Release v1.3.0. GitHub releases, published 2026-01-21. https://github.com/kubernetes-sigs/gateway-api-inference-extension/releases/tag/v1.3.0. Accessed 2026-09-18. Cited in: Module 25.
  169. repoNetflix. concurrency-limits GitHub repository. https://github.com/Netflix/concurrency-limits. Accessed 2026-09-17. Cited in: Module 11.
  170. repoNetflix. Hystrix README (project status). https://github.com/Netflix/Hystrix. Accessed 2026-09-17. Cited in: Module 11.
  171. repoNetflix. Hystrix Wiki: Configuration. v1.5.18. https://github.com/Netflix/Hystrix/wiki/Configuration. Accessed 2026-09-17. Cited in: Module 11.
  172. repoNetflix. Hystrix Wiki: How it Works. v1.5.18. https://github.com/Netflix/Hystrix/wiki/How-it-Works. Accessed 2026-09-17. Cited in: Module 11, Module 15.
  173. repoNovaSky-AI. SkyRL README. GitHub, main branch, 2026. https://github.com/NovaSky-AI/SkyRL. Accessed 2026-09-17. Cited in: Module 38.
  174. repoNVIDIA NeMo team. NVIDIA-NeMo/RL README. GitHub, main branch, 2026. https://github.com/NVIDIA-NeMo/RL. Accessed 2026-09-17. Cited in: Module 37, Module 38.
  175. repoOpenRLHF contributors. OpenRLHF README. GitHub, 2026. https://github.com/OpenRLHF/OpenRLHF. Accessed 2026-09-17. Cited in: Module 36, Module 37, Module 38.
  176. repoStripe. stripe-node repository, RequestSender.ts and stripe.core.ts. https://github.com/stripe/stripe-node. Accessed 2026-09-17. Cited in: Module 18.
  177. repoTHUDM. slime README. GitHub, main branch, 2026. https://github.com/THUDM/slime. Accessed 2026-09-17 (architecture and production-usage facts); re-accessed 2026-09-18 (fully_async example, SGLang argument passthrough). Cited in: Module 38.
  178. repoUber Technologies, Inc. h3lib/include/h3Index.h. GitHub, uber/h3, master branch. https://github.com/uber/h3/blob/master/src/h3lib/include/h3Index.h. Accessed 2026-09-17. Cited in: Module 19.
  179. repoverl contributors (ByteDance Seed / HKU). volcengine/verl README. GitHub, main branch, 2026. https://github.com/volcengine/verl. Accessed 2026-09-17. Cited in: Module 37, Module 38.
  180. talkBattey, R., Gupta, S. Training LLaMA: A Storage Perspective. @Scale Conference, 2024-06-17. https://atscaleconference.com/videos/training-llama-a-storage-perspective/. Accessed 2026-09-17. Cited in: Module 33.
  181. talkDean, J. Challenges in Building Large-Scale Information Retrieval Systems. WSDM 2009 keynote. https://research.google.com/people/jeff/WSDM09-keynote.pdf. Accessed 2026-09-17. Cited in: Module 12.
  182. talkKrikorian, Raffi. Timelines at Scale. QCon San Francisco 2012, recorded/published by InfoQ 2013-04-03. https://www.infoq.com/presentations/Twitter-Timeline-Scalability. Accessed 2026-09-17. Cited in: Module 17.
  183. talkVolmer, T. Google Global Cache - Enabling Content. Google Edge lead, EMEA. AfPIF (Africa Peering and Interconnection Forum) 2017, Abidjan. https://www.afpif.org/wp-content/uploads/2017/10/06_Google-Global-Cache-Enabler-2017.pdf. Accessed 2026-09-17. Cited in: Module 13.
  184. blogAaron, A., Li, Z., Manohara, M., De Cock, J., Ronca, D. (Netflix Technology Blog). Per-Title Encode Optimization. 2015-12-14. https://netflixtechblog.com/per-title-encode-optimization-7e99442b62a2. Accessed 2026-09-17. Cited in: Module 14.
  185. blogAbadi, D.J. Problems with CAP, and Yahoo's little known NoSQL system. DBMS Musings, 23 Apr 2010. http://dbmsmusings.blogspot.com/2010/04/problems-with-cap-and-yahoos-little.html. Accessed 2026-09-17. Cited in: Module 5, Module 39.
  186. blogAmatriain, X., Basilico, J. (Netflix). System Architectures for Personalization and Recommendation. Netflix Technology Blog, 27 Mar 2013. https://netflixtechblog.com/system-architectures-for-personalization-and-recommendation-e081aa94b5d8. Accessed 2026-09-17 (retrieved via an archived mirror of the Netflix Technology Blog's Medium-hosted publication for full article text). Cited in: Module 15.
  187. blogAmazon Web Services (Builders' Library). Caching Challenges and Strategies. Live documentation, n.d. https://aws.amazon.com/builders-library/caching-challenges-and-strategies/. Accessed 2026-09-17. Cited in: Module 2.
  188. blogAnthropic. Building safeguards for Claude. anthropic.com/news, 2025. https://www.anthropic.com/news/building-safeguards-for-claude. Accessed 2026-09-18. Cited in: Module 29.
  189. blogAnthropic. Clio: Privacy-preserving insights into real-world AI use. anthropic.com/research, 2024. https://www.anthropic.com/research/clio. Accessed 2026-09-18. Cited in: Module 29, Module 30.
  190. blogBarr, J. Amazon S3 Update: Strong Read-After-Write Consistency. AWS News Blog, 2020-12-01. https://aws.amazon.com/blogs/aws/amazon-s3-update-strong-read-after-write-consistency/. Accessed 2026-09-17. Cited in: Module 7.
  191. blogBrooker, M. Timeouts, retries, and backoff with jitter. The Amazon Builders' Library, Amazon Web Services. https://web.archive.org/web/20231225054225/https://aws.amazon.com/builders-library/timeouts-retries-and-backoff-with-jitter/ (Wayback Machine capture of the original article, whose live URL now redirects to builder.aws.com). Accessed 2026-09-17. Cited in: Module 11.
  192. blogChew, J., Khisti, N. Avoiding Double Payments in a Distributed Payments System. The Airbnb Tech Blog, 2019-04-16. https://medium.com/airbnb-engineering/avoiding-double-payments-in-a-distributed-payments-system-2981f6b070bb. Accessed 2026-09-17. Cited in: Module 18, Module 20.
  193. blogChristensen, B. (Netflix). Fault Tolerance in a High Volume, Distributed System. Netflix Technology Blog, 29 Feb 2012. https://netflixtechblog.com/fault-tolerance-in-a-high-volume-distributed-system-91ab4faae74a. Accessed 2026-09-17 (retrieved via an archived mirror of the Netflix Technology Blog's Medium-hosted publication after the live page returned an automated-access block). Cited in: Module 15.
  194. blogCloudflare Blog. Introducing DNS Resolver, 1.1.1.1 (not a joke). 2018 (live page, accessed 2026). https://blog.cloudflare.com/dns-resolver-1-1-1-1/. Accessed 2026-09-17. Cited in: Module 1.
  195. blogConfluent. Metronome Powers Real-Time Billing With Confluent Data Streaming Platform (customer case study). https://www.confluent.io/customers/metronome/. Accessed 2026-09-17. Cited in: Module 18.
  196. blogFeyisetan, F., Yuan, Y. How GKE Inference Gateway improved latency for Vertex AI. Google Cloud Blog, published 2026-02-07. https://cloud.google.com/blog/products/containers-kubernetes/how-gke-inference-gateway-improved-latency-for-vertex-ai. Accessed 2026-09-18. Cited in: Module 25.
  197. blogGMI Cloud (summarizing Fireworks AI's public claims). Fireworks AI Deep Dive: Inference at Scale. 2026. https://www.gmicloud.ai/en/blog/fireworks-ai-inference-at-scale. Accessed 2026-09-17. Cited in: Module 31.
  198. blogGrbovic, Mihajlo, Haibin Cheng, Qing Zhang, Lynn Yang, Phillippe Siclait, and Matt Jones. Listing Embeddings in Search Ranking. The Airbnb Tech Blog, published 2018-03-13 (companion post to Grbovic & Cheng, Real-time Personalization using Embeddings for Search Ranking at Airbnb, KDD 2018, pp. 311-320). https://medium.com/airbnb-engineering/listing-embeddings-for-similar-listing-recommendations-and-real-time-personalization-in-search-601172f7603e. Accessed 2026-09-17. Cited in: Module 20.
  199. blogGuo, Liang. Building Services at Airbnb, Part 1. Airbnb Tech Blog, published 2017-12-12. https://medium.com/airbnb-engineering/building-services-at-airbnb-part-1-c4c1d8fa811b. Accessed 2026-09-17. Cited in: Module 10, Module 20.
  200. blogHayashi, Kai; Paxinos, Angelo; Shen, Yueshi. Low Latency, High Reach: Creating an Unparalleled Live Video Streaming Network at Twitch. Twitch Blog, published 2021-10-25. https://blog.twitch.tv/en/2021/10/25/low-latency-high-reach-creating-an-unparalleled-live-video-streaming-network-at-twitch/. Accessed 2026-09-17. Cited in: Module 16.
  201. blogHiltner, Rhys. Go's march to low-latency GC. Twitch Blog, published 2016-07-05. https://blog.twitch.tv/en/2016/07/05/gos-march-to-low-latency-gc-a6fa96f06eb7/. Accessed 2026-09-17. Cited in: Module 16.
  202. blogHugging Face. Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries. hf.co/blog, 2026. https://huggingface.co/blog/async-rl-training-landscape. Accessed 2026-09-17. Cited in: Module 34, Module 37, Module 38, Module 39.
  203. blogInstagram Engineering. Sharding & IDs at Instagram. instagram-engineering.com, 2012. https://instagram-engineering.com/sharding-ids-at-instagram-1cf5a71e5a5c. Accessed 2026-09-17. Cited in: Module 17.
  204. blogIzrailevsky, Y., Tseitlin, A. (Netflix). The Netflix Simian Army. Netflix Technology Blog, 19 Jul 2011. https://netflixtechblog.com/the-netflix-simian-army-16e57fbab116. Accessed 2026-09-17 (retrieved via an archived mirror of the Netflix Technology Blog's Medium-hosted publication after the live page returned an automated-access block). Cited in: Module 15.
  205. blogKreps, J. Questioning the Lambda Architecture. O'Reilly Radar, 2 Jul 2014. https://www.oreilly.com/radar/questioning-the-lambda-architecture/. Accessed 2026-09-17. Cited in: Module 15.
  206. blogKubernetes project contributors. Introducing Gateway API Inference Extension. kubernetes.io/blog, published 2025-06-05. https://kubernetes.io/blog/2025/06/05/introducing-gateway-api-inference-extension/. Accessed 2026-09-17. Cited in: Module 21, Module 24, Module 25.
  207. blogLi, Z., Aaron, A., Katsavounidis, I., Moorthy, A., Manohara, M. (Netflix Technology Blog). Toward a Practical Perceptual Video Quality Metric. 2016-06-06. https://netflixtechblog.com/toward-a-practical-perceptual-video-quality-metric-653f208b9652. Accessed 2026-09-17. Cited in: Module 14.
  208. blogManohara, M., Moorthy, A., De Cock, J., Katsavounidis, I., Aaron, A. (Netflix Technology Blog). Optimized Shot-Based Encodes: Now Streaming!. 2018-03-09. https://netflixtechblog.com/optimized-shot-based-encodes-now-streaming-4b9464204830. Accessed 2026-09-17. Cited in: Module 14.
  209. blogNetflix Technology Blog. Serving 100 Gbps from an Open Connect Appliance. 2017. https://netflixtechblog.com/serving-100-gbps-from-an-open-connect-appliance-cdb51dda3b99. Accessed 2026-09-17. Cited in: Module 1, Module 2, Module 14.
  210. blogOpenAI. Unlocking the Codex harness: how we built the App Server. OpenAI, 2026. https://openai.com/index/unlocking-the-codex-harness/. Accessed 2026-09-18 (retrieved via r.jina.ai reader proxy after a direct fetch returned HTTP 403). Cited in: Module 27.
  211. blogOrosz, G. Designing Data-Intensive Applications: The Cloud & Doing the Right Thing (book excerpt, reprinted with publisher permission, plus commentary). The Pragmatic Engineer, 2026-05-05. https://newsletter.pragmaticengineer.com/p/designing-data-intensive-applications-book-excerpt. Accessed 2026-09-18. Cited in: Module 39.
  212. blogPrime Intellect. Environments Hub: A Community Hub To Scale RL To Open AGI. Prime Intellect, 2026. https://www.primeintellect.ai/blog/environments. Accessed 2026-09-17. Cited in: Module 27, Module 37.
  213. blogRoss, B. et al. Rebuilding Payment Orchestration at Airbnb. The Airbnb Tech Blog, 2022-02-24. https://medium.com/airbnb-engineering/rebuilding-payment-orchestration-at-airbnb-341d194a781b. Accessed 2026-09-17. Cited in: Module 18, Module 20.
  214. blogStripe (Brandur Leach et al.). Designing robust and predictable APIs with idempotency. Stripe Engineering Blog, 2017. https://stripe.com/blog/idempotency. Accessed 2026-09-17. Cited in: Module 8, Module 18, Module 20, Module 23.
  215. blogStripe. Ledger: Stripe's system for tracking and validating money movement. stripe.dev Engineering Blog. https://stripe.dev/blog/ledger-stripe-system-for-tracking-and-validating-money-movement. Accessed 2026-09-17. Cited in: Module 18.
  216. blogTogether AI. On-demand dedicated endpoints: run inference with unmatched price-performance & control at scale. Published 2025-03-13. https://www.together.ai/blog/on-demand-dedicated-endpoints. Accessed 2026-09-18. Cited in: Module 31, Module 39.
  217. blogTwitch (Video Ingest team). Ingesting Live Video Streams at Global Scale. Twitch Blog, published 2022-04-26. https://blog.twitch.tv/en/2022/04/26/ingesting-live-video-streams-at-global-scale/. Accessed 2026-09-17. Cited in: Module 16, Module 26.
  218. blogTwitch Engineering. Twitch Engineering: An Introduction and Overview. Twitch Blog, published 2015-12-18. https://blog.twitch.tv/en/2015/12/18/twitch-engineering-an-introduction-and-overview-a23917b71a25/. Accessed 2026-09-17. Cited in: Module 16.
  219. blogUber Engineering (Isaac Brodsky). H3: Uber's Hexagonal Hierarchical Spatial Index. 2018-06-27. https://www.uber.com/en-EG/blog/h3/. Accessed 2026-09-17. Cited in: Module 19.
  220. blogUber Engineering (Lucie Lozinski). Uber Engineering's Ringpop. 2016-02-04. https://www.uber.com/en-ES/blog/ringpop-open-source-nodejs-library. Accessed 2026-09-17. Cited in: Module 19.
  221. blogWhatsApp (Rick Reed). 1 million is so 2011. WhatsApp Engineering blog, 2012-01-06. https://blog.whatsapp.com/1-million-is-so-2011. Accessed 2026-09-17. Cited in: Module 17.
  222. analysisHoff, Todd. The Architecture Twitter Uses to Deal with 150M Active Users, 300K QPS, a 22 MB/S Firehose, and Send Tweets in Under 5 Seconds. High Scalability, 2013-07-08. https://highscalability.com/the-architecture-twitter-uses-to-deal-with-150m-active-users/. Accessed 2026-09-17. Cited in: Module 17.