RL Post-Training · Part 5

Rewards, Environments, Agents, and Their Failure Modes

Where reward signals come from when a unit test is not enough, what an RL environment is, how multi-turn agent training differs, how rewards get exploited, and what the resulting numbers do and do not show.

16Rewards Beyond Ground Truth: LLM Judges, Rubric Rewards, Generative Reward Models, and Judges Trained Inside the Loop45 min17RL Environments for LLMs: Task Datasets, Harnesses, Verifiers, State, and Reward Shaping50 min18Agentic and Multi-Turn RL: Trajectories as Episodes, Credit Assignment, Observation Tokens, and Staleness40 min19Reward Hacking in Practice: Proxy Exploits, Emergent Misalignment from Hacked Environments, and the Defenses Reports Describe50 min20Evaluating What RL Did: pass@1 versus pass@k, Spurious Rewards, Contamination, and the Sharpen-or-Expand Debate50 min