Alignment Challenges: Scalable Oversight, Goal Specification

Examines the core alignment challenges facing modern LLMs: scalable oversight, alignment tax, goal mis-specification, reward hacking. Read full notebook