Sonnet 4.6 silently drops a format rule on 80% of long agent runs

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

Sonnet 4.6 silently dropped a one-line format rule on 80% of long agent runs. The fix turned out to be one extra sentence in the initial user message. Tested across Opus 4.7, Sonnet 4.6, Haiku 4.5, GPT-4.1, and GPT-4o — 270 trajectories, ~$40 of API spend, four perfect end-to-end.

Read on ruairidhwm-blog-vuqo6dgbt-ruairidhwms-projects.vercel.app ↗