A 1.7B Model That Stops Guessing

swollm — SmolLM2-1.7B with the Turnstyle layer bolted on. A small model doesn’t usually fail because it can’t compute the answer. It fails because it won’t stop guessing long enough to compute it. BIG-Bench Hard (BBH) is a curated set of tasks where, at the time it was assembled, language models did worse than the average human rater: multi-step arithmetic, tracking shuffled objects, Dyck-language…