Claude got scarily good at faking deterministic output

The other day, I accidentally got Claude 3.7 Sonnet to generate a thousand-line, Req -based Elixir API client from the OpenAPI spec for Fly Machines . I was exploring the options for structuring such a module, more out of curiosity than any urgent need, and asked Claude on a whim if it could produce functions for all the endpoints. It did. Forty-odd functions, complete with typespecs and detailed…