Getting LLMs to reason with Types

The reason why LLMs are programmatically useful is because they can produce structured outputs. They&rsquo;ve become good over the years of producing these outputs accurately, but smaller (cheaper) models used mostly for data extraction still struggle when given complex object shapes. &#xA; Usually, to guide the LLMs to produce these outputs, developers prompt with a fully qualified JSON schema,…