What Does Verifiable Inference Get You?

Verifiable inference is the application of verifiable computing to AI systems. This is often positioned as a way to ensure that a computing provider is running a certain model, instead of using a cheaper one to cut costs. For example, from a recent paper on the subject: ... a user might request the Llama-3.1-70B model for complex tasks, but a dishonest computing provider could substitute the…