Benchmarking LLMs for hallucinations

How often do different language models hallucinate? You might have noticed that when presenting new models, AI labs usually avoid discussing this question. Their marketing departments probably discourage them from talking about hallucinations out loud. But maybe a more important reason is that benchmarking hallucinations is as straightforward as we think. The first issue we […]