Evaluating LLMs - Notes on a NeurIPS'24 Tutorial

I attended NeurIPS’24 virtually, and I was happy to see that they had two tutorials on topics that I care about. One was on evaluating LLMs, and the other one was on decoding-time strategies. This post covers the former. I have been meaning to publish this for a while, but this languished as a draft for a long time while life got in the way. Well. Introduction Tutorial Intro - Irina Sigler Quality…