D20bench - Benchmarking LLMs with Dungeons & Dragons Combat

How I turned a D&D combat engine into an LLM benchmark, why the models only looked stupid, and how a language model ended up beating my scripted AI. Open source, and you can help.