Line Goes Up? Large Language Models are Poor General Reasoners

Introduction The recent development of large language models (LLMs) based on the transformer architecture has led to extensive discussion as to how to best measure their capabilities. The most common way to assess LLMs is by their performance on standardised tests called benchmarks. These tests are designed to interrogate the ability of LLMs to perform [ ]