Testing 80 LLMs on spatial reasoning on grids

In the last article I introduced two different problems that I was curious how LLMs would answer. For that article, I ran a simple Kaggle experiment , but now it’s time for a more comprehensive study. To summarize, the problems involve laying out numbers in a grid, locating the position of 2026, and then summing out its neighbors. The only difference between the two problems is that the first…