Even a Bag of Words Has a World Model

my work, AI-generated overview In October 2023, Gurnee and Tegmark published Language Models Represent Space and Time : linear probes on Llama activations recover, among other things, the latitude and longitude of places the model has read about. The paper was received as ammunition in the “do LLMs have world models?” debate, and the skeptics’ rebuttal was predictable: recovering coordinates with…