The Web of Babel: Browsing the Internet's Latent Space

The BBC never published a digital edition of the Battle of Waterloo, but in the latent space of a Large Language Model (LLM), that page does exist. LLMs are famously trained to predict the next word in a sentence. Somehow, as a side effect, they also learn facts, concepts, and relationships. Among those relationships is the link between a URL and its content. This results in something like a…