The Web of Babel: Browsing the Internet's Latent Space

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

The BBC never published a digital edition of the Battle of Waterloo, but in the latent space of a Large Language Model (LLM), that page does exist. LLMs are famously trained to predict the next word in a sentence. Somehow, as a side effect, they also learn facts, concepts, and relationships. Among those relationships is the link between a URL and its content. This results in something like a…

Read on douwe.com ↗