RAG: How an LLM Answers From Documents It Never Saw

A chat model only knows what it saw in training. RAG is the plumbing that lets it answer from your private documents, today's news, or anything it was never trained on: a second kind of model that turns text into coordinates, a database of those coordinates, and a search step that runs before the LLM ever sees your prompt.