LLMs and the Blurry Distinction Between Code and Data

There is still a lot of confusion about what LLMs actually "are." A very helpful mental model to understand LLMs a bit better is to recognize the distinction between code and data, and when this distinction breaks down. In this article, I introduce you to what code and data formally are, and how LLMs completely defy this seemingly neat distinction. I also include some recommendations for any…