The future of LLMs: cognitive core + cartridges?

Andrej Karpathy introduced a concept of a “cognitive core”: