Continual Learning is not Continual Midtraining

Many have caught onto the truth that AGI-through-pure-LLM-scaling is probably&#xA;not going to happen. And many have identified continual learning as the key&#xA;difference between LLMs and a generally intelligent agent. If you&rsquo;ve ever used&#xA;Claude Code, you will be acutely aware of how effective context length limits&#xA;LLMs&rsquo; general utility, and if only we had something that…