Titans + MIRAS: Helping AI have long-term memory

Google Research introduces a new architecture using deep neural networks for long-term memory, enabling models to handle 2M+ token contexts by updating memory on the fly.