An Evolved Universal Transformer Memory

Best viewed on the original page , where extended functionality like the footnote helper is available. I stumbled on HN over this very interesting article about a new kind of context memory system that, is able to remove information that is &ldquo;unhelpful or redundant details&rdquo;. Thinking further, i think this would be super helpful for semantic search, that is currently not very performant…