Memory and Intelligence in LLM

Intelligence as shown by LLMs is interesting. Here by memory I mean “context window size” though they are not equivalent. And by “Intelligence” I don’t mean human intelligence which jumps into metaphysical debates. Perhaps “cognitive ability” to solve a task at hand is reasonable narrow definition. At the advent of LLMs the available “context window”for an LLM was limited and took the longest to…