Random thoughts on LLMs

Last year I said that transformers will be gone in a decade (2035), but didn’t say anything of substance beyond that. I still don’t have much substance, but I’d like to posit a counter architecture/model structure which may serve to be useful. I read some AI papers, but not all, so its most likely that this idea has been implemented, tested, and empirically shown to be terrible but I’ve not read…