Can Transformers Do Everything, and Undo It Too?

Large Language Models are Surjective? Injective? Invertible? Recently, there have been discussions on functional properties of Transformers, the basic building block of Large Language Models (LLM) and many other generative models. My paper ([1]) proves that Transformers can output anything given an appropriate input (surjective). After a few months, a followup ([2]) proves that LLMs always send…