Paper notes: The implicit dynamics of in-context learning

https://arxiv.org/html/2507.16003v1 I liked this paper, I think it gives a nice way to think about how self-attention (and equivalent constructions) operate. Unless otherwise stated, all ideas below are from the authors and I'm just simplifying a bit. The authors come up with an abstraction called a "contextual layer", i.e., a function A that can map either a vector x to another vector or a…