Case Study: Shortfalls of Attention is All You Need

This is drawn from Section 1.3 of my paper Neural Circuit Diagrams: Robust Diagrams for the Communication, Implementation, and Analysis of Deep Learning Architectures . It is a primer for a series of posts I am about to make on how Neural Circuit Diagrams can address many pressing problems in