On-Chip LLM: Inside the Chip

The datapath of a 3.16M-parameter transformer living in FPGA fabric: wide-word GEMV, the dual-port split-brain, and the proof that 16 streams is a hard wall.