What NCU Taught Us About Triton’s Scatter-Gather Codegen (And Why Our Optimizations Backfired)

We ran Nsight Compute on a Triton sparse attention kernel and discovered it already generates async pipelined scatter-gather loads — but three targeted optimizations (removing masks, adding pipeline stages, combining both) all made things worse.