Native DSLs Ops in PyTorch

You may have noticed that FlashAttention 4 was supported in PyTorch really quickly. That required a bit of new infrastructure: torch.native by Simon Layton. Prior versions of FlashAttention were written in Cutlass/C++, but for FA4 the team implemented the kernel in CuteDSL. Edit: Simon kindly pointed the FA4 work integration work predated his formalization of [ ]