Getting ROCm working on Arch WSL

With Anthropic releasing their J-space paper, I decided to see if I can replicate it on RWKV, the RNN inspired LLM that actually works. One problem, I can't seem to collect the required calabration data using q Q4 model, the activation change is way too big on small perturbations.. BF16 does work ...