Quick Follow-up on Inter-node RL Weight Transfer

In the previous blog post, I walked through how we achieved cross-machine RL weight updates in just 2 seconds. This post is a quick follow-up with a few extra details: For Kimi-K2 (1T params), with 256 GPUs in BF16 training and 128 GPUs in FP8 inference, weight updates take less than 1.3 seconds. The pipeline for parameter updates has been tuned a bit more, adding two parallelizable steps: H2D…