Training language models on TPUs shouldn’t be scary

A practical guide to migrating your PyTorch training code to TPUs, with step-by-step debugging and optimization tips.