Dynamic Batching for Training Large Sequence Models (LLMs)

Preliminaries