Enabling Long Context Training with Sequence Parallelism in Axolotl (v0.8.0)

Training large language models (LLMs) with long contexts has become an important capability as models continue to expand in both size and context length.