Paper notes - Merging LLMs at Pre-training, Considering Token Probabilities at RL

Here are two papers that target: Paper1: improving pre-training performance of an LLM by merging model checkpoints along the training trajectory and Paper2: improving post-training RL efficiency by avoiding the low-probability token dominance. Model Merging in Pre-training of Large Language Models What’s new Pre-trained Model Average (PMA) strategy for model merging during pre-training of large…