Paper Summary: DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

Please note This post is mainly intended for my personal use . It is not peer-reviewed work and should not be taken as such. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models by Shao et al. Source WHAT A domain-specific LLM with 7B params is built to solve mathematical problems. A novel policy-gradient RL algorithm (Group Relative Policy Optimization or GRPO) is…