Beyond Bigger MoE: How Kimi K3 Scales Context, Depth, and Agents

Kimi K3 is a 2.8-trillion-parameter open-weight multimodal MoE model that combines hybrid linear–global attention, selective residual connections across depth, and large-scale agentic reinforcement learning.