dots3-note Preview: Inside the 280B Multimodal MoE Model

dots3-note preview is a 280B-parameter, 16B-active multimodal MoE model with 512K context. Here's what it is and how it works.