MOPD

We talked about this sort of thing a bit before, but now the official Multi-Teacher On-Policy distillation paper is out, and its a pleasant read: “MOPD for Capability Integration in LLM Post-Training”. The problem MOPD is solving is composing a bunch of different capabilities into the same model. Normally you do this with RL, with [ ]