Training a Reasoning Model for Very Cheap with DPO

header