Markets as a Judge: Scaling Human Preference Data with Prediction Markets

Training language models on human preferences is expensive. The RLHF and DPO paradigms demand large volumes of preference data — pairs of… Keep reading .