Value functions and dense rewards

In context learning seems to largely just work, we have utilized RLHF and RL based on verifiable rewards to the limits of economic viability such that Yann LeCun gets a billion dollars seed funding on the thesis that further scaling has diminishing returns. While they are great coders now, Karpathy coins LLMs as having “jagged” boundaries. They are simultaneously superhuman and make mistakes a…