Pen & Paper LM 160
Pen & Paper LM 160 is a microscopic language model designed to be run by hand. It does not generate normal prose. It predicts the next token in a small workflow language: QUESTION TASK IDEA FACT PROBLEM UNKNOWN PLAN DO CHECK ASK ANSWER DONE The model is trained to produce simple useful loops: QUESTION → CHECK → ANSWER → DONE TASK → PLAN → DO → CHECK → DONE IDEA → CHECK → PLAN → DO → CHECK → DONE…