Autoresearch

&#xA;&#x9;&#x9;&#x9; Leaving the autoresearch loop going, the LLM was able to make 7.8% progress on the distillation task. &#xA;&#x9;&#x9; &#xA; &#xA;&#xA; I saw Andrej Karpathy&rsquo;s Autoresearch results the other day and decided to give it a shot on a relatively difficult task: distilling a retrieval/reranking model into a much smaller 10MB model. The model was trained on MS MARCO v1.1 and…