Training Data is Still an Open Problem
We spend most of our time working on training data. If someone told me this a year ago, it would have surprised me. The general thinking was that brute force scaling of AI models would begin to reach diminishing returns, and that data collection infrastructure like ours would be used as a tool during inference. Teams are still scaling pretraining aggressively. Not in a brute force way, but in a…