Scaling won't fix training data quality

Epistemic confidence: 60%. Writing this essay allowed me to see that models could have a spectrum of real intelligence that scales. As of now, I still err on the side of the argument made here. [Edit: Since writing this I dove deeper into scaling, and now find some of my views here too naive. The training data quality problem however seems to be a real problem.] A couple days ago Google DeepMind…