What Scaling Laws Don't Predict
Why predicting capabilities from scaling laws is harder than it looks
Kevin Niechen is an engineer and avid reader.
Why predicting capabilities from scaling laws is harder than it looks
Tech has become a default career for many young college students. There has never been a career path that has been so high-paying, comfortable, and accessible [1] . Few students decide to major in Computer Science in the same way that someone might decide to major in Physics or Art History. What this means is that millions of students today now choose a default, “obviously-right” career without…