Is There An Inference Glut Coming?

Small models, more efficient hardware... will it lead to overbuilt datacenter capacity?