Demetri Spanos: "To get additive performance [with AI] you need to double the amount of compute and data"

This is according to Demetri Spanos in this interview: Why AI Companies Need Scale [Wading Through AI - Episode 7]​ This is apparently well known in the field of AI: the performance of the AI system has a logarithmic relationship to its input. There are theories behind it and so far they have been empirically validated. He says that AI decision makers are taking decision based on this. It is a…