Cheaper AI does not mean greener AI

In this article I have a look at the cost of running queries for GPT-4 and similar models, in view of the drop in price per prompt. The main conclusions are: The energy efficiency gains for queries to large language models (LLM) are not leading to lower emissions. On the contrary, the lower prices are likely to lead to increased use and therefore higher emissions. The cost of a query is mainly…