microgpt on the ESP32 – but... why?

Yesterday I was looking at the zclaw project , and I thought it would be cool if the ESP32 could run an actual language model. Then I remembered that Andrej Karpathy had dropped microgpt a couple of weeks ago, and thought it might be fun to try and get a GPT running on the ESP32. I've got a couple of them lying around from a few other tinkering projects, as well as a functioning ESP32 Rust project…