The phone learns to think for itself

At Qualcomm’s Snapdragon Summit in Maui on October 24, 2023, an engineer ran a seven-billion-parameter language model on a smartphone chip with no network connection. The model — Meta’s Llama 2 — generated twenty tokens per second. Not from a server farm, not via satellite link, but from the chip…