On-device AI is a margin decision

Where your inference runs is a margin, privacy, and battery decision, and every upside hinges on whether your model actually works on the user's hardware - the aspects an engineering leader should weigh before betting on on-device AI.