The Compounding Error of Generative Models

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

Yann LeCun believes autoregressive models inherently suffer from a kind of ‘generational drift’ 1 due to compounding errors. Coming from LeCun - Chief AI Scientist at Meta and famed for his work on convolutional neural networks and image recognition - this alarming statement carries a lot of weight. It is also, I think, a novel concept to people who are not steeped in statistics, or…

Read on aimlbling-about.ninerealmlabs.com ↗