Backpropagation, 1986: the algorithm that revived neural networks

In 1974, Paul Werbos submitted a doctoral thesis to Harvard and left his best idea in one of its chapters. The title was Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences . Buried in it was a complete mathematical derivation of an algorithm that could train…