"A Foundational Result in Machine Learning"

A foundational result in machine learning is that a single-layer perceptron with N 2 parameters can store at least 2 bits of information per parameter ( Cover, 1965 ; Gardner, 1988 ; Baldi & Venkatesh, 1987 ). More precisely, a perceptron can implement a mapping from 2N, N-dimensional, input vectors to arbitrary N-dimensional binary output vectors, subject only to the extremely weak restriction…