Let the polynomial monster free

Overparameterized polynomial regression can exhibit double descent: past the interpolation threshold, some bases memorize and still generalize. Experiments compare power, Legendre, Chebyshev, and Fourier features.