Universal Approximation Theorem

Single-hidden-layer feedforward neural networks with non-polynomial activation functions are dense in C(K), the space of continuous functions on compact sets.