Uncovering Batch & Layer Normalization

Batch normalization and layer normalization improve training stability and reduce sensitivity to initialization by normalizing intermediate activations.