The maths behind the MLP

Contents Why from scratch Intuition? Notation Forward pass Matrix notation Vector of z values Vector of neuron values Non-linearity Conclusion Backpropagation Output layer derivatives Bias derivative Weight derivative Delta Representation of output layer backpropagation as a matrix operation Added notation Conclusion of the output layer derivatives Hidden layer derivatives Intuition behind the…