I posted this article originally on Notion, sharing here to unify We’ve all been asked to scale our features to speed up training & steadily decrease our cost. Ever wondered why scaling plays such an important role during model training? Let’s find out! 💭 This blog assumes that you are familiar with the concepts of cost function, gradient descent algorithm In multivariate linear regression we…
Regularization in Machine Learning is talked about a lot, often indicating that it solves the high variance problem whilst also helping with feature selection. A model is said to have overfit some training data when the error on it is very low but the error on unseen data is very high. This is explained by the formula for variance. σ 2 = 1 N ∑ i = 1 N ( x i…