Linklog | The quadratic sandwich

This post is a very well written explanation on whar mathematical conditions a loss function should obey so that gradient descent is effective on it.