Gradient approximations in derivative-free optimization

Most of modern ML is heavily reliant on gradient descent and its variants.