Welcome to the course!
The Backpropagation algorithm for a math student
Gradient Descent, Stochastic Optimization, and Other Tales
Stochastic gradient descent: where optimization meets machine learning
Recent Advances in Stochastic Gradient Descent in Deep Learning
On the different regimes of stochastic gradient descent