Leon Bottou, Facebook and NYU, USA

Training Deep Networks with Stochastic Gradient Algorithms (4.5h)

1. Elementary results on stochastic gradient algorithms

2. Stochastic gradient and learning

3. The cost function landscape and its symmetries

4. Existence of paths to optimality