Advanced Deep Learning

Slides

• Gabriel Peyré (CNRS and ENS): Differential programming.
• Edouard Oyallon, (CentraleSupelec), A road into deep learning.

Computational resources

Autodiff and more specific deep-learning softwares (Python):

• AutoGrad: directly differentiate basic python codes.
• Chainer: similar purpose.
• Theano: more advanced (symbolic computation).
• TensorFlow: similar.
• PyTorch: similar.
• Keras: deep learning library (on top of Theano or TensorFlow).
• Natural gradient in Torch by Gaetan Marceau.