Slides
Optimization in Deep Learning
Optimization in Deep Learning
Slides explain the various optimization algorithms used in deep learning and a comparison between them. It also has a brief about the ICML papers "Descending through a Crowded Valley — Benchmarking Deep Learning Optimizers" and "Optimizer Benchmarking Needs to Account for Hyperparameter Tuning."
Verifiable and Energy Efficient Medical Image Analysis with Quantised Self-attentive Deep Neural Networks
Slides used to present the mentioned paper at MICCAI 2022, Singapore.