Deep Learning for Artificial Intelligence

DLAI

Topics covered:

Deep learning technologies are at the core of the current revolution in artificial intelligence for multimedia data analysis. The convergence of large-scale annotated datasets and affordable GPU hardware has allowed the training of neural networks for data analysis tasks which were previously addressed with hand-crafted features.

Architectures such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs) or the Transformer based on Attention mechanisms have shaped a brand new scenario in signal processing. This course will cover the basic principles of deep learning from both an algorithmic and computational perspectives.

The course webpage can be found: [2020], [2019], [2018]

DLAI Lectures (2020)

dlai_2020_01_ml

Lecture 1: Machine Learning Basics

Learning Paradigms

Instructor: Xavier Giró-i-Nieto

dlai_2020_02_perceptron

Lecture 2: The Perceptron

Architectures

Instructor: Xavier Giró-i-Nieto

dlai_2020_03_backprop

Lecture 3: Backpropagation

Training

Instructor: Xavier Giró-i-Nieto

dlai_2020_04_softmax

Lecture 4: Softmax regression

Architectures

Instructor: Xavier Giró-i-Nieto

dlai_2020_05_mlp

Lecture 5: Multi Layer Perceptron

Architectures

Instructor: Xavier Giró-i-Nieto

[DLAI 2020] Loss functions

Lecture 6: Loss functions

Training

Instructor: Javier Ruiz Hidalgo

dlai_2020_07_CNN

Lecture 7: Convolutional Neural Networks

Architectures

Instructor: Veronica Vilaplana

11_rnn_dlai_2020

Lecture 11: Recurrent Neural Networks

Architectures

Instructor: Xavier Giró-i-Nieto

12_self_dlai_2020

Lecture 12: Self-supervsed Learning

Learning Paradigms

Instructor: Xavier Giró-i-Nieto

13_gan_dlai_2020

Lecture 13: Generative Adversial Networks

Generative Models

Instructor: Xavier Giró-i-Nieto

14_attention_dlai_2020

Lecture 14: Attention mechanisms

Architectures

Instructor: Xavier Giró-i-Nieto & Marta R. Costa-Jussà

15_transformer_dlai_2020

Lecture 15: The Transformer

Architectures

Instructor: Xavier Giró-i-Nieto

16_selfav_dlai_2020

Lecture 16: Self-supervised Audio-Visual Learning

Multimodal Learning

Instructor: Xavier Giró-i-Nieto