• Attention is all you need

• Transformers

• Self-Supervised Learning

• AutoEncoders

• Project Discussion

• Q-Learning

• AlphaZero

• Project Discussion

• Covolutional neural networks

• Space & memory considerations

• Momentum & Nesterov Accelerated Gradient

• Resilient Backpropagation

• Adaptive Gradient Algorithm

• Root Mean Square Propagation

• Adaptive Moment Estimation & Nesterov-accelerated Adaptive Moment Estimation

• AdaDelta

• Dropout

• Basic Statistical Notions

• Optimizations (overview)

• Weight initialization

• Loss Functions

• Computation Graph

• Backpropagation in Pytorch

• Stochastic Gradient Descent

• What is PyTorch

• Data types

• Tensors

• Layers

• Module base class

• Datasets & DataLoaders

• Checkpoints

• PyTorch Dataset and Dataloader + MLP example

• torchvision transforms

• Custom dataset and transforms/augmentations

• The perceptron algorithm

• Batch operations

• Adaline perceptron

• Numpy library

• DataTypes

• Shapes

• Slicing and indexes

• Operations with arrays

• Serialization/Deserialization

Intro to Linear Algebra. Resources.