Deep learning has been hugely successful. There are a few simple ideas that underlie much of the progress in deep learning, which I will
review. Deep learning also has severe limitations, one of which is its poor handling of uncertainty. Bayesian deep learning attempts to
address some of these limitations. I will highlight a few projects I have been working on to bring together the best of both the deep learning
and probabilistic modelling worlds.