Neural Nets Back to the Future @ ICML 16      June 23rd 2016 at Crowne Plaza in NYC    A workshop linking the past, present and future research on neural networks

Overview

As research in deep learning is extremely active today, we could take a step back and examine its foundations. We propose to have a critical look at previous work on neural networks, and try to have a better understanding of the differences with today's work. Previous work can point at promising directions to follow, pitfalls to avoid, ideas and assumptions to revisit. Similarly, today's progress can allow a critical examination of what should  still be investigated, what has been answered...

This workshop will be the occasion to

- critical review of previous work

- discuss forgotten "gems" from the earlier literature

- understand how mechanisms we take for granted todays came to be (e.g. gating, transfer functions...)

- understand research trajectories: how ideas came from promising to successful or not, what inspired influential solutions...

- revisit assumptions about what could work or not (e.g. vanishing gradients issues)

The program mixes invited talk with influential scientists who have contributed to our field for a long time, presentation of forgotten "gems" and panel discussion involving with a variety of researchers across neural network eras.

The workshop was recorded, we will post link to talks and slides as soon as there are available.