Deep Reinforcement Learning Symposium, NIPS 2017

Important Dates

Friday November 3, 2017 : Paper submission deadline

Monday November 20, 2017: Paper acceptance notification

Thursday December 7, 2017: Symposium

Call for Papers

We invite you to submit papers that combine neural networks with reinforcement learning, which will be presented as talks or posters. The deadline is November 3rd (midnight PST), and decisions will be sent out on November 20th. Please submit papers through this link. Submissions should be in the NIPS 2017 format with a maximum of eight pages, not including references, and as many pages as needed in an appendix section (all in a single pdf). Reading appendix is up to the discretion of the reviewers. The review process is double-blind. Accepted submissions will be presented in the form of posters or contributed talks.


Although the theory of reinforcement learning addresses an extremely general class of learning problems with a common mathematical formulation, its power has been limited by the need to develop task-specific feature representations. A paradigm shift is occurring as researchers figure out how to use deep neural networks as function approximators in reinforcement learning algorithms; this line of work has yielded remarkable empirical results in recent years. This workshop will bring together researchers working at the intersection of deep learning and reinforcement learning, and it will help researchers with expertise in one of these fields to learn about the other.


  • Tentative symposium schedule:

2:00 - 2:40 Invited Talk: David Silver (Google DeepMind), Mastering Games with Deep Reinforcement Learning

2:40 - 3:10 Contributed talks (3 x 10 minutes)

3:10 - 3:50 Invited Talk: Joelle Pineau (presentation) (McGill), Reproducibility in Deep Reinforcement Learning and Beyond

3:50 - 4:10 Break

4:10 - 4:40 Contributed talks (3 x 10 minutes)

4:40 - 5:20 Invited Talk: Ruslan Salakhutdinov (CMU), Neural Map: Structured Memory for Deep RL

5:20 - 5:50 Contributed talks (3 x 10 minutes)

5:50 - 7:10 Poster session / snacks

7:10 - 7:50 Invited Talk: Ben Van Roy (Stanford), Deep Exploration Via Randomized Value Functions

7:50 - 8:20 Contributed talks (3 x 10 minutes)

8:20 - 9:00 Invited Talk: Michael Bowling (presentation) (Alberta), Artificial Intelligence Goes All-In

Contributed Papers

Accepted papers will be presented in a spotlight talk or a poster session.

Program Committee

  • Rocky Duan
  • Rein Houthooft
  • Junhyuk Oh
  • Marcin Andrychowicz
  • Richard Y. Chen
  • Thomas Degris
  • Prafulla Dhariwal
  • Chelsea Finn
  • Jakob Foerster
  • Arthur Guez
  • Shixiang Gu
  • Xiaoxiao Guo
  • Jean Harb
  • Matt Hausknecht
  • Max Jaderberg
  • Alex Lee
  • Ryan Lowe
  • Vlad Mnih
  • Emilio Parisotto
  • Janarthanan Rajendran
  • Aravind Rajeswaran
  • Tim Salimans
  • Sainbayar Sukhbaatar
  • Arthur Szlam
  • Aviv Tamar
  • Haoran Tang
  • Yuandong Tian
  • Alex Vezhnevets
  • Markus Wulfmeier