Deep Reinforcement Learning Workshop

NIPS 2018

Call for Papers

We invite you to submit papers that combine neural networks with reinforcement learning, which will be presented as talks or posters. The deadline is October 12th, 2018 (11:59 PM AoE), and decisions will be sent out on November 19th. Please submit through the form at the bottom of this page. Submissions should be in the NIPS 2018 format with a maximum of eight (8) pages, not including references, and as many pages as needed in an appendix section (all in a single pdf). Reading appendix is up to the discretion of the reviewers. The review process is double-blind, so please make sure to submit your papers anonymously! Accepted submissions will be presented in the form of posters or contributed talks.

Submitted papers should be on work that is unpublished, or under review at a conference or journal but not accepted at the time of submission. Papers that meet this criterion but are on arXiv are also acceptable.


Q. While uploading my submission, Google forms appended my first name to the PDF filename and this could break anonymity. What should be done?

A. We will relabel the filenames before assigning to reviewers to ensure double-blind review process.

Q. I am unable to revise my submission on the Google forms. How do I update my submission?

A. Unfortunately, there is no option to allow for PDF upload updates. Please try to submit only when you have the final version. However, please feel free to make another submission for an update with the hope that there wouldn't too many such updates. Your final submission will be considered for reviews.

Q. If my paper is accepted, will I get a ticket for the NIPS 2018 Conference / Workshop?

A. At the moment, it is not clear what the policy adopted by the NIPS Program Chairs is for workshop registration. We will update once we have more information.

Q. Can the deadline be extended?

A. It's not possible to extend the deadline. However, we are still considering submissions that come in until 12 hours after the specified time to allow for any last minute hassles.

Q. Can I submit my paper to multiple other NIPS 2018 workshops?

A. Yes, submitting to this workshop doesn't constrain you in anyway from submitting to other conferences / workshops.



  • Friday October 12th, 2018, 11:59 PM Anywhere On Earth: Paper submission deadline
  • Monday November 19th, 2018: Paper acceptance notification
  • Friday December 7th, 2018 08:00 AM -- 07:00 PM: Workshop


In recent years, the use of deep neural networks as function approximators has enabled researchers to extend reinforcement learning techniques to solve increasingly complex control tasks. The emerging field of deep reinforcement learning has led to remarkable empirical results in rich and varied domains like robotics, strategy games, and multiagent interaction. This workshop will bring together researchers working at the intersection of deep learning and reinforcement learning, and it will help interested researchers outside of the field gain a high-level view about the current state of the art and potential directions for future contributions.

For previous editions, please visit NIPS 2017, NIPS 2016, and NIPS 2015.



  • 09:00 - 09:30 Yann LeCun
  • 09:30 - 10:00 contributed talks (3)
  • 10:00 - 10:30 Jacob Andreas
  • 10:30 - 11:00 coffee break
  • 11:00 - 11:30 Sham Kakade
  • 11:30 - 12:00 contributed talks (3)
  • 12:00 - 12:30 Jeff Clune

One-hour lunch break from 12:30 - 13:30.

  • 13:30 - 14:00 Satinder Singh
  • 14:00 - 14:30 contributed talks (3)
  • 14:30 - 15:00 Martha White
  • 15:30 - 16:00 poster session 1 + coffee
  • 16:00 - 16:30 Doina Precup
  • 16:30 - 17:15 late breaking talks
  • 17:15 - 18:00 panel discussion
  • 18:00 - 19:00 poster session 2


Accepted papers will be presented in a spotlight talk or a poster session. After the decision notification date, the accepted papers will be listed below.

Program Committee

We would like to thank the following people for their effort in making this year's edition of the Deep RL Workshop a success.

  • Tejas Kulkarni
  • Rocky Duan
  • Tim Salimans
  • Jonathan Ho
  • Marcin Andrychowicz
  • Max Jaderberg
  • Lerrel Pinto
  • Brandon Amos
  • Haoran Tang
  • Carlos Florensa
  • Jakob Foerster
  • Ashvin Nair
  • Vitchyr Pong
  • Justin Fu
  • Marvin Zhang
  • Sandy Huang
  • Ignasi Clavera
  • Devendra Singh Chaplot
  • Max Smith
  • Vivek Veeriah
  • Karol Hausman
  • Diana Borsa
  • Jane Wang
  • Junhyuk Oh
  • Shixiang Gu
  • Emilio Parisotto
  • Alex (Sascha) Vezhnevets
  • Josh Tobin
  • Jie Tang
  • Noam Brown
  • Nikhil Mishra
  • Igor Mordatch
  • Harri Edwards
  • Siddarth Reddy
  • Markus Wulfmeier
  • Tuomas Haarnoja
  • Richard Y. Chen
  • Ryan Lowe
  • Aviv Tamar
  • Matt Hausknecht
  • Tom Schaul
  • George Tucker
  • Aravind Rajeswaran
  • Alex Lee
  • Janarthanan Rajendran
  • Gregory Kahn
  • David Ha
  • Nick Rhinehart
  • Danijar Hafner
  • Karthik Narasimhan
  • Roberto Calandra
  • Abhishek Gupta
  • Xiaoxiao Guo
  • Anna Harutyunyan
  • Coline Devin
  • Deepak Pathak
  • Pulkit Agrawal
  • Xue Bin Peng
  • Maruan Al Shedivat
  • Yuandong Tian
  • Yashuhiro Fujita
  • John Schulman
  • Lisa Lee
  • Glen Berseth
  • Kendall Lowrey
  • Eric Jang
  • Bradly Stadie
  • Rohin Shah
  • Yuhai(Tony) Wu
  • Ofir Nachum