Junhyuk Oh

junhyuk (at) google (dot) com

Curriculum Vitae     Google Scholar

I am a research scientist at DeepMind. I finished my Ph.D. at the University of Michigan, where I was co-advised by Honglak Lee and Satinder Singh. My research focuses on deep reinforcement learning. Some of my work has been covered by MIT Technology Review and Daily Mail.



Invited Talks


Contingency-Aware Exploration in Reinforcement Learning
Jongwook Choi*, Yijie Guo*, Marcin Moczulski*, Junhyuk Oh, Neal Wu, Mohammad Norouzi, Honglak Lee.
ArXiv, 2018. 

Many-Goals Reinforcement Learning
Vivek VeeriahJunhyuk Oh, Satinder Singh
ArXiv, 2018. 
Unicorn: Continual Learning with a Universal, Off-policy Agent
Daniel J. Mankowitz, Augustin Žídek, André Barreto, Dan Horgan, Matteo Hessel, John Quan, Junhyuk Oh, Hado van Hasselt, David Silver, Tom Schaul
ArXiv, 2018. 


On Learning Intrinsic Rewards for Policy Gradient Methods
Zeyu Zheng, Junhyuk Oh, Satinder Singh
In Neural Information Processing Systems (NeurIPS), 2018. 

Hierarchical Reinforcement Learning for Zero-shot Generalization with Subtask Dependencies
Sungryull Sohn, Junhyuk Oh, Honglak Lee
In Neural Information Processing Systems (NeurIPS), 2018. 
Self-Imitation Learning
Junhyuk Oh*, Yijie Guo*, Satinder Singh, Honglak Lee
In International Conference on Machine Learning (ICML), 2018.

Value Prediction Network
Junhyuk Oh, Satinder Singh, Honglak Lee
INeural Information Processing Systems (NeurIPS), 2017. 

Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning
Junhyuk Oh, Satinder Singh, Honglak Lee, Pushmeet Kohli
In International Conference on Machine Learning (ICML), 2017. 

Control of Memory, Active Perception, and Action in Minecraft
Junhyuk Oh, Valliappa Chockalingam, Satinder Singh, Honglak Lee
In International Conference on Machine Learning (ICML), 2016. 
Press Coverage: [MIT Technology Review] [Daily Mail]

Learning Transferrable Knowledge for Semantic Segmentation
with Deep Convolutional Neural Network 
Seunghoon Hong, Junhyuk Oh, Bohyung Han, Honglak Lee 
In Computer Vision and Pattern Recognition (CVPR), 2016.
Spotlight presentation

Action-Conditional Video Prediction using Deep Networks in Atari Games
Junhyuk Oh, Xiaoxiao Guo, Honglak Lee, Richard Lewis, Satinder Singh
In Neural Information Processing Systems (NeurIPS), 2015. 
Spotlight presentation Acceptance rate: 4.5% (82/1858)


  • Sep 2014 - May 2018
    • University of Michigan, Ann Arbor, MI
    • Ph.D. student in Computer Science and Engineering
  • Mar 2007 - Feb 2014
    • Seoul National University, Seoul, Korea
    • B.S. in Computer Science and Engineering

Professional Experience

  • June 2018 - Present
    • Research Scientist, DeepMind, London, United Kingdom.
    • June 2017 - Sep 2017
      • Research Intern, DeepMind, London, United Kingdom.
    • June 2016 - Sep 2016 
      • Research Intern, Microsoft Research, Redmond, USA.
    • June 2011 - Jan 2013
      • Software Engineer, ESTsoft Co., Ltd., Seoul, Korea
    • Jan 2010 - June 2011
      • Software Engineer, GALA Lab Co., Ltd., Seoul, Korea

    Awards and Honors

    • Graduate Scholarship from Kwanjeong Educational Foundation, 2014 - Present
    • Undergraduate Scholarship from Korea Student Aid Foundation (KOSAF), 2007 - 2014