Seokju Lee, Ph.D.

Assistant Professor

Visual Intelligence & Energy Wise Lab

Korea Institute of Energy Technology (KENTECH)

School of Energy Engineering / Energy AI Track

slee [at] kentech.ac.kr / seokju91 [at] gmail.com

CV | Google Scholar | LinkedIn | GitHub | YouTube

Welcome

I am an assistant professor at the School of Energy Engineering (Energy AI Track) at KENTECH, Korea.

I completed my Ph.D. degree in Aug. 2021 at KAIST under the supervision of Prof. In So Kweon, and the M.S. degree in Aug. 2015 at KAIST under the supervision of Prof. David Hyunchul Shim. I finished my B.S. degree in electrical and computer engineering from UNIST in 2013.

I was a research intern in Visual Computing Group at Microsoft Research Asia (MSRA) during 2018, working with Dr. Stephen Lin.

I am one of the winners of Qualcomm Innovation Fellowship 2020, and 16th Samsung Electro-Mechanics Best Paper Award as the first author.

Research Interests

"My research focuses on building human-like visual perception systems by collaboratively and interactively understanding semantic and geometric knowledge."

  • Computer Vision

    • Semantic perception: segmentation / detection / recognition

    • Geometric perception: monocular depth / pose estimation / optical & scene flow / view synthesis for AR & VR

    • Sensor fusion (RGB camera + {motion sensor, thermal camera, LiDAR, event camera, etc.})

  • Deep Learning

    • Self-supervised learning, representation learning

    • Domain adaptation, few-shot learning

    • Neural architectural design

    • Multi-modal attention

International Publications

2022

Self-supervised Monocular Depth and Motion Learning in Dynamic Scenes: Semantic Prior to Rescue

Seokju Lee, Francois Rameau, Sunghoon Im, In So Kweon

International Journal of Computer Vision (IJCV), Accepted

[Paper]

Self-supervised Depth and Ego-motion Estimation for Monocular Thermal Video using Multi-spectral Consistency Loss

Ukcheol Shin, Kyunghyun Lee, Seokju Lee, In So Kweon

IEEE Robotics and Automation Letters (RA-L), Apr 2022

[Paper] [Project]

2021

Attentive and Contrastive Learning for Joint Depth and Motion Field Estimation

Seokju Lee, Francois Rameau, Fei Pan, In So Kweon

IEEE International Conference on Computer Vision (ICCV), Oct 2021

[Paper]

Correlate-and-Excite: Real-Time Stereo Matching via Guided Cost Volume Excitation

Antyanta Bangunharcana, Jae Won Cho, Seokju Lee, In So Kweon, Kyung-Soo Kim, Soohyun Kim

IEEE International Conference on Intelligent Robots and Systems (IROS), Sep 2021

[Paper] [Project] [Code]

Learning Monocular Depth in Dynamic Scenes via Instance-Aware Projection Consistency

Seokju Lee, Sunghoon Im, Stephen Lin, In So Kweon

AAAI Conference on Artificial Intelligence (AAAI), Feb 2021

[Paper] [Project] [Code]

Silver Prize, 16th Samsung Electro-Mechanics Best Paper Award

Winner, Qualcomm Innovation Fellowship Korea 2020

ResNet or DenseNet? Introducing Dense Shortcuts to ResNet

Chaoning Zhang, Philipp Benz, Dawit M. Argaw, Seokju Lee, Junsik Kim, Francois Rameau, Jean-Charles Bazin, In So Kweon

IEEE Winter Conference on Applications of Computer Vision (WACV), Jan 2021

[Paper]

2020

Instance-wise Depth and Motion Learning from Monocular Videos

Seokju Lee, Sunghoon Im, Stephen Lin, In So Kweon

NeurIPS Workshop on Machine Learning for Autonomous Driving (NeurIPSW), Dec 2020

NeurIPS Workshop on Differentiable Computer Vision, Graphics, and Physics in Machine Learning (NeurIPSW), Dec 2020

[Paper] [Project] [Code]

Honorable Mention, 12th Electronic Times ICT Paper Contest

Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervision

Fei Pan, Inkyu Shin, Francois Rameau, Seokju Lee, In So Kweon

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2020

[Paper] [Project] [Code] [Video]

Oral Presentation

Winner, Qualcomm Innovation Fellowship Korea 2020

2019

Learning Residual Flow as Dynamic Motion from Stereo Videos

Seokju Lee, Sunghoon Im, Stephen Lin, In So Kweon

IEEE International Conference on Intelligent Robots and Systems (IROS), Nov 2019

[Paper] [Project] [Video]

Oral Presentation

Visuomotor Understanding for Representation Learning of Driving Scenes

Seokju Lee, Junsik Kim, Tae-Hyun Oh, Yongseop Jeong, Donggeun Yoo, Stephen Lin, In So Kweon

The British Machine Vision Conference (BMVC), Sep 2019

[Paper] [Supp] [Dataset] [Poster] [Project] [Video]

Revisiting Residual Networks with Nonlinear Shortcuts

Chaoning Zhang, Francois Rameau, Seokju Lee, Junsik Kim, Philipp Benz, Dawit M. Argaw, Jean-Charles Bazin, In So Kweon

The British Machine Vision Conference (BMVC), Sep 2019

[Paper]

Spotlight Presentation

Variational Prototyping-Encoder: One-Shot Learning with Prototypical Images

Junsik Kim, Tae-Hyun Oh, Seokju Lee, Fei Pan, In So Kweon

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2019

[Paper] [Project]

2018

Co-domain Embedding using Deep Quadruplet Networks for Unseen Traffic Sign Recognition

Junsik Kim, Seokju Lee, Tae-Hyun Oh, In So Kweon

AAAI Conference on Artificial Intelligence (AAAI), Feb 2018

[Paper] [Project]

Best Poster Presentation Award, 30th IPIU 2018

2017

VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition

Seokju Lee, Junsik Kim, Jae Shin Yoon, Seunghak Shin, Oleksandr Bailo, Namil Kim, Tae-Hee Lee, Hyun Seok Hong, Seung-Hoon Han, In So Kweon

IEEE International Conference on Computer Vision (ICCV), Oct 2017

[Paper] [Project] [Code] [Poster] [Patent]

Patent in Korea (10-2018-0048407)

Pixel-Level Matching for Video Object Segmentation Using Convolutional Neural Networks

Jae Shin Yoon, Francois Rameau, Junsik Kim, Seokju Lee, Seunghak Shin, In So Kweon

IEEE International Conference on Computer Vision (ICCV), Oct 2017

[Paper] [Project]

Robust Road Marking Detection and Recognition Using Density-Based Grouping and Machine Learning Techniques

Oleksandr Bailo, Seokju Lee, Francois Rameau, Jae Shin Yoon, In So Kweon

IEEE Winter Conference on Applications of Computer Vision (WACV), Mar 2017

[Paper] [Video]

2016

Fast Multiple Objects Detection and Tracking Fusing Color Camera and 3D LIDAR for Intelligent Vehicles

Soonmin Hwang, Namil Kim, Yukyung Choi, Seokju Lee, In So Kweon

IEEE International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Aug 2016

[Paper] [Project]

2015

Rich Feature Hierarchies from Omni-directional RGB-DI Information for Pedestrian Detection

Seokju Lee, Sungsik Huh, Donggeun Yoo, In So Kweon, David Hyunchul Shim

IEEE International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Oct 2015

[Paper]

2014

Development of an Exploration Rover Platform for Sample Return Mission

Seokju Lee, Sungsik Huh, Sungyeon Park, David Hyunchul Shim

IEEE International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Nov 2014

[Paper] [Video]

Other Publications


  • A Flight Test for Neutralization of Enemy Position Using Intelligent Cooperative System of Heterogeneous Unmanned Vehicle System

Hanjun Song, Seokju Lee, Sungwook Cho, and David Hyunchul Shim

The Korean Society for Aeronautical and Space Sciences Spring Conference (KSAS), Apr 2015

[Paper] [IEEE Spectrum]


  • Development of Robotic Hand System Using Vision-Based Motion Sensor

Seokju Lee, Hanjun Song, and David Hyunchul Shim

The 29th Institute of Control, Robotics and Systems Annual Conference (ICROS), May 2014

[Paper] [Project] [Video]


  • Development of a Rover Platform for Exploration and Sample Return Mission

Seokju Lee, Sungsik Huh, Dasol Lee, Sungwook Cho, and David Hyunchul Shim

The Korean Society for Aeronautical and Space Sciences Spring Conference (KSAS), Apr 2014

[Paper] [Video]

Thesis


  • Learning-Based Visual Perception Using Semantic and Geometric Priors for Autonomous Driving

Ph.D. Thesis, Aug. 2021.

[Paper]


  • Hierarchical Pedestrian Detection Using Omnidirectional Camera and Laser Sensor Fusion

M.S. Thesis, Aug. 2015.

[Paper]

Patents


  • APPARATUS AND METHOD FOR LEARNING A NEURAL NETWORK

KR 10-2019-0029083


  • APPARATUS AND METHOD FOR DETECTING A LANE

KR 10-2018-0048407

Awards & Honors


  • Awards

- Silver Prize, 16th Samsung Electro-Mechanics Best Paper Award, Dec 2020

- Honorable Mention, 12th Electronic Times ICT Paper Contest, Dec 2020

- Best Poster Presentation Award, 30th IPIU 2018, Feb 2018


  • Honors

- Winner, Qualcomm Innovation Fellowship (QIF 2020), Dec 2020

- Stars of Tomorrow Internship Program, Microsoft Research Asia (MSRA), Dec 2018

- Certificate, International Computer Vision Summer School (ICVSS 2017), Jul 2017

Academic Activities


  • Journal Reviewer

- International Journal of Computer Vision (IJCV)

- Autonomous Robots (AURO)


  • Conference Reviewer

- IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018, 2019, 2020, 2021

- IEEE International Conference on Computer Vision (ICCV) 2021

- Conference on Neural Information Processing Systems (NeurIPS) 2020, 2021

- International Conference on Machine Learning (ICML) 2021

- International Conference on Learning Representations (ICLR) 2022

- AAAI Conference on Artificial Intelligence (AAAI) 2021

- IEEE Winter Conference on Applications of Computer Vision (WACV) 2021

- Asian Conference on Computer Vision (ACCV) 2020

- International Conference on 3D Vision (3DV) 2020

Last updated: Jan 05, 2022