Seungryul Baek ( 백승렬 )
Associate Professor
UNIST Vision and Learning (UVL) Lab
Artificial Intelligent Graduate School (AIGS) & Department of Computer Science and Engineering
College of Information and Biotechnology
Ulsan National Institute of Science and Technology (UNIST)
Email: srbaek@unist.ac.kr (official), sryul.baek@gmail.com (personal)
Links: [Lab Homepage: http://vision.unist.ac.kr], [YouTube channel], [Google scholar]
50 UNIST-gil, Ulju, Ulsan, South Korea, 44919
Brief Bio: I am an associate professor, jointly affiliated to the Artificial Intelligence Graduate School (AIGS) and Department of Computer Science and Engineering (CSE) at UNIST where I joined in April 2020. I obtained BS (2009) and MS (2011) degrees from Dept. of Electrical Engineering at KAIST and Ph.D. degree (2020) from Dept. of Electrical and Electronic Engineering at Imperial College London. I have interned at INRIA Sophia Antipolis (2019.6-2019.8.) and was a Post-doctoral Research Assistant at University of Oxford (2019.11-2020.2). Before joining Ph.D., I was an employee at DMC Research Center of Samsung Electronics for four years (2011.2.-2015.2.).
Research Interests
Computer Vision and Machine Learning (Deep Learning).
3D Pose Estimation/Mesh Reconstruction, Action/Gesture Recognition, Semantic Segmentation, Object Recognition.
Education
Ph.D. at Dept. of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom.
Advisor: Tae-Kyun Kim
Sep. 2015 ~ Mar. 2020.
M.S. at Dept. of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea.
Advisor: Chang D. Yoo
Feb. 2009 ~ Feb. 2011.
B.S. at Dept. of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea.
Mar. 2004 ~ Jan. 2009.
Work Experiences
Associate Professor, Ulsan National Institute of Science and Technology (UNIST), Ulsan, South Korea.
AI Graduate School and Dept. of CSE
Mar. 2024 ~ (Present).
Assistant Professor, Ulsan National Institute of Science and Technology (UNIST), Ulsan, South Korea.
AI Graduate School and Dept. of CSE
Apr. 2020 ~ Feb. 2024.
Post-doctoral Research Assistant, University of Oxford, Oxford, United Kingdom.
Advisor: Victor Adrian Prisacariu
Nov. 2019 ~ Feb. 2020.
Student Internship, INRIA Sophia Antipolis, Nice, France.
Advisor: François Brémond
Jun. 2019 ~ Aug. 2019.
Computer Vision Engineer, Samsung Electronics, DMC Research, Suwon, South Korea.
This job is taken as the alternative to the military duties in South Korea.
Feb. 2011 ~ Feb. 2015.
Publications
Junsu Kim, Hoseong Cho, Jihyeon Kim, Yihalem Yimolal Tiruneh, Seungryul Baek, "SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2024 (Highlight poster presentation, 324/11,532≈2.8% Accept ratio, accepted).
Junuk Cha, Jihyeon Kim, Jae Shin Yoon*, Seungryul Baek*, "Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interaction", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2024 (accepted).
Jongwook Choi, Taehoon Kim, Yonghyun Jeong, Seungryul Baek, Jongwon Choi, "Exploiting Style Latent Flows for Generalizing Video Deepfake Detection", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2024 (accepted).
Junsu Kim, Yunhoe Ku, Jihyeon Kim, Junuk Cha, Seungryul Baek, "VLM-PL: Advanced Pseudo Labeling approach Class Incremental Object Detection with Vision-Language Model", CVPR Workshop on Continual Learning Vision (CLVision), Seattle, USA, 2024 (accepted).
Junsu Kim, Sumin Hong, Chanwoo Kim, Jihyeon Kim, Yihalem Yimolal Tiruneh, Jeongwan On, Jihyun Song, Sunhwa Choi, Seungryul Baek, "Class-wise Buffer Management for Incremental Object Detection: An Effective Buffer Training Strategy", in Proc. of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, South Korea, 2024.
YunSeong Cho, Chanwoo Kim, Hoseong Cho, Yunhoe Ku, Eunseo Kim, Muhammadjon Boboev, Joonseok Lee, Seungryul Baek, "RMFER: Semi-supervised Contrastive Learning for Facial Expression Recognition with Reaction Mashup Video", in Proc. of IEEE Winter Conf. on Applications of Computer Vision (WACV), Hawaii, USA, 2024 (Oral presentation, 53/2,042≈2.6% Accept ratio).
Junuk Cha, Hansol Lee, Jaewon Kim, Nhat Nguyen Bao Truong, Jae Shin Yoon*, Seungryul Baek*, "3D Reconstruction of Interacting Multi-Person in Clothing from a Single Image", in Proc. of IEEE Winter Conf. on Applications of Computer Vision (WACV), Hawaii, USA, 2024.
Nodirkhuja Khujaev, Tsoy Roman, Seungryul Baek, "AstroYOLO: Learning Astronomy Multi-Tasks in a Single Unified Real-Time Framework", in NeurIPS 2023 Workshop on Machine Learning and Physical Sciences, New Orleans, USA, 2023.
Uyoung Jeong, Seungryul Baek, Hyung Jin Chang, Kwang In Kim, "BoIR: Box-Supervised Instance Representation for Multi Person Pose Estimation", in Proc. of British Machine Vision Conference (BMVC), Aberdeen, UK, 2023.
Hoseong Cho, Chanwoo Kim, Jihyeon Kim, Seongyeong Lee, Elkhan Ismayilzada, Seungryul Baek, "Transformer-based Unified Recognition of Two Hands Manipulating Objects", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Vancouver, Canada, 2023.
Seongyeong Lee, Hansoo Park, Jihyeon Kim, Dong Uk Kim, Muhammadjon Boboev, Seungryul Baek, "Image-free Domain Generalization via CLIP for 3D Hand Pose Estimation", in Proc. of IEEE Winter Conf. on Applications of Computer Vision (WACV), Hawaii, USA, 2023.
Junuk Cha, Muhammad Saqlain, GeonU Kim, Mingyu Shin, Seungryul Baek, "Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinement", in Proc. of European Conf. on Computer Vision (ECCV), Tel Aviv, Israel, 2022.
Junuk Cha, Muhammad Saqlain, Donguk Kim, Seungeun Lee, Seongyeong Lee, Seungryul Baek, "Learning 3D Skeletal Representation From Transformer for Action Recognition", in IEEE Access 2022 (IF:3.367).
Muhammad Saqlain, Donguk Kim, Junuk Cha, Changhwa Lee, Seongyeong Lee, Seungryul Baek, "3DMesh-GAR: 3D human body mesh-based method for group activity recognition", in Sensors 2022 (IF:3.576).
Dong Uk Kim, Kwang In Kim, Seungryul Baek, ''End-to-End Detection and Pose Estimation of Two Interacting Hands'', in Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Virtual, 2021.
Junuk Cha, Muhammad Saqlain, Changhwa Lee, Seongyeong Lee, Seungeun Lee, Donguk Kim, Won-Hee Park, Seungryul Baek, "Towards Single 2D Image-level Self-supervision for 3D Human Pose and Shape Estimation", in Journal of Applied Sciences 2021 (IF:2.679).
Anil Armagan, Guillermo Garcia-Hernando, Seungryul Baek, Shreyas Hampali, Mahdi Rad, Zhaohui Zhang, Shipeng Xie, Neo Chen, Boshen Zhang, Fu Xiong, Yang Xiao, Zhiguo Cao, Junsong Yuan, Pengfei Ren, Weiting Huang, haifeng sun, Marek Hrúz, Jakub Kanis, Zdeněk Krňoul, Qingfu Wan, Shile Li, Dongheui Lee, Linlin Yang, Angela Yao, Yun-Hui Liu, Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Philippe Weinzaepfel, Romain Brégier, Grégory Rogez, Vincent Lepetit, Tae-Kyun Kim, ''Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction'', in Proc. of European Conf. on Computer Vision (ECCV), Edinburgh, UK, 2020.
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Weakly-supervised Domain Adaptation via GAN and Mesh Model for Estimating 3D Hand Poses Interacting Objects", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2020 (Oral presentation, 335/5,865≈5.7% Accept ratio).
Binod Bhattarai, Seungryul Baek, Rumeysa Bodur, Tae-Kyun Kim, "Sampling Strategies for GAN Synthetic Data", in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 2020.
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Pushing the envelope for RGB-based dense 3D hand pose estimation via neural rendering", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2019.
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Augmented skeleton space transfer for depth-based hand pose estimation", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 2018 (Oral presentation, 70/3,300≈2.1% Accept ratio).
Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim, "First-person hand action benchmark with RGB-D videos and 3D hand pose annotations", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 2018.
Seungryul Baek, Zhiyuan Shi, Masato Kawade, Tae-Kyun Kim, "Kinematic-layout-aware random forests for depth-based action recognition", in Proc. of British Machine Vision Conference (BMVC), London, UK, 2017 (Oral presentation, 36/635≈5.6% Accept ratio).
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Real-time online action detection forests using spatio-temporal contexts", in Proc. of IEEE Winter Conf. on Applications of Computer Vision (WACV), Santa Rosa, CA, USA, 2017.
Seungryul Baek, Taegyu Lim, Yong Seok Heo, Sungbum Park, Hantak Kwak and Woosung Shim, "Superpixel coherency and uncertainty models for semantic segmentation", in Proc. of IEEE Int. Conf. on Computer Vision (ICCV) workshop on PGMs, Sydney, Australia, 2013.
Seungryul Baek, Chang D. Yoo, Sungrack Yun, "Learning a discriminative visual codebook using homonym scheme", in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 2011.
Honors and Awards
Best Paper Award Finalist at WACV 2024.
Special Prize at UNIST AI Challenger Program (AICP) 2023.
Best Paper Award (Encouragement) at Autumn Annual Conference of IEIE 2023.
3rd place at HANDS workshop challenge - ARCTIC held in ICCV 2023.
Achievement Award at AI Association 2022.
1st place at HBHA challenge (Egocentric 3D hand pose estimation) held in ECCV 2022.
2nd place at HBHA challenge (Hand and object pose based action recognition) held in ECCV 2022.
Best Paper Award (Encouragement) at IPIU 2022.
Best Paper Award Nominee at CVPR 2020.
Silver prize at KIPS (Korea Information Processing Society) 2020 Fall Conference Paper Awards.
Europe Finalist at Qualcomm Innovation Fellowship 2018.
Silver prize at Samsung Best Paper Awards 2013.
Academic Activities
Program Committee for Korean Conference on Computer Vision (KCCV) 2024, 12-14 Aug. 2024.
Organizing Committee for AI Association's Autumn Conference 2023, 23-25 Nov. 2023.
Chair for International Paper Session (NLP & Computer Vision) at Summer Conference of AI Association, 18 Jul. 2023.
Organizing Committee for AI Association's Autumn Conference 2022, 17-19 Nov. 2022.
Paper Committee for AI Association's Summer Conference 2022, 1-3 Aug. 2022.
Organizing Committee for AI Winter School by AI Association, 17 Feb. 2022.
Chair for International Paper Session (NLP & Machine Learning) at Fall Conference of AI Association, 5 Nov. 2021.
Chair for International Paper Session (NLP & Computer Vision) at Summer Conference of AI Association, 9 Jul. 2021.
Executive member of AI Association (Since 2020).
Senior Program Committee at AAAI 2024, AAAI 2023.
Program Committee (Peer-Reviewer) at ACCV 2024, ECCV 2024, ICML 2024, IJCAI 2024, CVPR 2024, VR 2024, ICASSP 2024, FG 2024, WACV 2024, NeurIPS 2023, BMVC 2023, ICCV 2023, CAI 2023, IJCAI 2023, CVPR 2023, WACV 2023, ICLR 2023, BMVC 2022, SIGGRAPH 2022, NeurIPS 2022, ECCV 2022, CVPR 2022, AAAI 2022, IJCAI 2022, ICLR 2022, WACV 2022, FG 2022, JKAIA2021, CKAIA 2021, CVPR 2021, BMVC 2021, IJCAI 2021, WACV 2021, AAAI 2021, JKAIA 2020, ACCV 2020, BMVC 2020, ECCV 2020, CVPR 2020, AAAI 2020, CKAIA 2020, ICCV 2019, BMVC 2019, CVPR 2019, ICCV HANDS 2019 Workshop, BMVC 2018 (emergency reviewer).
Journal Reviewer at Journal of Imaging (since 2020), Sensors (since 2020), Pattern Recognition (since 2020), International Journal of Computer Vision (since 2018), Neurocomputing (since 2019), IEEE Transactions on Circuits and Systems for Video Technology (since 2019), IET Computer Vision (since 2019).
Challenge Committee at HANDS Workshop 2019 (ICCV).
Challenge Committee at HANDS Workshop 2018 (ECCV).
Student Volunteer at BMVC 2017.
Invited Talks & Lectures
Lecture at 5th Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 14 Jun. 2024.
Lecture at 5th Gyungnam AI Novatus Academia (AI Basic 1 part) by UNIST AI Innovation Park, Masan, South Korea, 3 May. 2024.
Invited Talk at Ajou Univ., Suwon, South Korea, 4th Apr. 2024.
Lecture at 4th Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 20 Oct. 2023.
Lecture at 6th AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 25 Aug. 2023.
Invited Talk at Electronics and Telecommunications Research Institute (ETRI), Daejeon, South Korea, 21th Aug. 2023.
Invited Talk at Ajou Univ., Suwon, South Korea, 18th May. 2023.
Lecture at 3rd Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 21 Apr. 2023.
Lecture at 5th AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 24 Feb. 2023.
Invited Talk at Korean Computer Vision Society (KCVS) Forum, Seoul, South Korea, 27 Jan. 2023.
Invited Talk at Korea Electronics Technology Institute (KETI), Seoul, South Korea, 1 Dec. 2022.
Lecture at 2nd Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 21 Oct. 2022.
Invited Talk at Chung-Ang Univ., Seoul, South Korea, 27th Sep. 2022.
Lecture at 4th AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 19 Aug. 2022.
Lecture at Spring Coding School by AI Association, Virtual, 27 May. 2022.
Invited Talk at Samsung Display, Yongin, South Korea, 18 May. 2022 ~ 6 Jul. 2022.
Lecture at 1st Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 15 Apr. 2022.
Lecture at 3rd AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 25 Feb. 2022.
Lecture at AI Winter School by AI Association, Virtual, 17 Feb. 2022.
Invited Talk at 34th Workshop on Image Processing and Image Understanding (IPIU) 2022, Virtual, 10 Feb. 2022.
Invited Talk at LG Electronics, Changwon, South Korea, 9 Dec. 2021.
Invited Talk at Chonnam Nat. Univ., Gwangju, South Korea, 7 Oct. 2021.
Invited Talk at Chung-Ang Univ., Seoul, South Korea, 24 Sep. 2021.
Lecture at 2nd AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 16 Sep. 2021.
Lecture at 1st AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 26 Mar. 2021.
Invited Talk at UNIST, Ulsan, South Korea, 18 Dec. 2019.
Invited Talk at Microsoft Research, Zurich, Switzerland, 5 Jun. 2019.
Invited Talk at INRIA, Paris, France, 6 Mar. 2019.
Invited Talk at KAIST, Daejeon, South Korea, 2 Jan. 2019.
Invited Talk at NAVER Corp., Seongnam, South Korea, 28 Dec. 2018.
Invited Talk at Samsung Advanced Institute of Technology (SAIT), Suwon, South Korea, 18 Dec. 2018.
Invited Talk at AI and CV Research Workshop 2018, Munich, Germany, 13 Sep. 2018.
Invited Talk at Global Top Talent Forum 2018 Competition by Hyundai Motors, San Diego, CA, USA, 18 Aug. 2018.
Invited Talk at Qualcomm Innovation Fellowship 2018 Final Day, Amsterdam, Netherlands, 3 May, 2018.
Invited Talk at AI and 3D Research workshop 2017, London, UK, 13 Dec. 2017.
Teaching
2024 Fall - CSE47201 Computer Vision.
2024 Spring - AI516 Computer Vision (code shared to CSE54501 Advanced Computer Vision).
2023 Fall - AI516 Computer Vision (code shared to CSE54501 Advanced Computer Vision), Course evaluation: 4.54/5.0.
2023 Spring - ITP11701 Introduction to AI Programming 2, Course evaluation: 4.58/5.0.
2022 Fall - CSE47201 Computer Vision, Course evaluation: 4.55/5.0.
2022 Spring - AI51801 Deep Generative Models (code shared to CSE54501 Advanced Computer Vision), Course evaluation: 4.73/5.0.
2021 Fall - ITP11701 Introduction to AI Programming 2, Course evaluation: 4.52/5.0.
2021 Fall - AI51801 Deep Generative Models (code shared to CSE54501 Advanced Computer Vision), Course evaluation: 4.66/5.0.
2021 Spring - AI50301 AI Toolkit (code shared to CSE61001 CSE Special Topics (AI Toolkit)) Course evaluation: 4.27/5.0.
2020 Fall - CSE48001 CSE Special Topics (Computer Vision), Course evaluation: 4.61/5.0.
Alumni
Yunhoe Ku, Master student (2022 ~ 2024), now in Deep Brain AI, South Korea.
Jihyeon Kim, Master student (2022 ~ 2024), now in KETI, South Korea.
Hoseong Cho, Master student (2022 ~ 2024), now in LG Electronics, South Korea.
Hansoo Park, Master student (2021 ~ 2023), now in KIST, South Korea.
Hansol Lee, Master student (2021 ~ 2023), now in KIST, South Korea.
Yunseong Cho, Master student (2021 ~ 2023), now in Super Labs Corp., South Korea.
Dong Uk Kim, Master student (2021 ~ 2023), now in NALBI Inc., South Korea.
Seongyeong Lee, Master student (2020 ~ 2022), now in NC Soft, South Korea.
Changhwa Lee, Master student (2020 ~ 2022), now in Kakao Brain, South Korea.
Muhammad Saqlain, PostDoc (2021 ~ 2022), now in eSmart Systems, Norway.