Seungryul Baek ( 백승렬 )
Assistant Professor
UNIST Vision and Learning (UVL) Lab
Artificial Intelligent Graduate School (AIGS) & Department of Computer Science and Engineering
College of Information and Biotechnology
Ulsan National Institute of Science and Technology (UNIST)
Email: srbaek@unist.ac.kr (official), sryul.baek@gmail.com (personal)
Links: [UVL Lab webpage], [Google scholar]
50 UNIST-gil, Ulju, Ulsan, South Korea, 44919
Brief Bio: I am an assistant professor, jointly affiliated to the Artificial Intelligence Graduate School (AIGS) and Department of Computer Science and Engineering (CSE) at UNIST since April 2020. I obtained BS (2009) and MS (2011) degrees from Dept. of Electrical Engineering at KAIST and Ph.D. degree (2020) from Dept. of Electrical and Electronic Engineering at Imperial College London. I have interned at INRIA Sophia Antipolis (2019.6-2019.8.) and was a Post-doctoral Research Assistant at University of Oxford (2019.11-2020.2). Before joining Ph.D., I was an employee at DMC Research Center of Samsung Electronics for four years (2011.2.-2015.2.).
Research Interests
Computer Vision and Machine Learning (Deep Learning).
3D Pose Estimation/Mesh Reconstruction, Action/Gesture Recognition, Semantic Segmentation, Object Recognition.
Education
Ph.D. at Dept. of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom.
Advisor: Tae-Kyun Kim
Sep. 2015 ~ Mar. 2020.
M.S. at Dept. of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea.
Advisor: Chang D. Yoo
Feb. 2009 ~ Feb. 2011.
B.S. at Dept. of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea.
Mar. 2004 ~ Jan. 2009.
Work Experiences
Assistant Professor, AI Graduate School and Dept. of CSE, UNIST, South Korea.
Apr. 2020 ~ (Present).
Post-doctoral Research Assistant, Univ. of Oxford, United Kingdom.
Advisor: Victor Adrian Prisacariu
Nov. 2019 ~ Feb. 2020.
Student Internship, INRIA Sophia Antipolis, France.
Advisor: François Brémond
Jun. 2019 ~ Aug. 2019.
Computer Vision Engineer, Samsung Electronics, DMC Research, Suwon, South Korea.
This job is taken as the alternative to the military duties in South Korea.
Feb. 2011 ~ Feb. 2015.
Publications
Uyoung Jeong, Seungryul Baek, Hyung Jin Chang, Kwang In Kim, "BoIR: Box-Supervised Instance Representation for Multi Person Pose Estimation", in Proc. of British Machine Vision Conference (BMVC), Aberdeen, UK, 2023. (accepted)
Hoseong Cho, Chanwoo Kim, Jihyeon Kim, Seongyeong Lee, Elkhan Ismayilzada, Seungryul Baek, "Transformer-based Unified Recognition of Two Hands Manipulating Objects", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Vancouver, Canada, 2023.
Junsu Kim, Sumin Hong, Chanwoo Kim, Hoseong Cho, Yihalem Yimolal Tiruneh, Jihyeon Kim, Eunseo Kim, Jihyeon Song, Sunhwa Choi, Seungryul Baek, "An Effective Buffer Training Strategy for Class-Incremental Object Detection", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) workshop on Continual Learning Vision (CLVision), Vancouver, Canada, 2023.
Seongyeong Lee, Hansoo Park, Jihyeon Kim, Dong Uk Kim, Muhammadjon Boboev, Seungryul Baek, "Image-free Domain Generalization via CLIP for 3D Hand Pose Estimation", in Proc. of IEEE Winter Conf. on Applications of Computer Vision (WACV), Hawaii, USA, 2023.
Junuk Cha, Muhammad Saqlain, GeonU Kim, Mingyu Shin, Seungryul Baek, "Multi-Person 3D Pose and Shape Estimation via Inverse Kinematics and Refinement", in Proc. of European Conf. on Computer Vision (ECCV), Tel Aviv, Israel, 2022.
Junuk Cha, Muhammad Saqlain, Donguk Kim, Seungeun Lee, Seongyeong Lee, Seungryul Baek, "Learning 3D Skeletal Representation From Transformer for Action Recognition", in IEEE Access 2022 (IF:3.367).
Muhammad Saqlain, Donguk Kim, Junuk Cha, Changhwa Lee, Seongyeong Lee, Seungryul Baek, "3DMesh-GAR: 3D human body mesh-based method for group activity recognition", in Sensors 2022 (IF:3.576).
Dong Uk Kim, Kwang In Kim, Seungryul Baek, ''End-to-End Detection and Pose Estimation of Two Interacting Hands'', in Proc. of IEEE Int. Conf. on Computer Vision (ICCV), Virtual, 2021.
Junuk Cha, Muhammad Saqlain, Changhwa Lee, Seongyeong Lee, Seungeun Lee, Donguk Kim, Won-Hee Park, Seungryul Baek, "Towards Single 2D Image-level Self-supervision for 3D Human Pose and Shape Estimation", in Journal of Applied Sciences 2021 (IF:2.679).
Anil Armagan, Guillermo Garcia-Hernando, Seungryul Baek, Shreyas Hampali, Mahdi Rad, Zhaohui Zhang, Shipeng Xie, Neo Chen, Boshen Zhang, Fu Xiong, Yang Xiao, Zhiguo Cao, Junsong Yuan, Pengfei Ren, Weiting Huang, haifeng sun, Marek Hrúz, Jakub Kanis, Zdeněk Krňoul, Qingfu Wan, Shile Li, Dongheui Lee, Linlin Yang, Angela Yao, Yun-Hui Liu, Adrian Spurr, Pavlo Molchanov, Umar Iqbal, Philippe Weinzaepfel, Romain Brégier, Grégory Rogez, Vincent Lepetit, Tae-Kyun Kim, ''Measuring Generalisation to Unseen Viewpoints, Articulations, Shapes and Objects for 3D Hand Pose Estimation under Hand-Object Interaction'', in Proc. of European Conf. on Computer Vision (ECCV), Edinburgh, UK, 2020.
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Weakly-supervised Domain Adaptation via GAN and Mesh Model for Estimating 3D Hand Poses Interacting Objects", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2020 (Oral presentation, 5.7% Accept ratio).
Binod Bhattarai, Seungryul Baek, Rumeysa Bodur, Tae-Kyun Kim, "Sampling Strategies for GAN Synthetic Data", in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain, 2020.
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Pushing the envelope for RGB-based dense 3D hand pose estimation via neural rendering", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2019.
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Augmented skeleton space transfer for depth-based hand pose estimation", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 2018 (Oral presentation, 2.1% Accept ratio).
Guillermo Garcia-Hernando, Shanxin Yuan, Seungryul Baek, Tae-Kyun Kim, "First-person hand action benchmark with RGB-D videos and 3D hand pose annotations", in Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, Utah, USA, 2018.
Seungryul Baek, Zhiyuan Shi, Masato Kawade, Tae-Kyun Kim, "Kinematic-layout-aware random forests for depth-based action recognition", in Proc. of British Machine Vision Conference (BMVC), London, UK, 2017 (Oral presentation, 5.6% Accept ratio).
Seungryul Baek, Kwang In Kim, Tae-Kyun Kim, "Real-time online action detection forests using spatio-temporal contexts", in Proc. of IEEE Winter Conf. on Applications of Computer Vision (WACV), Santa Rosa, CA, USA, 2017.
Seungryul Baek, Taegyu Lim, Yong Seok Heo, Sungbum Park, Hantak Kwak and Woosung Shim, "Superpixel coherency and uncertainty models for semantic segmentation", in Proc. of IEEE Int. Conf. on Computer Vision (ICCV) workshop on PGMs, Sydney, Australia, 2013.
Seungryul Baek, Chang D. Yoo, Sungrack Yun, "Learning a discriminative visual codebook using homonym scheme", in Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Prague, Czech Republic, 2011.
Honors and Awards
Achievement Award at AI Association 2022.
1st place at HBHA challenge (Egocentric 3D hand pose estimation) held in ECCV 2022.
2nd place at HBHA challenge (Hand and object pose based action recognition) held in ECCV 2022.
Best Paper Award (Encouragement) at IPIU 2022.
Best Paper Award Nominee at CVPR 2020.
Silver prize at KIPS (Korea Information Processing Society) 2020 Fall Conference Paper Awards.
Europe Finalist at Qualcomm Innovation Fellowship 2018.
Silver prize at Samsung Best Paper Awards 2013.
Academic Activities
Chair for International Paper Session (NLP & Computer Vision) at Summer Conference of AI Association, 18 Jul. 2023.
Organizing Committee for AI Association's Autumn Conference 2022, 17-19 Nov. 2022.
Paper Committee for AI Association's Summer Conference 2022, 1-3 Aug. 2022.
Organizing Committee for AI Winter School by AI Association, 17 Feb. 2022.
Chair for International Paper Session (NLP & Machine Learning) at Fall Conference of AI Association, 5 Nov. 2021.
Chair for International Paper Session (NLP & Computer Vision) at Summer Conference of AI Association, 9 Jul. 2021.
Executive member of AI Association (Since 2020).
Senior Program Committee at AAAI 2024, AAAI 2023.
Program Committee (Peer-Reviewer) at VR 2024, ICASSP 2024, FG 2024, WACV 2024, NeurIPS 2023, BMVC 2023, ICCV 2023, CAI 2023, IJCAI 2023, CVPR 2023, WACV 2023, ICLR 2023, BMVC 2022, SIGGRAPH 2022, NeurIPS 2022, ECCV 2022, CVPR 2022, AAAI 2022, IJCAI 2022, ICLR 2022, WACV 2022, FG 2022, JKAIA2021, CKAIA 2021, CVPR 2021, BMVC 2021, IJCAI 2021, WACV 2021, AAAI 2021, JKAIA 2020, ACCV 2020, BMVC 2020, ECCV 2020, CVPR 2020, AAAI 2020, CKAIA 2020, ICCV 2019, BMVC 2019, CVPR 2019, ICCV HANDS 2019 Workshop, BMVC 2018 (emergency reviewer).
Journal Reviewer at Journal of Imaging (since 2020), Sensors (since 2020), Pattern Recognition (since 2020), International Journal of Computer Vision (since 2018), Neurocomputing (since 2019), IEEE Transactions on Circuits and Systems for Video Technology (since 2019), IET Computer Vision (since 2019).
Challenge Committee at HANDS Workshop 2019 (ICCV).
Challenge Committee at HANDS Workshop 2018 (ECCV).
Student Volunteer at BMVC 2017.
Invited Talks & Lectures
Lecture at 4th Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 20 Oct. 2023.
Lecture at 6th AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 25 Aug. 2023.
Invited Talk at Electronics and Telecommunications Research Institute (ETRI), Daejeon, South Korea, 21th Aug. 2023.
Invited Talk at Ajou Univ., Suwon, South Korea, 18th May. 2023.
Lecture at 3rd Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 21 Apr. 2023.
Lecture at 5th AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 24 Feb. 2023.
Invited Talk at Korean Computer Vision Society (KCVS) Forum, Seoul, South Korea, 27 Jan. 2023.
Invited Talk at Korea Electronics Technology Institute (KETI), Seoul, South Korea, 1 Dec. 2022.
Lecture at 2nd Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 21 Oct. 2022.
Invited Talk at Chung-Ang Univ., Seoul, South Korea, 27th Sep. 2022.
Lecture at 4th AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 19 Aug. 2022.
Lecture at Spring Coding School by AI Association, Virtual, 27 May. 2022.
Invited Talk at Samsung Display, Yongin, South Korea, 18 May. 2022 ~ 6 Jul. 2022.
Lecture at 1st Gyungnam AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Masan, South Korea, 15 Apr. 2022.
Lecture at 3rd AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 25 Feb. 2022.
Lecture at AI Winter School by AI Association, Virtual, 17 Feb. 2022.
Invited Talk at 34th Workshop on Image Processing and Image Understanding (IPIU) 2022, Virtual, 10 Feb. 2022.
Invited Talk at LG Electronics, Changwon, South Korea, 9 Dec. 2021.
Invited Talk at Chonnam Nat. Univ., Gwangju, South Korea, 7 Oct. 2021.
Invited Talk at Chung-Ang Univ., Seoul, South Korea, 24 Sep. 2021.
Lecture at 2nd AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 16 Sep. 2021.
Lecture at 1st AI Novatus Academia (Computer Vision part) by UNIST AI Innovation Park, Ulsan, South Korea, 26 Mar. 2021.
Invited Talk at UNIST, Ulsan, South Korea, 18 Dec. 2019.
Invited Talk at Microsoft Research, Zurich, Switzerland, 5 Jun. 2019.
Invited Talk at INRIA, Paris, France, 6 Mar. 2019.
Invited Talk at KAIST, Daejeon, South Korea, 2 Jan. 2019.
Invited Talk at NAVER Corp., Seongnam, South Korea, 28 Dec. 2018.
Invited Talk at Samsung Advanced Institute of Technology (SAIT), Suwon, South Korea, 18 Dec. 2018.
Invited Talk at AI and CV Research Workshop 2018, Munich, Germany, 13 Sep. 2018.
Invited Talk at Global Top Talent Forum 2018 Competition by Hyundai Motors, San Diego, CA, USA, 18 Aug. 2018.
Invited Talk at Qualcomm Innovation Fellowship 2018 Final Day, Amsterdam, Netherlands, 3 May, 2018.
Invited Talk at AI and 3D Research workshop 2017, London, UK, 13 Dec. 2017.
Teaching
2023 Fall - AI516 Computer Vision (code shared to CSE54501 Advanced Computer Vision).
2023 Spring - ITP11701 Introduction to AI Programming 2.
2022 Fall - CSE47201 Computer Vision.
2022 Spring - AI51801 Deep Generative Models (code shared to CSE54501 Advanced Computer Vision).
2021 Fall - ITP11701 Introduction to AI Programming 2.
2021 Fall - AI51801 Deep Generative Models (code shared to CSE54501 Advanced Computer Vision).
2021 Spring - AI50301 AI Toolkit (code shared to CSE61001 CSE Special Topics (AI Toolkit)).
2020 Fall - CSE48001 CSE Special Topics (Computer Vision).
Alumni
Hansol Lee, Master student (2021 ~ 2023), now in KIST, South Korea.
Yunseong Cho, Master student (2021 ~ 2023), now in Super Labs Corp., South Korea.
Dong Uk Kim, Master student (2021 ~ 2023), now in NALBI Inc., South Korea.
Seongyeong Lee, Master student (2020 ~ 2022), now in NC Soft, South Korea.
Changhwa Lee, Master student (2020 ~ 2022), now in Kakao Brain, South Korea.
Muhammad Saqlain, PostDoc (2021 ~ 2022), now in eSmart Systems, Norway.