MemoryTalker: Personalized Speech-Driven 3D Facial Animation via Audio-Guided Stylization

Hyung Kyu Kim, Sangmin Lee☨, Hak Gu Kim☨ (☨ Corresponding Author)

ICCV 2025 (Top-tier AI Conf.)

SocialGesture: Delving into Multi-person Gesture Understanding

Xu Cao, Pranav Virupaksha, Wenqi Jia, Bolin Lai, Fiona Ryan, Sangmin Lee☨, James M. Rehg☨ (☨ Corresponding Author)

CVPR 2025 (Top-tier AI Conf.)

Object-aware Sound Source Localization via Audio-Visual Scene Understanding

Sung Jin Um*, Dongjin Kim*, Sangmin Lee☨, Jung Uk Kim☨ (* Equal Contribution, ☨ Corresponding Author)

CVPR 2025 (Top-tier AI Conf.)

Gaze-LLE: Gaze Target Estimation via Large-Scale Learned Encoders

Fiona Ryan, Ajay Bati, Sangmin Lee, Daniel Bolya, Judy Hoffman, James M. Rehg

CVPR 2025 (Top-tier AI Conf.) (Highlight) [ Acceptance Rate 4% ]

Unleashing In-context Learning of Autoregressive Models for Few-shot Image Manipulation

Bolin Lai, Felix Juefei-Xu, Miao Liu, Xiaoliang Dai, Nikhil Mehta, Chenguang Zhu, Zeyi Huang, James M. Rehg,
Sangmin Lee, Ning Zhang, Tong Xiao

CVPR 2025 (Top-tier AI Conf.) (Highlight) [ Acceptance Rate 4% ]

Question-Aware Gaussian Experts for Audio-Visual Question Answering

Hongyeob Kim*, Inyoung Jung*, Dayoon Suh, Youjia Zhang, Sangmin Lee, Sungeun Hong (* Equal Contribution)

CVPR 2025 (Top-tier AI Conf.) (Highlight) [ Acceptance Rate 4% ]

Watch Video, Catch Keyword: Context-aware Keyword Attention for Moment Retrieval and Highlight Detection

Sung Jin Um, Dongjin Kim, Sangmin Lee☨, Jung Uk Kim☨ (☨ Corresponding Author)

AAAI 2025 (Top-tier AI Conf.)

Towards Social AI: A Survey on Understanding Social Interactions

Sangmin Lee, Minzhi Li, Bolin Lai, Wenqi Jia, Fiona Ryan, Xu Cao, Ozgur Kara, Bikram Boote, Weiyan Shi, Diyi Yang, James M. Rehg

Preprint 2024  

Leveraging Object Priors for Point Tracking

Bikram Boote, Anh Thai, Wenqi Jia, Ozgur Kara, Stefan Stojanov, James M. Rehg☨, Sangmin Lee☨
(☨ Corresponding Author)

ECCVW 2024 (Oral Presentation)

Modeling Multimodal Social Interactions: New Challenges and Baselines with Densely Aligned Representations

Sangmin Lee, Bolin Lai, Fiona Ryan, Bikram Boote, James M. Rehg

CVPR 2024 (Top-tier AI Conf.) (Oral Presentation) [ Acceptance Rate 0.8% ]

Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledge

Dongjin Kim*, Sung Jin Um*, Sangmin Lee☨, Jung Uk Kim☨ (* Equal Contribution, ☨ Corresponding Author)

CVPR 2024 (Top-tier AI Conf.)

Text-Guided Distillation Learning to Diversify Video Embeddings for Text-Video Retrieval

Sangmin Lee, Hyung-Il Kim, Yong Man Ro

Pattern Recognition (2024) (Journal IF: 8.0)

Analyzing Visible Articulatory Movements in Speech Production for Speech-Driven 3D Facial Animation

Hyung Kyu Kim, Sangmin Lee, Hak Gu Kim

ICIP 2024

Audio-Visual Mismatch-Aware Video Retrieval via Association and Adjustment

Sangmin Lee, Sungjune Park, Yong Man Ro

ECCV 2022 (Top-tier AI Conf.)

Weakly Paired Associative Learning for Sound and Image Representations via Bimodal Associative Memory

Sangmin Lee, Hyung-Il Kim, Yong Man Ro

CVPR 2022 (Top-tier AI Conf.)

Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning

Sangmin Lee, Hak Gu Kim, Dae Hwi Choi, Hyung-Il Kim, Yong Man Ro

CUA Loss: Class Uncertainty-Aware Gradient Modulation for Robust Object Detection

Jung Uk Kim, Seong Tae Kim, Hong Joo Lee, Sangmin Lee, Yong Man Ro

IEEE TCSVT (2021) (Journal IF: 8.4)

Assessing Individual VR Sickness through Deep Feature Fusion of VR Video and Physiological Response

Sangmin Lee, Seongyeop Kim, Hak Gu Kim, Yong Man Ro

IEEE TCSVT (2021) (Journal IF: 8.4)

Towards a Better Understanding of VR Sickness: Physical Symptom Prediction for VR Contents

Hak Gu Kim, Sangmin Lee, Seongyeop Kim, Heoun-taek Lim, Yong Man Ro

AAAI 2021 (Top-tier AI Conf.)

Visual Comfort Aware-Reinforcement Learning for Depth Adjustment of Stereoscopic 3D Images

Hak Gu Kim, Minho Park, Sangmin Lee, Seongyeop Kim, Yong Man Ro

AAAI 2021 (Top-tier AI Conf.)

SACA Net: Cybersickness Assessment of Individual Viewers for VR Content via Graph-based Symptom Relation Embedding

Sangmin Lee, Jung Uk Kim, Hak Gu Kim, Seongyeop Kim, Yong Man Ro

ECCV 2020 (Top-tier AI Conf.)

Structure Boundary Preserving Segmentation for Medical Image With Ambiguous Boundary

Hong Joo Lee, Jung Uk Kim, Sangmin Lee, Hak Gu Kim, Yong Man Ro

CVPR 2020  (Top-tier AI Conf.)

Video Frame Interpolation via Exceptional Motion-aware Synthesis

Minho Park, Sangmin Lee, Yong Man Ro

ICASSP 2020 (Oral Presentation) 

BMAN: Bidirectional Multi-scale Aggregation Networks for Abnormal Event Detection

Sangmin Lee, Hak Gu Kim, Yong Man Ro

IEEE TIP (2020) (Journal IF: 10.6)

Robust Video Frame Interpolation with Exceptional Motion Map

Minho Park, Hak Gu Kim, Sangmin Lee, Yong Man Ro

IEEE TCSVT (2020) (Journal IF: 8.4)

Estimating VR Sickness Caused by Camera Shake in VR Videography

Seongyeop Kim, Sangmin Lee, Yong Man Ro

ICIP 2020 (Oral Presentation) 

Physiological Fusion Net: Quantifying Individual VR Sickness with Content Stimulus and Physiological Response

Sangmin Lee, Seongyeop Kim, Hak Gu Kim, Min Seob Kim, Seokho Yun, Bumseok Jeong, Yong Man Ro

ICIP 2019

Deep Objective Assessment Model Based on Spatio-temporal Perception of 360-Degree Video for VR Sickness Prediction

Kihyun Kim*, Sangmin Lee*, Hak Gu Kim, Minho Park, Yong Man Ro (* Equal Contribution)

ICIP 2019 (Oral Presentation) 

ICIP Best Paper Finalist, Top 1% of Submissions

VRSA Net: VR Sickness Assessment considering Exceptional Motion for 360-degree VR Video

Hak Gu Kim, Heoun-taek Lim, Sangmin Lee, Yong Man Ro

IEEE TIP (2019) (Journal IF: 10.6)

On-the-Fly Facial Expression Prediction using LSTM Encoded Appearance-Suppressed Dynamics

Wissam J. Baddar, Sangmin Lee, Yong Man Ro

IEEE TAFFC (2019) (Journal IF: 11.2)

STAN: Spatio-temporal Adversarial Networks for Abnormal Event Detection

Sangmin Lee, Hak Gu Kim, Yong Man Ro

ICASSP 2018 (Oral Presentation)