Dongyoon Han
Currently, I am a Senior Research Scientist in NAVER AI Lab (from 2018.01 - ) and an Adjunct Professor at KAIST GSAI (from 2021.09 - ).
I am interested in designing novel deep neural network architectures and developing novel training/regularization methods, which are in line with the previous works such as MaxNet, ViDT, PiT, ReXNet, CutMix, and AdamP, Video related or multimodal topics are becoming my other interests.
E-mails: dongyoon.han at navercorp.com / karusun at gmail.com
Research Interest
Large-scale learning methods
Self-supervised/unsupervised representation learning
Neural network architecture modeling (e.g., ViTs and ConvNets)
Neural architecture search
Optimizers and training regularizers
Continual learning and domain adaptation methods
News
One paper has been accepted at CVPR 2023
One paper has been accepted at Neural Networks (IF=9.657)
Two papers have been accepted at AAAI 2023
Two papers have been accepted at ECCV 2022
One paper has been accepted at ICML 2022
One paper has been accepted at CVPR 2022
Two papers have been accepted at ICLR 2022
One paper has been accepted at ICCV 2021
One paper has been accepted at Pattern Recognition (IF =7.74)
Two papers have been accepted at CVPR 2021
One paper has been accepted at ICLR 2021
Academic Activity
Served as a reviewer for TMLR, TKDE, TNNLS, TPAMI, and TIP.
Served (or will serve) as a reviewer for the following conferences:
ICLR 2023, CVPR2023, ICML 2023, ICCV 2023
ICLR 2022, CVPR 2022, ICML 2022, ECCV 2022, NeurIPS 2022
ICLR 2021, CVPR 2021 (outstanding reviewer), ICML 2021, ICCV 2021, NeurIPS 2021
AAAI 2020, ICLR 2020, CVPR 2020, ECCV 2020, NeurIPS 2020
ICLR 2019, ICML 2019, ICCV 2019, NeurPS 2019,
CVPR 2018, NeurIPS 2018 (top-200 reviewers)
Publications
Dongyoon Han, Junsuk Choe, Seonghyeok Chun, John Joon Young Chung, Minsuk Chang, Sangdoo Yun, Jean Y. Song, Seong Joon Oh, "Neglected Free Lunch -- Learning Image Classifiers Using Annotation Byproducts", arXiv preprint arXiv:2303.17595. [PDF]
Beomyoung Kim, Joonhyun Jeong, Dongyoon Han, Sung Ju Hwang, "The Devil is in the Points: Weakly Semi-Supervised Instance Segmentation via Point-Guided Mask Representation", IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2023
Kyeongtak Han, Youngeun Kim, Dongyoon Han, Sungeun Hong, "TL-ADA: Transferable Loss-based Active Domain Adaptation", Neural Networks, 2023 [PDF]
Sangyeop Yeo, Yoojin Jang, Jy-yong Sohn, Dongyoon Han, Jaejun Yoo, "Can We Find Strong Lottery Tickets in Generative Models?", In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) 2023. [PDF]
Jinhyung Kim, Taeoh Kim, Minho Shim, Dongyoon Han, Dongyoon Wee, Junmo Kim, "Spatiotemporal Augmentation on Selective Frequencies for Video Representation Learning", In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) 2023. [PDF]
Jaemin Na, Dongyoon Han, Hyung Jin Chang, and Wonjun Hwang, “Contrastive Vicinal Space for Unsupervised Domain Adaptation”, European Conference on Computer Vision (ECCV), 2022. [PDF]
Geewook Kim, Teakgyu Hong, Moonbin Yim, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, and Seunghyun Park, “Donut: Document Understanding Transformer without OCR”, European Conference on Computer Vision (ECCV), 2022. [PDF]
Sukmin Yun, Jaehyung Kim, Dongyoon Han, Hwanjun Song, Jung-Woo Ha, Jinwoo Shin, "Time Is MattEr: Temporal Self-supervision for Video Transformers", International Conference on Machine Learning (ICML) 2022. [PDF]
Joonhyun Jeong, Joonsang Yu, Dongyoon Han, YoungJoon Yoo, "Neural Architecture Search with Loss Flatness-aware Measure", International Conference on Machine Learning (ICML), 2022, Workshop on Dynamic Neural Networks. [PDF]
Kyeongtak Han, Youngeun Kim, Dongyoon Han, Sungeun Hong, "Loss-based Sequential Learning for Active Domain Adaptation", arXiv preprint arXiv:2204.11665. [PDF]
Hwanjun Song, Deqing Sun, Sanghyuk Chun, Varun Jampani, Dongyoon Han, Byeongho Heo, Wonjae Kim, and Ming-Hsuan Yang. "An Extendable, Efficient and Effective Transformer-based Object Detector", arXiv preprint arXiv:2204.07962. [PDF][CODE]
Jisoo Mok, Byunggook Na, Ji-Hoon Kim*, Dongyoon Han*, Sungroh Yoon*, "Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training?" IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2022. [PDF][CODE]
Dongyoon Han, YoungJoon Yoo, Beomyoung Kim, and Byeongho Heo, "Learning Features with Parameter-Free Layers", International Conference on Learning Representations (ICLR), 2022, Best paper among NAVER AI Lab's 2022 papers, [PDF][CODE][Openreview]
Hwanjun Song, Deqing Sun, Sanghyuk Chun, Varun Jampani, Dongyoon Han, Byeongho Heo, Wonjae Kim, and Ming-Hsuan Yang. "ViDT: An Efficient and Effective Fully Transformer-based Object Detector", International Conference on Learning Representations (ICLR), 2022. [PDF][CODE][Openreview]
Byeongho Heo, Sangdoo Yun, Dongyoon Han, Sanghyuk Chun, Junsuk Choe, and Seong Joon Oh. "Rethinking spatial dimensions of vision transformers", IEEE International Conference on Computer Vision (ICCV), 2021. [PDF][CODE]
Junho Cho, Sangdoo Yun, Dongyoon Han, Byeogho Heo and Jin Young Choi, "Detecting and Removing Text in the Wild," in IEEE Access, vol. 9, pp. 123313-123323, 2021. [PDF]
Junsuk Choe, Dongyoon Han, Sangdoo Yun, Jung-Woo Ha, Seong Joon Oh, and Hyunjung Shim. "Region-based dropout with attention prior for weakly supervised object localization", Pattern Recognition (impact factor: 7.74), 116, 2021.
Dongyoon Han, Sangdoo Yun, Byeongho Heo, and YoungJoon Yoo, "Rethinking Channel Dimensions for Efficient Model Design", IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2021. [PDF][CODE]
Sangdoo Yun, Seong Joon Oh, Byeongho Heo, Dongyoon Han, Junsuk Choe, and Sanghyuk Chun, "Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels", IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2021. [PDF][CODE]
Byeongho Heo*, Sanghyuk Chun*, Seong Joon Oh, Dongyoon Han, Sangdoo Yun, Youngjung Uh, and Jung-Woo Ha, "Slowing Down the Weight Norm Increase in Momentum-based Optimizers", International Conference on Learning Representations (ICLR), 2021, (*authors contributed equally). [PDF][CODE][Openreview]
Sangdoo Yun, Seong Joon Oh, Byeongho Heo, Dongyoon Han, and Jinhyung Kim. "VideoMix: Rethinking Data Augmentation for Video Classification." arXiv preprint arXiv:2012.03457 (2020). [PDF]
Sanghyuk Chun, Seong Joon Oh, Sangdoo Yun, Dongyoon Han, Junsuk Choe, YoungJoon Yoo, "An Empirical Evaluation on Robustness and Uncertainty of Regularization methods", International Conference on Machine Learning (ICML), 2019, Uncertainty & Robustness in Deep Learning Workshop. [PDF]
Gayoung Lee, Dohyun Kim, Youngjoon Yoo, Dongyoon Han, Jung-Woo Ha, Jaehyuk Chang, "Unpaired Sketch-to-Line Translation via Synthesis of Sketches", SIGGRAPH Asia, 2019 Technical Briefs. [PDF]
Youngjoon Yoo, Dongyoon Han, and Sangdoo Yun, "EXTD: Extremely Tiny Face Detector via Iterative Filter Reuse", arXiv preprint arXiv:1906.06579. [PDF]
Sangdoo Yun, Dongyoon Han, Seong Joon Oh, Sanghyuk Chun, Junsuk Choe, and Youngjoon Yoo, “CutMix:Regularization Strategy to Train Strong Classifiers with Localizable Features”, IEEE International Conference on Computer Vision (ICCV), 2019 (oral). [PDF] [CODE]
Jeonghun Baek, Geewook Kim, Junyeop Lee, Sungrae Park, Dongyoon Han, Sangdoo Yun, Seong Joon Oh, and Hwalsuk Lee, “What is wrong with scene text recognition model comparisons? dataset and model analysis”, IEEE International Conference on Computer Vision (ICCV), 2019 (oral). [PDF] [CODE]
Jisung Hwang*, Younghoon Kim*, Sanghyuk Chun*, Jaejun Yoo, Ji-Hoon Kim, and Dongyoon Han, “Where to be adversarial perturbations added? Investigating and manipulating pixel robustness using input gradients”, International Conference on Learning Representations (ICLR), 2019, Debugging Machine Learning Models Workshop (*authors contributed equally, worked as a corresponding author). [PDF]
Hyojin Park, Youngjoon Yoo, Geonseok Seo, and Dongyoon Han, Sangdoo Yun, Nojun Kwak, “Concentrated-Comprehensive Convolutions for lightweight semantic segmentation”, arXiv preprint arXiv:1812.04920. [PDF]
Youngmin Baek, Bado Lee, Dongyoon Han, Sangdoo Yun, and Hwalsuk Lee, “Character Region Awareness for Text Detection”, IEEE Computer Vision and Pattern Recognition (CVPR), 2019. [PDF] [CODE]
Yekang Lee, Heechul Jung, Dongyoon Han, Kyungsu Kim, and Junmo Kim, “Learning Receptive Field Size by Learning Filter Size”, IEEE Winter Conference on Applications of Computer Vision (WACV), 2019. [PDF]
Sihyeon Seong, Yekang Lee, Youngwook Kee, Dongyoon Han, and Junmo Kim, “Towards Flatter Loss Surface via Nonmonotonic Learning Rate Scheduling”, Conference on Uncertainty in Artificial Intelligence (UAI), 2018 (acceptance rate: 24.6%). [PDF]
Dongyoon Han and Junmo Kim, "Unified Simultaneous Clustering and Feature Selection for Unlabeled and Labeled Data," IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2018 (impact factor: 11.683). [PDF]
Dongyoon Han*, Jiwhan Kim*, and Junmo Kim, “Deep Pyramidal Residual Networks”, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2017 (*authors contributed equally). [PDF][CODE]
Juseung Yun, Jaeyoung Lee, Dongyoon Han, Jeongwoo Ju, and Junmo Kim, “Cost-efficient 3D face reconstruction from a single 2D image”, ICACT, 2017.
Jiwhan Kim, Dongyoon Han, Wonjun Hwang, and Junmo Kim, “3D face recognition via discriminative keypoint selection”, 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), 2017.
Jiwhan Kim, Dongyoon Han, Yu-Wing Tai, and Junmo Kim, "Salient Region Detection via High-Dimensional Color Transform and Local Spatial Support," IEEE Transactions on Image Processing (TIP), Vol. 25, No. 1, pp. 9-23, 2016 (impact factor: 6.79). [PDF]
Jiwhan Kim, Dongyoon Han, Sungryull Sohn, and Junmo Kim, "Facial Age Estimation via Extended Curvature Gabor Filter", IEEE International Conference on Image Processing (ICIP), 2015. [PDF]
Dongyoon Han and Junmo Kim "Unsupervised Orthogonal Basis Feature Selection", IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2015. [PDF][CODE]
Dongyoon Han, Jung Eun, Pyunghwan Ahn, and Jeonghyo Ha, Donghoon Shin, Junmo Kim, “Automatic Drawing Simplification via Complex Zernike Moments”, ITC-CSCC, 2015.
Jiwhan Kim, Dongyoon Han, Yu-Wing Tai, and Junmo Kim, "Salient Region Detection via High Dimensional Color Transform", IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2014. [PDF][Project Page]
Dongyoon Han, Jiwhan Kim, Jeongwoo Ju, Injae Lee, Jihun Cha, and Junmo Kim, "Efficient and Fast Multi-View Face Detection Based on Feature Transformation", ICACT, 2014.
Dongyoon Han and Junmo Kim, "Texture Classification Based on Discriminative Component Selection of Local Binary Pattern and Variants", FCV, 2014.
Wonjun Hwang, Jiwhan Kim, Dongyoon Han, and Junmo Kim, "A Survey of Face Recognition Technique for Real Media Processing", Korea Society Broadcast Engineers Magazine, Vol. 19, No. 3, pp. 111-122, Jul. 2014.