Dongyoon Han

Research interests

News

Academic activities

Awards

Publications

Model Stock: All we need is just a few fine-tuned models

arxiv 2024, [PDF]

Dong-Hwan Jang, Sangdoo Yun*, Dongyoon Han* (* equal contribution)


Thanks to our insights in the fine-tuned weight space, fine-tuning a few models (i.e., only two)  can lead to superior merged weights (closer to the center of a weight space) without merging many fine-tuned models under extensive parameter searches like Model  Soup

DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs

arxiv 2024, [PDF]

Donghyun Kim*, Byeongho Heo, Dongyoon Han* (* equal contribution)


Through strategic enhancements, we revitalized the once-superior DenseNets, surpassing ConvNeXts, MogaNets, and so on. By focusing on expanding transition layers and refining the architecture's building blocks, we've crafted SOTA architectures on ImageNet.


Rotary Position Embedding for Vision Transformer

arxiv 2024,  [PDF]

Byeongho Heo, Song Park, Dongyoon Han, Sangdoo Yun


Vision transformers can be enhanced by utilizing RoPE, which allows them to extrapolate beyond the resolutions they were trained on very effectively.



Masked Image Modeling via Dynamic Token Morphing

arxiv 2024, [PDF]

Taekyung Kim*, Byeongho Heo, Dongyoon Han*, (* equal contribution)


Masked Image Modeling (MIM) learns improved representations by incorporating morphing tokens that intelligently merge tokens multiple times.

SeiT++: Masked Token Modeling Improves Storage-efficient Training

arxiv 2023


Minhyun Lee, Song Park, Byeongho Heo, Dongyoon Han, Hyunjung Shim


[Paper]

Match me if you can: Semantic Correspondence Learning with Unpaired Images

arxiv 2023


Jiwon Kim, Byeongho Heo, Sangdoo Yun, Seungryong Kim, Dongyoon Han*


[Paper]


Longer-range Contextualized Masked Autoencoder

arxiv 2023


Taekyung Kim*, Sanghyuk Chun, Byeongho Heo, Dongyoon Han* 

(* equal contribution)


[Paper]


Switching Temporary Teachers for Semi-Supervised Semantic Segmentation

NeurIPS 2023


Jaemin Na, Jung-Woo Ha, Hyung Jin Chang, Dongyoon Han*, Wonjun Hwang*

(* equal contribution)


[Paper][Project Page]


Neglected Free Lunch - Learning Image Classifiers Using Annotation Byproducts

ICCV 2023


Dongyoon Han*, Junsuk Choe*, Seonghyeok Chun, John Joon Young Chung, Minsuk Chang, Sangdoo Yun, Jean Y. Song, Seong Joon Oh

(* equal contribution)


[Paper][Project Page]

Gramian Attention Heads are Strong yet Efficient Vision Learners

ICCV 2023


Jongbin Ryu*, Dongyoon Han*, Jongwoo Lim

(* equal contribution)


[Paper][Project Page]



Scratching Visual Transformer's Back with Uniform Attention

ICCV 2023


Nam Hyeon-Woo, Kim Yu-Ji, Byeongho Heo, Dongyoon Han, Seong Joon Oh, Tae-Hyun Oh


[Paper]

Generating Instance-level Prompts for Rehearsal-free Continual Learning

ICCV 2023  (oral presentation)


Dahuin Jung, Dongyoon Han, Jiwhan Bang, Hwanjun Song


[Paper][Project Page]

Augmenting Sub-model to Improve Main Model

arxiv, under review


Byeongho Heo, Taekyung Kim, Sangdoo Yun, Dongyoon Han


[Paper][Project Page]


GeNAS: Neural Architecture Search with Better Generalization

IJCAI 2023


Joonhyun Jeong, Joonsang Yu, Geondo Park, Dongyoon Han, YoungJoon Yoo


[Paper]

The Devil is in the Points: Weakly Semi-Supervised Instance Segmentation via Point-Guided Mask Representation

CVPR 2023


Beomyoung Kim, Joonhyun Jeong, Dongyoon Han, Sung Ju Hwang


[Paper][Project Page]



TL-ADA: Transferable Loss-based Active Domain Adaptation

Neural Networks 2023


Kyeongtak Han, Youngeun Kim, Dongyoon Han, Sungeun Hong


[Paper]

Can We Find Strong Lottery Tickets in Generative Models?

AAAI 2023


Sangyeop Yeo, Yoojin Jang, Jy-yong Sohn, Dongyoon Han, Jaejun Yoo


[Paper][Project Page]

Spatiotemporal Augmentation on Selective Frequencies for Video Representation Learning

AAAI 2023


Jinhyung Kim, Taeoh Kim, Minho Shim, Dongyoon Han*, Dongyoon Wee, Junmo Kim

AAAI 2023


[Paper]

Similarity of Neural Architectures Based on Input Gradient Transferability 

arxiv, under review


Jaehui Hwang, Dongyoon Han, Byeongho Heo, Song Park, Sanghyuk Chun, Jong-Seok Lee,


[Paper]

Contrastive Vicinal Space for Unsupervised Domain Adaptation

ECCV 2022


Jaemin Na, Dongyoon Han, Hyung Jin Chang, and Wonjun Hwang


[Paper][Project Page]

Donut: Document Understanding Transformer without OCR

ECCV 2022


Geewook Kim, Teakgyu Hong, Moonbin Yim, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, and Seunghyun Park


[Paper][Project Page]

Time Is MattEr: Temporal Self-supervision for Video Transformers

ICML 2022


Sukmin Yun, Jaehyung Kim, Dongyoon Han, Hwanjun Song, Jung-Woo Ha, Jinwoo Shin


[Paper][Project Page]

Neural Architecture Search with Loss Flatness-aware Measure

ICML 2022,  Workshop on Dynamic Neural Networks


Joonhyun Jeong, Joonsang Yu, Dongyoon Han, YoungJoon Yoo


[Paper]

An Extendable, Efficient and Effective Transformer-based Object Detector

arxiv, under review


Hwanjun Song,  Deqing Sun, Sanghyuk Chun, Varun Jampani, Dongyoon Han, Byeongho Heo, Wonjae Kim, and Ming-Hsuan Yang


[Paper][Project Page]

Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training?

CVPR 2022


Jisoo Mok, Byunggook Na, Ji-Hoon Kim*, Dongyoon Han*, Sungroh Yoon*

(* equal contribution)


[Paper]

Learning Features with Parameter-Free Layers

ICLR 2022, Best paper of NAVER AI Lab 2022


Dongyoon Han, YoungJoon Yoo, Beomyoung Kim, and Byeongho Heo


[Paper][Project Page][Openreview]

ViDT: An Efficient and Effective Fully Transformer-based Object Detector

ICLR 2022


Hwanjun Song,  Deqing Sun, Sanghyuk Chun, Varun Jampani, Dongyoon Han, Byeongho Heo, Wonjae Kim, and Ming-Hsuan Yang


[Paper][Project Page][Openreview]

Rethinking spatial dimensions of vision transformers

ICCV 2021


Byeongho Heo, Sangdoo Yun, Dongyoon Han, Sanghyuk Chun, Junsuk Choe, and Seong Joon Oh


[Paper][Project Page]

Detecting and Removing Text in the Wild

IEEE Access, vol. 9, pp. 123313-123323, 2021


Junho Cho, Sangdoo Yun, Dongyoon Han, Byeogho Heo, and Jin Young Choi


[Paper]

Region-based dropout with attention prior for weakly supervised object localization

Pattern Recognition, 116, 2021


Junsuk Choe, Dongyoon Han, Sangdoo Yun, Jung-Woo Ha, Seong Joon Oh, and Hyunjung Shim 


[Paper]

Rethinking Channel Dimensions for Efficient Model Design

CVPR 2021


Dongyoon Han, Sangdoo Yun, Byeongho Heo, and YoungJoon Yoo


[Paper][Project Page]

Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels

CVPR 2021


Sangdoo Yun, Seong Joon Oh, Byeongho Heo, Dongyoon Han, Junsuk Choe, and Sanghyuk Chun


[Paper][Project Page]

Slowing Down the Weight Norm Increase in Momentum-based Optimizers

ICLR 2021


Byeongho Heo, Sanghyuk Chun, Seong Joon Oh, Dongyoon Han, Sangdoo Yun, Youngjung Uh, and Jung-Woo Ha


[Paper][Project Page][Openreview]

VideoMix: Rethinking Data Augmentation for Video Classification

arxiv, under review


Sangdoo Yun, Seong Joon Oh, Byeongho Heo, Dongyoon Han, and Jinhyung Kim


[Paper]

An Empirical Evaluation on Robustness and Uncertainty of Regularization Methods

ICML 2019, Uncertainty & Robustness in Deep Learning Workshop



Sanghyuk Chun, Seong Joon Oh, Sangdoo Yun, Dongyoon Han, Junsuk Choe, YoungJoon Yoo


[Paper]

Unpaired Sketch-to-Line Translation via Synthesis of Sketches

SIGGRAPH Asia 2019, Technical Briefs



Gayoung Lee, Dohyun Kim, Youngjoon Yoo, Dongyoon Han, Jung-Woo Ha, Jaehyuk Chang


[Paper]

EXTD: Extremely Tiny Face Detector via Iterative Filter Reuse

arxiv, under review


Youngjoon Yoo, Dongyoon Han, and Sangdoo Yun


[Paper]

CutMix:Regularization Strategy to Train Strong Classifiers with Localizable Features

ICCV 2019  (oral presentation)


Sangdoo Yun, Dongyoon Han, Seong Joon Oh, Sanghyuk Chun, Junsuk Choe, and Youngjoon Yoo


[Paper] [Project Page]

What is wrong with scene text recognition model comparisons? dataset and model analysis

ICCV 2019  (oral presentation)



Jeonghun Baek, Geewook Kim, Junyeop Lee, Sungrae Park, Dongyoon Han, Sangdoo Yun, Seong Joon Oh, and Hwalsuk Lee


[Paper][Project Page]

Where to be adversarial perturbations added? Investigating and manipulating pixel robustness using input gradients

ICLR 2019, Debugging Machine Learning Models Workshop 


Jisung Hwang, Younghoon Kim, Sanghyuk Chun, Jaejun Yoo, Ji-Hoon Kim, and Dongyoon Han*


[Paper]

Character Region Awareness for Text Detection

CVPR 2019 


Youngmin Baek, Bado Lee, Dongyoon Han, Sangdoo Yun, and Hwalsuk Lee,


[Paper] [Project Page]

Concentrated-Comprehensive Convolutions for lightweight semantic segmentation

arxiv, under review


Hyojin Park, Youngjoon Yoo, Geonseok Seo, and Dongyoon Han, Sangdoo Yun, Nojun Kwak


[Paper][Project Page]

Learning Receptive Field Size by Learning Filter Size

WACV 2019 


Yekang Lee, Heechul Jung, Dongyoon Han, Kyungsu Kim, and Junmo Kim


[Paper]

Towards Flatter Loss Surface via Nonmonotonic Learning Rate Scheduling

UAI 2018


Sihyeon Seong, Yekang Lee, Youngwook Kee, Dongyoon Han, and Junmo Kim


[Paper]

Unified Simultaneous Clustering and Feature Selection for Unlabeled and Labeled Data

IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2018


Dongyoon Han and Junmo Kim


[Paper]

Deep Pyramidal Residual Networks

CVPR 2017


Dongyoon Han, Jiwhan Kim, and Junmo Kim


[Paper][Project Page]

Salient Region Detection via High-Dimensional Color Transform and Local Spatial Support

IEEE Transactions on Image Processing (TIP), 2016


Jiwhan Kim, Dongyoon Han, Yu-Wing Tai, and Junmo Kim


[Paper][Project Page]

Unsupervised Orthogonal Basis Feature Selection

CVPR 2015


Dongyoon Han and Junmo Kim


[Paper][Project Page]

Salient Region Detection via High-Dimensional Color Transform


Jiwhan Kim, Dongyoon Han, Yu-Wing Tai, and Junmo Kim

CVPR 2014


[Paper][Project Page]

Summarized publication list


2024



2023


2022


2021


Before 2020