Byeongho Heo's Hompage
[ Google scholar ] [ CV ] [linkedin] [github]
Ph.D. Byeongho Heo
Research scientist
NAVER AI LAB
Visiting assistant professor
AI institute, Seoul National University
Email : bh.heo [at] navercorp.com, ho6946 [at] gmail.com, bhheo [at] snu.ac.kr
Research interest: vision transformer, knowledge distillation, network compression, network architecture
Publications
Conferences
SeiT: Storage-Efficient Vision Training with Tokens Using 1% of Pixel Storage
Song Park*, Sanghyuk Chun*, Byeongho Heo, Wonjae Kim, Sangdoo Yun
IEEE International Conference on Computer Vision (ICCV), 2023
[arxiv]
Scratching Visual Transformer's Back with Uniform Attention
Nam Hyeon-Woo, Kim Yu-Ji, Byeongho Heo, Doonyoon Han, Seong Joon Oh, Tae-Hyun Oh
IEEE International Conference on Computer Vision (ICCV), 2023
[arxiv]
What Do Self-Supervised Vision Transformers Learn?
Namuk Park, Wonjae Kim, Byeongho Heo, Taekyung Kim, Sangdoo Yun
International Conference on Learning Representations (ICLR), 2023
[paper]
Group Generalized Mean Pooling for Vision Transformer
Byungsoo Ko, Han-Gyu Kim, Byeongho Heo, Sangdoo Yun, Sanghyuk Chun, Geonmo Gu, Wonjae Kim
Arxiv, 2022
[arxiv]
Similarity of Neural Architectures Based on Input Gradient Transferability
Jaehui Hwang, Dongyoon Han, Byeongho Heo, Song Park, Sanghyuk Chun, Jong-Seok Lee
Arxiv, 2022
[arxiv]
K-centered Patch Sampling for Efficient Video Recognition
Seong Hyeon Park, Jihoon Tack, Byeongho Heo, Jung-Woo Ha, Jinwoo Shin
European Conference on Computer Vision (ECCV), 2022
[paper]
Improving Ensemble Distillation with Weight Averaging and Diversifying Perturbation
Giung Nam, Hyungi Lee, Byeongho Heo, Juho Lee
International Conference on Machine Learning (ICML), 2022
[paper]
Joint Global and Local Hierarchical Priors for Learned Image Compression
Jun-Hyuk Kim, Byeongho Heo, Jong-Seok Lee
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[arxiv]
AdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights
Byeongho Heo*, Sanghyuk Chun*, Seong Joon Oh, Dongyoon Han, Sangdoo Yun, Gyuwan Kim, Youngjung Uh, Jung-Woo Ha
International Conference on Learning Representations (ICLR), 2021
[arxiv] [project page] [code]
VideoMix: Rethinking Data Augmentation for Video Classification
Sangdoo Yun , Seong Joon Oh , Byeongho Heo , Dongyoon Han , Jinhyung Kim
Arxiv, 2020
[arxiv]
A Comprehensive Overhaul of Feature Distillation
Byeongho Heo, Jeesoo Kim, Sangdoo Yun, Hyojin Park, Nojun Kwak, and Jin Young Choi
IEEE International Conference on Computer Vision (ICCV), 2019
[arxiv] [project page] [code] [slides] [poster]
Appearance and motion based deep learning architecture for moving object detection in moving camera
Byeongho Heo, Kimin Yun, and Jin Young Choi
IEEE International Conference on Image Processing (ICIP), 2017, oral
[pdf]
Deep Learning Architecture for Pedestrian 3-D Localization and Tracking Using Multiple Cameras
Kikyung Kim, Byeongho Heo, Moonsub Byeon, and Jin Young Choi
IEEE International Conference on Image Processing (ICIP), 2017, oral
[pdf]
Weighted Pooling Based on Visual Saliency for Image Classification
Byeongho Heo, Hawook Jeong, Jiyun Kim, Sang-Il Choi, and Jin Young Choi
International Symposium on Visual Computing (ISVC), 2014, oral
[pdf]
Journals
Detecting and Removing Text in the Wild
Junho Cho, Sangdoo Yun, Dongyoon Han, Byeongho Heo, Jin Young Choi
IEEE Access, 2021
[paper]
Motion-aware ensemble of three-mode trackers for unmanned aerial vehicles
Kyuewang Lee, Hyung Jin Chang, Jongwon Choi, Byeongho Heo, Aleš Leonardis, Jin Young Choi
Machine Vision and Applications, 2021
[paper]
Rollback Ensemble with Multiple Local Minima in Fine-tuning Deep Learning Networks
Youngmin Ro, Jongwon Choi, Byeongho Heo, Jin Young Choi
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2021.02
[paper]
Filter Pruning and Re-Initialization via Latent Space Clustering
Seunghyun Lee, Byeongho Heo, Jung-Woo Ha, Byung Cheol Song
IEEE Access, 2020
[paper]
Pose Transforming Network: Learning to Disentangle Human Posture in Variational Auto-encoded Latent Space
Jongin Lim, Youngjoon Yoo, Byeongho Heo, and Jin Young Choi
Pattern Recognition Letters (PRL), September 2018
[pdf]
Research interest
Deep learning
Knowledge distillation
Network compression
Image classification, object detection