Junyeong Kim

Assistant Professor @ Department of AI, Chung-Ang University, Republic of Korea

E-mail: junyeongkim [at] cau.ac.kr

[CV] [Google Scholar]

Research Interests

Computer Vision

Deep Learning

Visual Question Answering

Vision-Language Reasoning

Experience

Post-Doc Researcher @ AIM Lab., KAIST

Mar.2021 - Feb.2022

Full-time Research Intern @ Natural Language Processing Group, MSRA

Dec.2020 - Jun.2021

Education

Ph.D., School of Electrical Engineering, KAIST Mar.2021 - Feb.2022

  • Thesis: "Deep Learning based Approaches for Multimodal Video Question Answering"

  • Advisor: Prof. Chang D. Yoo

M.S., School of Electrical Engineering, KAIST Mar.2015- Feb.2017

  • Thesis: "Partial Person Re-identification with Convolutional Neural Network and Attention Model"

  • Advisor: Prof. Chang D. Yoo

B.S., School of Electrical Engineering, KAIST Mar.2011- Feb.2015

Publications

2021

Structured Co-reference Graph Attention for Video-grounded Dialogue

Junyeong Kim, Sunjae Yoon, Dahyun Kim, Chang D. Yoo

AAAI Conference on Artificial Intelligence (AAAI), Feb 2021.

[Paper] [Bibtex]

Weakly-supervised Moment Retrieval Network for Video Corpus Moment Retrieval

Sunjae Yoon, Dahyun Kim, Ji Woo Hong, Junyeong Kim, Kookhoi Kim, Chang D. Yoo

IEEE International Conference on Image Processing (ICIP), Sep 2021.

[Paper] [Bibtex]

2020

Modality Shifting Attention Network for Multi-modal Video Question Answering

Junyeong Kim, Minuk Ma, Pham X. Trung, Kyungsoo Kim, Chang D. Yoo

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2020.

[Paper] [Bibtex]

VLANet: Video-Language Alignment Network for Weakly-Supervised Video Moment Retrieval

Minuk Ma*, Sunjae Yoon*, Junyeong Kim, Youngjoon Lee, Sunghun Kang, Chang D. Yoo

European Conference on Computer Vision (ECCV), Aug, 2020.

[Paper] [Bibtex]

2019

Progressive Attention Memory Network for Movie Story Question Answering

Junyeong Kim, Minuk Ma, Kyungsoo Kim, Sungjin Kim, Chang D. Yoo

IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Jun 2019.

[Paper] [Bibtex]

Gaining Extra Supervision via Multi-task Learning for Multi-modal Video Question Answering

Junyeong Kim, Minuk Ma, Kyungsoo Kim, Sungjin Kim, Chang D. Yoo

International Joint Conference on Neural Networks (IJCNN), Jul 2019.

[Paper] [Bibtex]

Flexible Piezoelectric Acoustic Sensors and Machine Learning for Speech Processing

Younghoon Jung, SeongKwang Hong, Heeseung Wang, Jaehyun Han, Trung X. Pham, Hyunsin Park, Junyeong Kim, Sunghun Kang, Chang D. Yoo, Keonjae Lee

Advanced Materials, Oct 2019.

[Paper] [Bibtex]

2018

Pivot Correlational Neural Network for Multimodal Video Categorization

Sunghun Kang, Junyeong Kim, Hyunsoo Choi, Sungjin Kim, Chang D. Yoo

European Conference on Computer Vision (ECCV), Sep 2018.

[Paper] [Bibtex]

Action Recognition: First-and Second-order 3D Feature in Bi-directional Attention Network

Ohchul Kwon, Junyeong Kim, Chang D. Yoo

IEEE International Conference on Image Processing (ICIP), oct 2018.

[Paper] [Bibtex]

2017

Deep Partial Person Re-identification via Attention Model

Junyeong Kim, Chang D. Yoo

IEEE International Conference on Image Processing (ICIP), Sep 2017.

[Paper] [Bibtex]

Academic Activities

Awards

Outstanding Ph.D. Thesis Award, School of Electrical Engineering, KAIST, 2021

Best Paper Award, Summer Conference, KAIA, 2020

Challenge

MS COCO instance segmentation 2019 in team "DeepAR(ETRIxKAIST_AIM)" and achieved 4th place

ILSVRC 2016 Object Detection from Video (VID) in team "KAIST-SLSP" and achieved 5th place

Reviewer

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) : 2020,2021,2022

IEEE International Conference on Computer Vision (ICCV) : 2019,2021,0

European Conference on Computer Vision (ECCV) : 2020

Neural Information Processing Systems (NIPS) : 2020,2021

International Conference on Machine Learning (ICML) : 2020,2021,2022

International Conference on Learning Representations (ICLR) : 2021,2022

AAAI Conference on Artificial Intelligence (AAAI) : 2020,2021, 2022

Winter Conference on Applications of Computer Vision (WACV) : 2021,2022

International Conference on Image Processing (ICIP) : 2019, 2020,2021

Asian Conference on Computer Vision (ACCV) : 2020

Talk

Tutorial : "Tutorial on Deep Learning for Vision and Language Reasoning", Asian Conference on Pattern Recognition, 2021

Invited Talk : "Development of Multi-modal Video QA & Dialogue Systems", Young Researcher Session, Joint Fall Conference held by KAIA and MSRA, 2020

Invited Paper Presentation : "Progressive Attention Memory Network for Movie Story Question Answering", Video Turoing Test Workshop, ICCV, 2019