Yongfei Liu
Researcher @ AML Bytedance | Ph.D. from UCAS
Perception, Learning and UnderStanding (PLUS) Lab
liuyf3 [at] shanghaitech.edu.cn; liuyongfei.0314@bytedance.com
Short Bio
Greetings! Welcome to my homepage!
I obtained my Ph.D. degree in 2022 from joint program of University of Chinese Academy of Sciences & ShanghaiTech, advised by Prof. Xuming He. Prior to my Ph.D. Study, I obtained the Bachelor degree from XIDIAN University in 2017.
Since 2023.01, I have joined the Bytedance AML as a research scientist. My research interests mainly focus on CodeLLM & Generative Multimodality.
News
2023.08.20 one paper accepted by ICCV 2023. Congratulation to Wuyu & Yana.
2023.08.20 one paper accepted by BMVC2023. Congratulation to Chuyu & Chuanyang.
2023.01.21 one paper accepted by CVPR2023. Congratulation to Shan & Longtian.
2023.01.21 one paper accepted by ICLR2023
2022.12.04 I complete my Ph.D. degree defense and successfully graduate from UCAS. CONGRATULATION TO MYSELF !!!
2022.04.12 our multimodal pretraining KD-VLP paper got accepted by NAACL 2022
2022.01.10 we are the third-place winner of WebQA challenges with our self-developed VL pre-trained model KD-VLP. [certificate]
2021.07.14 I receive the Outstanding Intern award of the Tencent Rhino-Bird Elite Program.
2021.05.06 one paper about multi-lingual multi-modal video & text datasets accepted by ACL2021
2021.03.20 start my onsite internship at MSRA NLC Group
2021.03.01 one paper about cross-modal understanding accepted by CVPR2021
2021.01.05 start my internship at MSRA NLC Group remotely
2020.09.01 start my onsite internship at Shenzhen Tencent AI Lab
2020.06.20 one paper about few-shot segmentation accepted by ECCV2020
2020.05.04 start my internship remotely at Tencent AI Lab, shenzhen
Industry Experiences
Researcher at Bytedance AML, 2023.01~Now
Research Intern at Amazon AWS,collaborate with Yi Zhu & Mu Li 2022.07~2022.12
Research Intern at MSRA (Beijing),collaborate with Chenfei Wu & Nan Duan 2020.12~2021.12
Research Intern at Tencent AI Lab (shenzhen),collaborate with Lin Ma, 2020.05~2020.11
Publication
- HOICLIP: Efficient Knowledge Transfer for HOI Detection with Visual Linguistic Model Shan Ning*, Longtian Qiu*, Yongfei Liu and Xuming He CVPR2023
- Weakly-supervised HOI Detection via Prior-guided Bi-level Representation Learning [paper] Bo Wan*, Yongfei Liu*, Tinne Tuytelaars and Xuming He ICLR2023
- Intention-aware Feature Propagation Network for Interactive Segmentation [paper] Chuyu Zhang, Chuanyang Hu, Yongfei Liu, and Xuming He In submission
- VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers [paper] Meng Du, Estelle Guez Aflalo, Shao-Yen Teng, Yongfei Liu, Chenfei Wu, Nan Duan and Vasudev Lal CVPR2022 best demo award This work was done when Yongfei was a research intern at MSRA
- KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation [paper] Yongfei Liu, Chenfei Wu, Shao-yen Tseng, Vasudev Lal, Xuming He and Nan Duan NAACL2022
This work was done when Yongfei was a research intern at MSRA GEM: A General Evaluation Benchmark for Multimodal Tasks [paper] [dataset][leaderboard]
Relation-aware Instance Refinement for Weakly-Supervised Visual Grounding [paper][code][video][poster][slides]
Part-aware Prototype Network for Few-shot Semantic Segmentation [paper][code] [video] [slides]
Yongfei Liu*, Bo Wan*, Xiaodan zhu, Xuming He Association for the Advancement of Artificial Intelligence (AAAI), 2020
Bo Wan*, Desen Zhou*, Yongfei Liu, Rongjie Li, Xuming He International Conference on Computer Vision (ICCV), 2019
Academic Service
Reviewer of IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
Reviewer of IEEE Transactions on Multimedia (TMM)
Reviewer of ECCV-2020, ACMMM-2020
Reviewer of AAAI-2021, CVPR-2021, ICLR-2021
Reviewer of AAAI-2022, CVPR-2022, NAACL-2022
Reviewer of Neurips-2022, ICLR-2023, AAAI-2023, ICCV-2023