Henry, Lei Zhu
Assistant Professor, ROAS Thrust, The Hong Kong University of Science and Technology (Guangzhou), Nansha, Guangzhou, 511400, Guangdong, China
Affiliated Assistant Professor, Department of Electonic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China
Email: leizhu@ust.hk or leizhu@hkust-gz.edu.cn
Office: Room 515, W1, The Hong Kong University of Science and Technology (Guangzhou), Nansha, Guangzhou, 511400, Guangdong, China
[Google Scholar] [DBLP] [Researchgate]
Update: I am currently looking for talented students to work on innovative computer vision, computer graphics, medical imaging, and deep learning at HKUST (GZ). PhD/RA/Postdoc positions are available. The salaries will be highly competitive. Please drop me an email (with a title 'PHD/RA/Postdoc application') if you are interested. As a new campus of HKUST, HKUST (GZ) focuses on the interdisciplinary research.
Short Bio.
I am an assistant professor at ROAS Thrust, HKUST(GZ), and also an affiliated assistant professor at ECE, HKUST. Before that, I was a Postdoctoral researcher at DAMTP, University of Cambridge, working with Prof. Carola-Bibiane Schönlieb. My Ph.D. was obtained at the Department of Computer Science and Engineering, the Chinese University of Hong Kong under the supervision of Prof. Pheng-Ann Heng and Prof. Chi-Wing Fu, Philip in 2017. I am serving as the PG coordinator of the ROAS Thrust from 2023.
Research Interests
My research interests include computer vision, image restoration, image enhancement, image and video processing, medical AI, and deep learning. The main research goal is to answer the question of how to develop intelligent image perception methods for extracting useful information from visual content that is prevalent in live sources and medical imaging. These techniques benefit outdoor vision analysis, multimedia analysis, and medical intelligence systems. In the past three years, our research works have been published in top-tier journals and conferences, e.g., IEEE TPAMI/IJCV/CVPR/ICCV/ECCV, IEEE TIP/TNNLS/TMM/TCSVT/TVCG, AAAI/IJCAI/ACM-MM, and MICCAI/IEEE TMI/Medical Image Analysis/IEEE TBME. I have been invited as an Area Chair of ECCV 2024, MICCAI 2024, MICCAI 2023, ACM Multimedia 2022, ACM Multimedia 2021, a program chair of ACM SIGGRAPH VRCAI 2022, and an organization chair of CGI 2023, associate editor of The Visual Computer, and so on.
News
---(07-2024) Three papers accepted by ACM MM 2024.
---(07-2024) One paper accepted by IEEE TMI.
---(07-2024) Four papers accepted by ECCV 2024.
---(06-2024) One paper accepted by IJCV.
---(06-2024) Six papers accepted at MICCAI 2024 (four papers with an early accept).
---(05-2024) One paper accepted by IEEE TCSVT.
---(03-2024) One paper accepted by IJCV.
---(02-2024) Three papers accepted by CVPR 2024.
---(02-2024) One paper accepted by IEEE TMM.
---(02-2024) One paper accepted by IEEE TCSVT.
---(02-2024) Serve as an Area Chair of MICCAI 2024.
---(01-2024) Serve as an Area Chair of ECCV 2024.
---(01-2024) Two papers accepted by IEEE JBHI.
---(01-2024) One paper accepted by IEEE TNNLS.
---(10-2023) One paper accepted by Medical Image Analysis.
---(10-2023) Received the CCF CAD/CG 2023 Outstanding Reviewer Award
---(07-2023) Two papers accepted by ACM MM 2023.
---(07-2023) Four paper accepted by ICCV 2023.
---(07-2023) One paper accepted by IJCV.
---(06-2023) One paper accepted by IEEE TPAMI.
---(06-2023) Two papers accepted by MICCAI 2023.
---(06-2023) One paper accepted by IEEE TMI.
---(05-2023) One paper accepted by IJCV.
---(05-2023) One paper accepted by IEEE JBHI.
---(02-2023) Three papers accepted by CVPR 2023.
---(02-2023) One paper accepted by IEEE TBME.
---(01-2023) One paper accepted by IEEE TMI.
---(01-2023) Serve as an Area Chair of MICCAI 2023.
---(01-2023) One paper accepted by IEEE ICRA 2023.
---(01-2023) Serve as an organization chair of CGI 2023.
---入选 '美国斯坦福大学2022年度全球前2%顶尖科学家榜单 '.
---(11-2022) One paper accepted by IEEE T-CYB.
---(09-2022) One paper accepted by IEEE TNNLS.
---(08-2022) One paper accepted by PG 2022.
---(07-2022) One paper accepted by ECCV 2022.
---(06-2022) Two papers accepted by ACM MM 2022.
---(06-2022) Five papers accepted by MICCAI 2022.
---(06-2022) Serve as a meta-reviewer of MIUA 2022.
---(03-2022) Serve as Program Co-Chair, ACM SIGGRAPH VRCAI 2022
Conference, December 10-11, 2022, Guangzhou, China.
---(03-2022) One paper accepted by CVPR 2022.
---(02-2022) Serve as an Area Chair of ACM MM 2022.
---(01-2022) One paper accepted by IEEE TBME.
---(12-2021) One paper accepted by IEEE TIP.
---(11-2021) One paper accepted by IEEE TPAMI.
---(10-2021) One paper accepted by Pattern Recognition.
---(10-2021) One paper accepted by IEEE TMM.
---(10-2021) One paper accepted by IEEE TCSVT.
---(07-2021) One paper accepted by ICCV 2021.
---(07-2021) One paper accepted by ACM MM 2021.
---(05-2021) One paper accepted by MICCAI 2021.
---(03-2021) One paper accepted by IEEE TMM.
---(03-2021) Two papers accepted by CVPR 2021.
---(02-2021) Invited as an Area Chair of ACM MM 2021.
Selected publications
Summary: 26x CVPR/ICCV/ECCV, 3x IEEE TPAMI, 4x IJCV
33. Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraint
Sixiang Chen, Tian Ye, Kai Zhang, Zhaohu Xing, Yunlong Lin, and Lei Zhu*,
To appear in ECCV 2024.
32. Semi-Supervised Video Desnowing Network via Temporal Decoupling Experts and Distribution-Driven Contrastive Regularization
Hongtao Wu, Yijun Yang, Angelica Aviles-Rivero, Jingjing Ren, Sixiang Chen, Haoyu Chen, and Lei Zhu*,
To appear in ECCV 2024.
31. Two-Stage Video Shadow Detection via Temporal-Spatial Adaption
Xin Duan, Yu Cao, Lei Zhu, Gang Fu, Xin Wang, Renjie ZHANG, and Ping Li
To appear in ECCV 2024.
30. OpenIn-s3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation
Zhening Huang, Xiaoyang Wu, Xi Chen, Hengshuang Zhao, Lei Zhu, and Joan Lasenby,
To appear in ECCV 2024.
29. Triplane-Smoothed Video Dehazing with CLIP-Enhanced Generalization
Jingjing Ren, Tian Ye, Haoyu Chen, Hongtao Wu, and Lei Zhu*.
To appear in International Journal of Computer Vision (IJCV), 2024
28. Learning Diffusion Texture Priors for Image Restoration
Tian Ye, Sixiang Chen, Wenhan Chai, Zhaohu Xing, Jing Qin, Ge Lin, and Lei Zhu,
CVPR, pp. 2524-2534, 2024.
27. Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal
Yijun Yang, Hongtao Wu, Angelica Aviles-Rivero, Yulun Zhang, Jing Qin, and Lei Zhu,
CVPR, pp. 25606-25616, 2024.
26. Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning
Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Haoze Sun, Xueyi Zou, Youliang Yan, Zhensong Zhang, and Lei Zhu,
CVPR, pp. 25857-25867, 2024.
25. ViDSOD-100: A New Dataset and A Baseline Model for RGB-D Video Salient Object Detection,
Junhao Lin, Lei Zhu, Jiaxing Shen, Huazhu Fu, Qing Zhang, and Liansheng Wang,
To appear in International Journal of Computer Vision (IJCV), 2024
24. Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation,
Yijun Yang, Angelica Aviles-Rivero, Ye Liu, Huazhu Fu, Weiming Wang, and Lei Zhu,
ICCV, pp. 13200-13210, 2023. [Project & Code]
23. Snow Removal in Video: A New Dataset and A Novel Method,
Haoyu Chen, Jingjing Ren, Jinjin Gu, Hongtao Wu, Xuequan Lu, Haoming Cai, and Lei Zhu,
ICCV, pp. 13211-13222 , 2023. [Project & Code]
22. Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks,
Sixiang Chen, Tian Ye, Jinbin Bai, Erkang Chen, Shi Jun, and Lei Zhu,
ICCV, pp. 13106-13117, 2023. [Project & Code]
21. Towards High-quality Specular Highlight Removal by Leveraging Large-scale Synthetic Data
Gang Fu, Qing Zhang, Lei Zhu, Chunxia Xiao, and Ping Li,
ICCV, pp. 12857-12865, 2023.
20. Towards High-Resolution Specular Highlight Detection
Gang Fu, Qing Zhang, Lei Zhu, Qifeng Lin, Yihao Wang, Siyuan Fan, and Chunxia Xiao
To appear in International Journal of Computer Vision (IJCV), 2023.
19. MNGNAS: Distilling Adaptive Combination of Multiple Searched Networks for One-Shot Neural Architecture Search
Zhihua Chen, Guhao Qiu, Ping Li, Lei Zhu, Xiaokang Yang, and Bin Sheng
To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023.
18. Masked Image Pre-training for Generalizable Image Denoising,
Haoyu Chen, Jinjin Gu, Yihao Liu, Salma Abdel Magid, Chao Dong, Qiong Wang, Hanspeter Pfister, and Lei Zhu#,
CVPR, pp. 1692-1703, 2023. [GitHub]
17. Video Dehazing via a Multi-Range Temporal Alignment Network with Physical Prior,
Jiaqi Xu, Xiaowei Hu#, Lei Zhu#, Qi Dou, Jifeng Dai, Yu Qiao, and Pheng-Ann Heng,
CVPR, pp. 18053-18062, 2023. [GitHub]
16. SCOTCH and SODA: A Transformer Video Shadow Detection Framework,
Lihao Liu, Jean Prost, Lei Zhu, Nicolas Papadakis, Pietro Lio, Carola-Bibiane Schönlieb, and Angelica I Aviles-Rivero,
CVPR, pp. 10449-10458, 2023. [GitHub]
15. Learning to Remove Shadows from a Single Image
Hao Jiang, Qing Zhang, Yongwei Nie, Lei Zhu, and Wei-Shi Zheng
International Journal of Computer Vision (IJCV), 131, pp. 2471–2488, 2023.
14. Rethinking Video Rain Streak Removal: A New Synthesis Model and A Deraining Network with Video Rain Prior
Shuai Wang, Lei Zhu#, Huazhu Fu, Jing Qin, Carola-Bibiane Schönlieb, Wei Feng, and Song Wang
ECCV, pp. 565-582, 2022. [GitHub]
13. RSCFed: Random Sampling Consensus Federated Semi-supervised Learning
Xiaoxiao Liang, Yiqun Lin, Huazhu Fu, Lei Zhu, Xiaomeng Li
CVPR, pp. 10154-10163, 2022. [GitHub]
12. VIL-100: A New Dataset and A Baseline Model for Video Instance Lane Detection
Yujun Zhang^, Lei Zhu^, Wei Feng, Huazhu Fu, Mingqian Wang, Qingxia Li, Cheng Li, and Song Wang (^ joint 1st authors)
ICCV, pp. 15681-15690, 2021. [GitHub] [Dataset]
11. Triple-cooperative Video Shadow Detection
Zhihao Chen, Liang Wan, Lei Zhu#, Jia Shen, Huazhu Fu, Wennan Liu, and Jing Qin
CVPR, pp. 2715–2724, 2021. [GitHub] [Dataset]
10. A Multi-Task Network for Joint Specular Highlight Detection and Removal
Gang Fu, Qing Zhang, Lei Zhu, Ping Li, and Chunxia Xiao
CVPR, pp. 7752–7761, 2021. [GitHub]
9. Unsupervised Intrinsic Image Decomposition Using Internal Self-similarity Cues
Qing Zhang, Jin Zhou, Lei Zhu, Wei Sun, Chunxia Xiao, and Wei-Shi Zheng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 44, No. 12, pp. 9669–9686, 2022.
8. A Multi-task Mean Teacher for Semi-supervised Shadow Detection
Zhihao Chen^, Lei Zhu^, Liang Wan, Song Wang, Wei Feng, and Pheng-Ann Heng (^ joint 1st authors)
CVPR, pp. 5611–5620, 2020. [GitHub]
7. Direction-aware Spatial Context Features for Shadow Detection and Removal
Xiaowei Hu, Chi-Wing Fu, Lei Zhu#, Jing Qin, and Pheng-Ann Heng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 42, No. 11, pp. 2795–2808, 2020.
6. Deep Multi-Model Fusion for Single-Image Dehazing
Zijun Deng^, Lei Zhu^, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Qing Zhang, Jing Qin, and Pheng-Ann Heng (^ joint 1st authors)
ICCV, pp. 2453–2462, 2019. [GitHub] [Code]
5. Depth-attentional Features for Single-image Rain Removal
Xiaowei Hu, Chi-Wing Fu, Lei Zhu#, and Pheng-Ann Heng
CVPR, pp. 8022–8031, 2019.
4. Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection
Lei Zhu, Zijun Deng, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, and Pheng-Ann Heng
ECCV, pp. 121–136, 2018. [Github] [Paper]
3. Direction-aware Spatial Context Features for Shadow Detection
Xiaowei Hu^, Lei Zhu^, Chi-Wing Fu, Jing Qin, and Pheng-Ann Heng (^ joint 1st authors)
CVPR, pp. 7454–7462, 2018. [Github]
2. Joint Bi-layer Optimization for Single-image Rain Streak Removal
Lei Zhu, Chi-Wing Fu, Dani Lischinski, and Pheng-Ann Heng
ICCV, pp. 2526–2534, 2017.
1. A Non-Local Low-Rank Framework for Ultrasound Speckle Reduction
Lei Zhu, Chi-Wing Fu, Michael S. Brown, and Pheng-Ann Heng
CVPR, pp. 5650–5658, 2017. [Homepage]
Teaching
Lecturer, 2023-2024, Spring, ROAS 6000G, Advanced Learning Techniques for Medical Robotics Systems, HKUST (GZ).
Lecturer, 2023-2024, Fall, ROAS 5800, Physical-based vision for Robot and Autonomous Driving, HKUST (GZ).
Lecturer, 2023-2024, Fall, ROAS 6800E, Seminar in Robotics and Autonomous Systems, HKUST (GZ).
Lecturer, 2022-2023, Spring, ROAS 6000G, Advanced Learning Techniques for Medical Robotics Systems, HKUST (GZ).
Lecturer, 2022-2023, Spring, ROAS 6800D, Seminar in Robotics and Autonomous Systems, HKUST (GZ).
Lecturer, 2022-2023, Fall, ROAS 6000B, Physical-based vision for Robot and Autonomous Driving, HKUST (GZ).
TA, 2016-2017, Spring CMSC 5711, Image Processing and Computer Vision, CUHK.
TA, 2015-2016, Spring CSCI 2100B, Data Structures, CUHK.
TA, 2015-2016, Spring CMSC 5711, Image Processing and Computer Vision, CUHK.
TA, 2015-2016, Fall CSCI 3260, Principles of Computer Graphics, CUHK.
TA, 2014-2015, Spring CSCI 5210, Advanced Topics in Computer Graphics and Visualization, CUHK.
TA, 2014-2015, Fall CSCI 5460, Virtual Reality, CUHK.
Copyright©2023 Henry