Henry, Lei Zhu

Assistant Professor, ROAS Thrust, The Hong Kong University of Science and Technology (Guangzhou), Nansha, Guangzhou, 511400, Guangdong, China

Affiliated Assistant Professor, Department of Electonic and Computer Engineering, The Hong Kong University of Science and Technology, Hong Kong SAR, China

Email: leizhu@ust.hk  or leizhu@hkust-gz.edu.cn

Office: Room 515, W1, The Hong Kong University of Science and Technology (Guangzhou), Nansha, Guangzhou, 511400, Guangdong, China

[Google Scholar] [DBLP] [Researchgate]

Update: I am currently looking for talented students to work on innovative computer vision, computer graphics, medical imaging, and deep learning at HKUST (GZ). PhD/RA/Postdoc positions are available. The salaries will be highly competitive. Please drop me an email (with a title 'PHD/RA/Postdoc application') if you are interested. As a new campus of HKUST, HKUST (GZ) focuses on the interdisciplinary research.

Short Bio.

I am an assistant professor at ROAS Thrust, HKUST(GZ), and also an affiliated assistant professor at ECE, HKUST. Before that, I was a Postdoctoral researcher at DAMTP, University of Cambridge, working with Prof. Carola-Bibiane Schönlieb. My Ph.D. was obtained at the Department of Computer Science and Engineering, the Chinese University of Hong Kong under the supervision of Prof. Pheng-Ann Heng and Prof. Chi-Wing Fu, Philip in 2017. I am serving as the PG coordinator of the ROAS Thrust from 2023.

Research Interests

My research interests include computer vision, image restoration, image enhancement, image and video processing, medical AI, and deep learning. The main research goal is to answer the question of how to develop intelligent image perception methods for extracting useful information from visual content that is prevalent in live sources and medical imaging. These techniques benefit outdoor vision analysis, multimedia analysis, and medical intelligence systems. In the past three years, our research works have been published in top-tier journals and conferences, e.g., IEEE TPAMI/IJCV/CVPR/ICCV/ECCV, IEEE TIP/TNNLS/TMM/TCSVT/TVCG, AAAI/IJCAI/ACM-MM, and MICCAI/IEEE TMI/Medical Image Analysis/IEEE TBME. I have been invited as an area chair of ECCV 2024, MICCAI 2024, MICCAI 2023, ACM Multimedia 2022, ACM Multimedia 2021, a program chair of ACM SIGGRAPH VRCAI 2022,  and an organization chair of CGI 2023, associate editor of The Visual Computer.

News

---(03-2024)  One paper accepted by IJCV

---(02-2024)  Three papers accepted by CVPR 2024. 

---(02-2024)  One paper accepted by IEEE TMM. 

---(02-2024)  One paper accepted by IEEE TCSVT. 

---(02-2024) Serve as an area chair of MICCAI 2024.

---(01-2024) Serve as an area chair of ECCV 2024.

---(01-2024) Two papers accepted by IEEE JBHI.

---(01-2024) One paper accepted by IEEE TNNLS.

---(10-2023) One paper accepted by Medical Image Analysis.

---(10-2023) Received the CCF CAD/CG 2023 Outstanding Reviewer Award

---(07-2023) Two papers accepted by ACM MM 2023.

---(07-2023) Four  paper accepted by ICCV 2023.

---(07-2023) One paper accepted by IJCV.

---(06-2023) One paper accepted by IEEE TPAMI.

---(06-2023) Two papers accepted by MICCAI 2023.

---(06-2023) One paper accepted by IEEE TMI.

---(05-2023) One paper accepted by IJCV.

---(05-2023) One paper accepted by IEEE JBHI.

---(02-2023) Three papers accepted by CVPR 2023.

---(02-2023) One paper accepted by IEEE TBME.

---(01-2023) One paper accepted by IEEE TMI.

---(01-2023) Serve as an area chair of MICCAI 2023.

---(01-2023) One paper accepted by IEEE ICRA 2023.

---(01-2023) Serve as an organization chair of CGI 2023.

---入选 '美国斯坦福大学2022年度全球前2%顶尖科学家榜单 '.

---(11-2022) One paper accepted by IEEE T-CYB.

---(09-2022) One paper accepted by IEEE TNNLS.

---(08-2022) One paper accepted by PG 2022.

---(07-2022) One paper accepted by ECCV 2022.

---(06-2022) Two papers accepted by ACM MM 2022.

---(06-2022) Five papers accepted by MICCAI 2022.

---(06-2022) Serve as a meta-reviewer of MIUA 2022.

---(03-2022) Serve as Program Co-Chair, ACM SIGGRAPH VRCAI 2022

 Conference, December 10-11, 2022, Guangzhou, China.

---(03-2022) One paper accepted by CVPR 2022.

---(02-2022) Serve as an area chair of ACM MM 2022.

---(01-2022) One paper accepted by IEEE TBME.

---(12-2021) One paper accepted by IEEE TIP.

---(11-2021) One paper accepted by IEEE TPAMI.

---(10-2021) One paper accepted by Pattern Recognition.

---(10-2021) One paper accepted by IEEE TMM.

---(10-2021) One paper accepted by IEEE TCSVT.

---(07-2021) One paper accepted by ICCV 2021.

---(07-2021) One paper accepted by ACM MM 2021.

---(05-2021) One paper accepted by MICCAI 2021.

---(03-2021) One paper accepted by IEEE TMM.

---(03-2021) Two papers accepted by CVPR 2021.

---(02-2021) Invited as an area chair of ACM MM 2021.

Selected publications 

Summary: 22x CVPR/ICCV/ECCV, 3x IEEE TPAMI, 3x IJCV 

28. Learning Diffusion Texture Priors for Image Restoration

Tian Ye, Sixiang Chen, Wenhan Chai, Zhaohu Xing, Jing Qin, Ge Lin, and Lei Zhu,

To appear in CVPR 2024

27. Genuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather Removal

Yijun Yang, Hongtao Wu, Angelica Aviles-Rivero, Yulun Zhang, Jing Qin, and Lei Zhu,

To appear in CVPR 2024

26. Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning

Haoyu Chen, Wenbo Li, Jinjin Gu, Jingjing Ren, Haoze Sun, Xueyi Zou, Youliang Yan, Zhensong Zhang, and Lei Zhu,

To appear in CVPR 2024

25. ViDSOD-100: A New Dataset and A Baseline Model for RGB-D Video Salient Object Detection, 

Junhao Lin, Lei Zhu, Jiaxing Shen, Huazhu Fu, Qing Zhang, and Liansheng Wang,

To appear in International Journal of Computer Vision (IJCV), 2024

24. Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagation,

Yijun Yang, Angelica Aviles-Rivero, Ye Liu, Huazhu Fu, Weiming Wang, and Lei Zhu

ICCV, pp. 13200-13210, 2023. [Project & Code]

23. Snow Removal in Video: A New Dataset and A Novel Method, 

Haoyu Chen, Jingjing Ren, Jinjin Gu, Hongtao Wu, Xuequan Lu, Haoming Cai, and Lei Zhu

ICCV, pp. 13211-13222 , 2023. [Project & Code]

22. Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks, 

Sixiang Chen, Tian Ye, Jinbin Bai, Erkang Chen, Shi Jun, and Lei Zhu

ICCV, pp. 13106-13117,  2023. [Project & Code]

21. Towards High-quality Specular Highlight Removal by Leveraging Large-scale Synthetic Data

Gang Fu, Qing Zhang, Lei Zhu, Chunxia Xiao, and Ping Li, 

ICCV, pp. 12857-12865, 2023. 

20. Towards High-Resolution Specular Highlight Detection

Gang Fu, Qing Zhang, Lei Zhu, Qifeng Lin, Yihao Wang, Siyuan Fan, and Chunxia Xiao

To appear in International Journal of Computer Vision (IJCV), 2023. 

19. MNGNAS: Distilling Adaptive Combination of Multiple Searched Networks for One-Shot Neural Architecture Search 

Zhihua Chen, Guhao Qiu, Ping Li, Lei Zhu, Xiaokang Yang, and Bin Sheng

To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023.

18. Masked Image Pre-training for Generalizable Image Denoising

Haoyu Chen, Jinjin Gu, Yihao Liu, Salma Abdel Magid, Chao Dong, Qiong Wang, Hanspeter Pfister, and Lei Zhu#

CVPR, pp. 1692-1703, 2023. [GitHub]

17. Video Dehazing via a Multi-Range Temporal Alignment Network with Physical Prior

Jiaqi Xu, Xiaowei Hu#, Lei Zhu#, Qi Dou, Jifeng Dai, Yu Qiao, and Pheng-Ann Heng, 

CVPR, pp. 18053-18062, 2023. [GitHub]

16. SCOTCH and SODA: A Transformer Video Shadow Detection Framework,

Lihao Liu, Jean Prost, Lei Zhu, Nicolas Papadakis, Pietro Lio, Carola-Bibiane Schönlieb, and Angelica I Aviles-Rivero, 

CVPR, pp. 10449-10458, 2023. [GitHub]

15. Learning to Remove Shadows from a Single Image

Hao Jiang, Qing Zhang, Yongwei Nie, Lei Zhu, and Wei-Shi Zheng

International Journal of Computer Vision (IJCV), 131, pp. 2471–2488, 2023.

14. Rethinking Video Rain Streak Removal: A New Synthesis Model and A Deraining Network with Video Rain Prior

Shuai Wang, Lei Zhu#, Huazhu Fu, Jing Qin, Carola-Bibiane Schönlieb, Wei Feng, and Song Wang

ECCV, pp. 565-582,  2022. [GitHub]

13. RSCFed: Random Sampling Consensus Federated Semi-supervised Learning

Xiaoxiao Liang, Yiqun Lin, Huazhu Fu, Lei Zhu, Xiaomeng Li

CVPR, pp. 10154-10163,  2022. [GitHub]

12. VIL-100: A New Dataset and A Baseline Model for Video Instance Lane Detection

Yujun Zhang^, Lei Zhu^, Wei Feng, Huazhu Fu, Mingqian Wang, Qingxia Li, Cheng Li, and Song Wang  (^ joint 1st authors)

ICCV, pp. 15681-15690, 2021. [GitHub] [Dataset]

11. Triple-cooperative Video Shadow Detection

Zhihao Chen, Liang Wan, Lei Zhu#, Jia Shen, Huazhu Fu, Wennan Liu, and Jing Qin

CVPR, pp. 27152724, 2021. [GitHub] [Dataset]

10. A Multi-Task Network for Joint Specular Highlight Detection and Removal 

Gang Fu, Qing Zhang, Lei Zhu, Ping Li, and Chunxia Xiao

CVPR, pp. 77527761, 2021. [GitHub]

9. Unsupervised Intrinsic Image Decomposition Using Internal Self-similarity Cues

Qing Zhang, Jin Zhou, Lei Zhu, Wei Sun, Chunxia Xiao, and Wei-Shi Zheng

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 44, No. 12, pp. 9669–9686, 2022. 

8. A Multi-task Mean Teacher for Semi-supervised Shadow Detection 

Zhihao Chen^, Lei Zhu^, Liang Wan, Song Wang, Wei Feng, and Pheng-Ann Heng (^ joint 1st authors)

CVPR, pp. 56115620, 2020. [GitHub]

7. Direction-aware Spatial Context Features for Shadow Detection and Removal

Xiaowei Hu, Chi-Wing Fu, Lei Zhu#, Jing Qin, and Pheng-Ann Heng

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 42, No. 11, pp. 2795–2808, 2020.

6. Deep Multi-Model Fusion for Single-Image Dehazing 

Zijun Deng^, Lei Zhu^, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Qing Zhang, Jing Qin, and Pheng-Ann Heng (^ joint 1st authors)

ICCV, pp. 2453–2462, 2019.  [GitHub] [Code]

5. Depth-attentional Features for Single-image Rain Removal

Xiaowei Hu, Chi-Wing Fu, Lei Zhu#, and Pheng-Ann Heng

CVPR,  pp. 8022–8031, 2019. 

4. Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection 

Lei Zhu, Zijun Deng, Xiaowei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, and Pheng-Ann Heng

ECCV, pp. 121–136, 2018.  [Github]    [Paper]   

3. Direction-aware Spatial Context Features for Shadow Detection 

Xiaowei Hu^, Lei Zhu^, Chi-Wing Fu, Jing Qin, and Pheng-Ann Heng (^ joint 1st authors)

CVPR, pp. 7454–7462, 2018. [Github]  

2. Joint Bi-layer Optimization for Single-image Rain Streak Removal 

Lei Zhu, Chi-Wing Fu, Dani Lischinski, and Pheng-Ann Heng

ICCV, pp. 25262534, 2017. 

1. A Non-Local Low-Rank Framework for Ultrasound Speckle Reduction 

Lei Zhu, Chi-Wing Fu, Michael S. Brown, and Pheng-Ann Heng

CVPR, pp. 56505658, 2017. [Homepage]   

Teaching 

Copyright©2023 Henry