Short Biography
Siyu Zhu is a full professor with tenure at the AI3 Institute of Fudan University and lead the generative vision lab (Fusion Lab). Prior to this, he served as a director at Alibaba Cloud AI Lab, leading a team of 100 employees, and contributed to various aspects of computer vision and machine learning-related products. He also co-founded the 3D vision company Altizure, which was later acquired by Apple Inc and contributed core technology to Apple Augmented Reality.
He obtained his Ph.D. from The Hong Kong University of Science and Technology (HKUST) under the supervision of Professor Long Quan, and bachelor's degree in computer science from Zhejiang University. He has authored or co-authored over 60 papers in top journals and conferences such as TPAMI, ICLR, CVPR, ICCV, and ECCV. His research interests include: (1) generative model for video and 3D, specifically 3D and physics guided video generation, and (2) image based 3D reconstruction.
He served as the program committee member or area chair of AAAI and ICCV. He was awarded the CCF Outstanding Engineer Award.
Selected Works
2D Video Generative Model
3D Generative Model
Generative Model for Biology
3D Reconstruction Engine
SH Zhu, J Chen, Z Dai, Y Xu, X Cao, Y Yao, H Zhu, S ZhuEuropean Conference on Computer Vision (ECCV) 2024
Y Zeng, Y Jiang, S Zhu, Y Lu, Y Lin, H Zhu, W Hu, X Cao, Y YaoEuropean Conference on Computer Vision (ECCV) 2024
Y He, W Yuan, S Zhu, Z Dong, L Bo, Q HuangEuropean Conference on Computer Vision (ECCV) 2024
- Learning a Parametric 3D Full-Head for Free-View Synthesis in 360◦
- High-Fidelity Free-View Synthesis of Emotional 3D Talking Head
Z Dai, Z Zhang, Y Yao, B Qiu, S Zhu, L Qin, W WangArxiv:2311.12886, 2024
Q Zuo, X Gu, L Qiu, Y Dong, Z Zhao, W Yuan, R Peng, S Zhu, Z Dong, L Bo, Q HuangArxiv:2403.12010, 2024
J Cai, Y He, W Yuan, S Zhu, Z Dong, L Bo, Q ChenIEEE Robotics and Automation Letters (RA-L) 2024
Y Lin, Z Dai, S Zhu, Y Yao.Computer Vision and Pattern Recognition (CVPR) 2024.
W Yuan, X Gu, H Li, Z Dong, S Zhu. International Conference on Learning Representations (ICLR) 2023.
X Gu, W Yuan, Z Dai, C Tang, S Zhu, P Tan.IEEE Robotics and Automation Letters (RA-L) 2023
X Gu, C Tang, W Yuan, Z Dai, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2022.
W Yuan, X Gu, Z Dai, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2022.
S Tang, J Zhang, S Zhu, P Tan.International Conference on Learning Representations (ICLR) 2022.
S Tang, C Tang, R Huang, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2021.
Z Fan, L Zhu, H Li, X Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2021.
L Liu, X Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2021.
H Jiang, Z Sheng, S Zhu, Z Dong, R Huang.International Conference on Robotics and Automation (ICRA) 2021.
- Single-Shot is Enough: Panoramic Infrastructure Based Calibration of Multiple Cameras and 3D LiDARs.
R Zhang, S Zhu, T Shen, L Zhou, Z Luo, T Fang, L Quan.IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2020.
F Tan, H Zhu, Z Cui, S Zhu, M Pollefeys, P Tan.Computer Vision and Pattern Recognition (CVPR) 2020.
L Li, S Zhu, H Fu, P Tan, CL Tai.Computer Vision and Pattern Recognition (CVPR) 2020.
X Gu, Z Fan, S Zhu, Z Dai, F Tan, P Tan.Computer Vision and Pattern Recognition (CVPR) 2020.
Z Dai, M Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2019.
S Tang, F Tan, K Cheng, Z Li, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2019.
Z Luo, T Shen, L Zhou, S Zhu, R Zhang, Y Yao, T Fang, L Quan.European Conference on Computer Vision (ECCV) 2018.
L Zhou, S Zhu, Z Luo, T Shen, R Zhang, M Zhen, T Fang, L Quan.European Conference on Computer Vision (ECCV) 2018.
S Zhu, R Zhang, L Zhou, T Shen, T Fang, P Tan, L Quan.Computer Vision and Pattern Recognition (CVPR) 2018.
R Zhang, S Zhu, T Fang, L Quan.International Conference on Computer Vision (ICCV) 2017.
L Zhou, S Zhu, T Shen, J Wang, T Fang, L Quan.International Conference on Computer Vision (ICCV) 2017.
T Shen, S Zhu, T Fang, R Zhang, L Quan.European Conference on Computer Vision (ECCV) 2016.
R Zhang, S Li, T Fang, S Zhu, L Quan.International Conference on Computer Vision (ICCV) 2015.
S Zhu, T Fang, J Xiao, L Quan.Computer Vision and Pattern Recognition (CVPR) 2014.