Short Biography

Siyu Zhu is a full professor with tenure at the AI3 Institute of Fudan University and lead the generative vision lab (Fusion Lab). Prior to this, he served as a director at Alibaba Cloud AI Lab, leading a team of 100 employees, and contributed to various aspects of computer vision and machine learning-related products. He also co-founded the 3D vision company Altizure, which was later acquired by Apple Inc and contributed core technology to Apple Augmented Reality.

He obtained his Ph.D. from The Hong Kong University of Science and Technology (HKUST) under the supervision of Professor Long Quan, and bachelor's degree in computer science from Zhejiang University. He has authored or co-authored over 60 papers in top journals and conferences such as TPAMI, ICLR, CVPR, ICCV, and ECCV.

His research interests include: (1) generative model for video and 3D, namely vision-based 3D reconstruction, generation, understanding, manipulation and simulation; (2) deep learning and pattern recognition, namely self-supervised learning, human pose estimation, semantic segmentation, object detection, image classification, salient object detection. 


Representative Works

Hallo,  Champ,  AnimateAnything  
VideoMVStag4D
Altizure (Apple Augmented Reality) 

Selected Publications (Full List)

M Xu, H Li, Q Su, H Shang, L Zhang, C Liu, J Wang, Y Yao, S ZhuArXiv:2406.08801
SH Zhu, J Chen, Z Dai, Y Xu, X Cao, Y Yao, H Zhu, S ZhuEuropean Conference on Computer Vision (ECCV) 2024
Y Zeng, Y Jiang, S Zhu, Y Lu, Y Lin, H Zhu, W Hu, X Cao, Y YaoEuropean Conference on Computer Vision (ECCV) 2024
Y He, W Yuan, S Zhu, Z Dong, L Bo, Q HuangEuropean Conference on Computer Vision (ECCV) 2024
  • Learning a Parametric 3D Full-Head for Free-View Synthesis in 360◦
European Conference on Computer Vision (ECCV) 2024
  • High-Fidelity Free-View Synthesis of Emotional 3D Talking Head
European Conference on Computer Vision (ECCV) 2024
Z Dai, Z Zhang, Y Yao, B Qiu, S Zhu, L Qin, W WangArxiv:2311.12886, 2023
Q Zuo, X Gu, L Qiu, Y Dong, Z Zhao, W Yuan, R Peng, S Zhu, Z Dong, L Bo, Q HuangArxiv:2403.12010, 2024
J Cai, Y He, W Yuan, S Zhu, Z Dong, L Bo, Q ChenIEEE Robotics and Automation Letters (RA-L) 2024
Y Lin, Z Dai, S Zhu, Y Yao.Computer Vision and Pattern Recognition (CVPR) 2024.
W Yuan, X Gu, H Li, Z Dong, S Zhu.  International Conference on Learning Representations (ICLR) 2023.
X Gu, W Yuan, Z Dai, C Tang, S Zhu, P Tan.IEEE Robotics and Automation Letters (RA-L) 2023
X Gu, C Tang, W Yuan, Z Dai, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2022.
W Yuan, X Gu, Z Dai, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2022.
S Tang, J Zhang, S Zhu, P Tan.International Conference on Learning Representations (ICLR) 2022.
S Tang, C Tang, R Huang, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2021.
Z Fan, L Zhu, H Li, X Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2021.
L Liu, X Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2021.
H Jiang, Z Sheng, S Zhu, Z Dong, R Huang.International Conference on Robotics and Automation (ICRA) 2021.
C Fang, S Ding, Z Dong, H Li, S Zhu, P Tan.International Conference on Intelligent Robots and Systems (IROS) 2021.
R Zhang, S Zhu, T Shen, L Zhou, Z Luo, T Fang, L Quan.IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2020.
F Tan, H Zhu, Z Cui, S Zhu, M Pollefeys, P Tan.Computer Vision and Pattern Recognition (CVPR) 2020.
L Li, S Zhu, H Fu, P Tan, CL Tai.Computer Vision and Pattern Recognition (CVPR) 2020.
X Gu, Z Fan, S Zhu, Z Dai, F Tan, P Tan.Computer Vision and Pattern Recognition (CVPR) 2020.
Z Dai, M Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2019.
S Tang, F Tan, K Cheng, Z Li, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2019.
Z Luo, T Shen, L Zhou, S Zhu, R Zhang, Y Yao, T Fang, L Quan.European Conference on Computer Vision (ECCV) 2018.
L Zhou, S Zhu, Z Luo, T Shen, R Zhang, M Zhen, T Fang, L Quan.European Conference on Computer Vision (ECCV) 2018.
S Zhu, R Zhang, L Zhou, T Shen, T Fang, P Tan, L Quan.Computer Vision and Pattern Recognition (CVPR) 2018.
R Zhang, S Zhu, T Fang, L Quan.International Conference on Computer Vision (ICCV) 2017.
L Zhou, S Zhu, T Shen, J Wang, T Fang, L Quan.International Conference on Computer Vision (ICCV) 2017.
T Shen, S Zhu, T Fang, R Zhang, L Quan.European Conference on Computer Vision (ECCV) 2016.
R Zhang, S Li, T Fang, S Zhu, L Quan.International Conference on Computer Vision (ICCV) 2015.
S Zhu, T Fang, J Xiao, L Quan.Computer Vision and Pattern Recognition (CVPR) 2014.