Short Biography

Siyu Zhu is a full professor in the AI3 Institute of Fudan University and lead the generative vision lab (Fusion Lab). Prior to this, he served as a director at Alibaba Cloud AI Lab, leading a team of 100 employees, and contributed to various aspects of computer vision and machine learning-related products. He also co-founded the 3D vision company Altizure, which was later acquired by Apple Inc and contributed core technology to Apple Augmented Reality.

He obtained his Ph.D. from The Hong Kong University of Science and Technology (HKUST) under the supervision of Professor Long Quan, and bachelor's degree in computer science from Zhejiang University. He has authored or co-authored over 50 papers in top journals and conferences such as TPAMI, ICLR, CVPR, ICCV, and ECCV.

His research interests include: (1) generative model for video and 3D, namely vision-based 3D reconstruction, generation, understanding, manipulation and simulation; (2) deep learning and pattern recognition, namely self-supervised learning, human pose estimation, semantic segmentation, object detection, image classification, salient object detection. 


Representative Works

Champ
AnymateAnything  
VideoMV, STAG4D
Altizure (Apple Augmented Reality) 

Selected Publications (Google Scholar)

S Zhu, J Chen, Z Dai, Y Xu, X Cao, Y Yao, H Zhu, S ZhuArxiv:2403.14781, 2024
Z Dai, Z Zhang, Y Yao, B Qiu, S Zhu, L Qin, W WangArxiv:2311.12886, 2023
Q Zuo, X Gu, L Qiu, Y Dong, Z Zhao, W Yuan, R Peng, S, Z Dong, L Bo, Q HuangArxiv:2403.12010, 2024
J Cai, Y He, W Yuan, S Zhu, Z Dong, L Bo, Q ChenArxiv:2403.12396, 2024
Y Zeng, Y Jiang, S Zhu, Y Lu, Y Lin, H Zhu, W Hu, X Cao, Y YaoArxiv:2403.14939, 2024
Y Lin, Z Dai, S Zhu, Y Yao.Computer Vision and Pattern Recognition (CVPR) 2024.
W Yuan, X Gu, H Li, Z Dong, S Zhu.  International Conference on Learning Representations (ICLR) 2023.
X Gu, W Yuan, Z Dai, C Tang, S Zhu, P Tan.IEEE Robotics and Automation Letters (RA-L) 2023
Z Zhang, F Shao, Z Dai, S Zhu.Arxiv:2301.09416, 2023.
Z Wei, X Chen, M Chen, S Zhu.Arxiv:2301.06429, 2023.
Z Dai, G Wang, W Yuan, X Liu, S Zhu, P Tan.Asian Conference on Computer Vision (ACCV) 2022.
X Gu, C Tang, W Yuan, Z Dai, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2022.
W Yuan, X Gu, Z Dai, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2022.
S Tang, J Zhang, S Zhu, P Tan.International Conference on Learning Representations (ICLR) 2022.
R Shrestha, Z Fan, Z Dai, Q Su, S Zhu, P Tan.International Conference on 3D Vision (3DV) 2021.
S Tang, C Tang, R Huang, S Zhu, P Tan.Computer Vision and Pattern Recognition (CVPR) 2021.
Z Fan, L Zhu, H Li, X Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2021.
L Liu, X Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2021.
H Jiang, Z Sheng, S Zhu, Z Dong, R Huang.International Conference on Robotics and Automation (ICRA) 2021.
W Yuan, Y Zhang, B Wu, S Zhu, P Tan, MY Wang, Q Chen.International Conference on Intelligent Robots and Systems (IROS) 2021.
C Fang, S Ding, Z Dong, H Li, S Zhu, P Tan.International Conference on Intelligent Robots and Systems (IROS) 2021.
R Zhang, S Zhu, T Shen, L Zhou, Z Luo, T Fang, L Quan.IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2020.
F Tan, H Zhu, Z Cui, S Zhu, M Pollefeys, P Tan.Computer Vision and Pattern Recognition (CVPR) 2020.
L Li, S Zhu, H Fu, P Tan, CL Tai.Computer Vision and Pattern Recognition (CVPR) 2020.
X Gu, Z Fan, S Zhu, Z Dai, F Tan, P Tan.Computer Vision and Pattern Recognition (CVPR) 2020.
Z Dai, M Chen, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2019.
S Tang, F Tan, K Cheng, Z Li, S Zhu, P Tan.International Conference on Computer Vision (ICCV) 2019.
Z Luo, T Shen, L Zhou, S Zhu, R Zhang, Y Yao, T Fang, L Quan.European Conference on Computer Vision (ECCV) 2018.
L Zhou, S Zhu, Z Luo, T Shen, R Zhang, M Zhen, T Fang, L Quan.European Conference on Computer Vision (ECCV) 2018.
S Zhu, R Zhang, L Zhou, T Shen, T Fang, P Tan, L Quan.Computer Vision and Pattern Recognition (CVPR) 2018.
Y Yao, S Li, S Zhu, H Deng, T Fang, L Quan.International Conference on 3D Vision (3DV) 2017.
R Zhang, S Zhu, T Fang, L Quan.International Conference on Computer Vision (ICCV) 2017.
L Zhou, S Zhu, T Shen, J Wang, T Fang, L Quan.International Conference on Computer Vision (ICCV) 2017.
S Zhu, T Shen, L Zhou, R Zhang, J Wang, T Fang, L Quan.Arxiv:1702.08601, 2017.
T Shen, S Zhu, T Fang, R Zhang, L Quan.European Conference on Computer Vision (ECCV) 2016.
J Wang, T Fang, Q Su, S Zhu, J Liu, S Cai, CL Tai, L Quan.IEEE Transactions on Visualization & Computer Graphics (TVCG) 2016.
R Zhang, S Li, T Fang, S Zhu, L Quan.International Conference on Computer Vision (ICCV) 2015.
S Zhu, T Fang, J Xiao, L Quan.Computer Vision and Pattern Recognition (CVPR) 2014.