Talk

1. "Efficient Training for Large-scale Deep Learning Models", Invited Talk, School of Cyber Science and Technology, Sun Yat-sen University, October 2023.

2. "Efficient Training and Continual Training for Foundation Models and Large Language Models",  Internal Talk, "Product and Technology" Seminar in JD Explore Academy, October 2023.

3. "Efficient Training for Large-scale Deep Learning Models", Invited Talk, School of Intelligence Science and Technology, Peking University, October 2023.

4. "Efficient Training for Large-scale Deep Learning Models", Invited Talk, Gaoling School of Artificial Intelligence, Renmin University of China,  October 2023.

5. "Efficient Training for Large-scale Deep Learning Models", Invited Talk, China University of Petroleum,  October 2023.

6. "Efficient Training for Large-scale Deep Learning Models", Invited Talk, Department of Computer Science and Engineering, Southern University of Science and Technology,  September 2023.

7. "Adaptive Optimization for Deep Learning and Beyond", Invited Talk, School of Intelligence Science and Technology, Peking University, September 2023.

8. "Decision Intelligence: Reinforcement Learning, Decision Transformer, Large Language Models, and Beyond", Invited Talk, Department of Automation, Tsinghua University, August 2023.

9. "Learning to Learn without Data", Invited Talk, School of Information and Electronics, Beijing Institute of Technology, May 2023.

10. "Communication-Efficient Personalized Federated Learning via Sparse Training", Invited Talk, School of Information and Electronics, Beijing Institute of Technology, November 2022.

11. "Communication-Efficient Personalized Federated Learning via Sparse Training", Invited Talk, Software College, Northeastern University,  November 2022.

12. "Communication-Efficient Personalized Federated Learning via Sparse Training", Invited Talk, Zhejiang Lab, June 2022.

13. "Large Scale Distributed Deep Learning --Methods, Theory and Applications", Invited Talk,  NVIDIA | GTC2022 Spring, March 2022.

14. "Large Scale Distributed Deep Learning --Methods, Theory and Applications", Invited Talk, CNCC2021, Shenzhen, December 2021.

15. "Large Scale Distributed Deep Learning --Methods, Theory and Applications", Invited Talk, The 13th HPC-AI Advisory Council China Annual Conference, Zhuhai, October 2021.

16. "Modern Optimization for Deep Learning", Invited Talk, Shanghai Graduate School of University of Science and Technology of China, Shanghai, September 2021.

17. "Distributed Optimization and Federated Learning --from the perspective of Optimization", Summer school, School of the Gifted Young, University of Science and Technology of China, August 2021.

18. "Distributed Optimization and Federated Learning --from the perspective of Optimization", Summer school, Fudan University, July 2021.

19. "On the Convergence of Distributed Adam and Beyond", Invited Talk, Shenzhen University, Shenzhen, October 2020.

20. "An Algorithmic Framework of Variable Metric Over-Relaxed Hybrid Proximal Extra-Gradient Method", ICML Oral presentation, Stockholm, Sweden, July 2018.

21. "GSOS: Gauss-Seidel Operator Splitting Algorithm for Multi-Term Nonsmooth Convex Composite Optimization", ICML Oral presentation, Sydney, Australia, August 2017.