Zeman Li

ATLAS: Learning to Optimally Memorize the Context at Test Time

Ali Behrouz, Zeman Li, Praneeth Kacham, Majid Daliri, Yuan Deng, Peilin Zhong, Meisam Razaviyayn, Vahab Mirrokni

[Preprint]

PiKE: Adaptive Data Mixing for Multi-Task Learning Under Low Gradient Conflicts

Zeman Li, Yuan Deng, Peilin Zhong, Meisam Razaviyayn, Vahab Mirrokni

[Preprint]

Synthetic Text Generation for Training Large Language Models via Gradient Matching

Dang Nguyen*, Zeman Li*, Mohammadhossein Bateni, Vahab Mirrokni, Meisam Razaviyayn, Baharan Mirzasoleiman 

*Equal contribution

Accepted at ICML 25

[Preprint] [Code] 

Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models

Zeman Li, Xinwei Zhang, Peilin Zhong, Yuan Deng, Meisam Razaviyayn, Vahab Mirrokni

Accepted at ICLR 25

[Preprint] [Code]

Optimal Differentially Private Learning with Public Data

Andrew Lowy, Zeman Li, Tianjian Huang, Meisam Razaviyayn

Accepted at ICML 24

[Preprint] [Code]