Conference Papers (* denotes equal contribution)

• • • Scalable Primal-Dual Actor-Critic Method for Safe Multi-Agent RL with General Utilities.

      • Donghao Ying, Yunkai Zhang, Yuhao Ding, Alec Koppel, Javad Lavaei.

      • The 37th Annual Conference on Neural Information Processing Systems (NeurIPS), 2023.

• • • No-Regret Learning in Dynamic Competition with Reference Effects Under Logit Demand.

      • Mengzi Amy Guo, Donghao Ying, Javad Lavaei, Zuo-Jun Max Shen

      • The 37th Annual Conference on Neural Information Processing Systems (NeurIPS), 2023.

• • • Scalable Multi-Agent Reinforcement Learning with General Utilities.

      • Donghao Ying, Yuhao Ding, Alec Koppel, Javad Lavaei

      • American Control Conference (ACC), 2023.

• • • Policy-based Primal-Dual Methods for Convex Constrained Markov Decision Processes.

      • Donghao Ying, Mengzi Amy Guo, Yuhao Ding, Javad Lavaei, Zuo-Jun Max Shen.

      • The 37th AAAI Conference on Artificial Intelligence (AAAI), 2023.

• • • A Dual Approach to Constrained Markov Decision Processes With Entropy Regularization.

      • Donghao Ying, Yuhao Ding and Javad Lavaei.

      • The 25th International Conference on Artificial Intelligence and Statistics (AISTATS), 2022.

• • • Towards VM Rescheduling Optimization Through Deep Reinforcement Learning.

      • Xianzhong Ding*, Yunkai Zhang*, Binbin Chen, Donghao Ying, Tieying Zhang, Jian-jun Chen, Lei Zhang, Alberto Cerpa, Wan Du

      • European Conference on Computer Systems (EuroSys), 2025.

      • Short version accepted by The MlSys Workshop at Neurips, 2023.

Journal Articles

• • • Policy-based Primal-Dual Methods for Concave CMDP with Variance Reduction.

  • Donghao Ying, Mengzi Amy Guo, Hyunin Lee, Yuhao Ding, Javad Lavaei, Zuo-Jun Max Shen

  • Accepted by Journal of Artificial Intelligence Research (JAIR), 2025.

• • • Last-iterate Convergence in No-regret Learning: Games with Reference Effects Under Logit Demand.

      • Mengzi Amy Guo, Donghao Ying, Javad Lavaei, Zuo-Jun Max Shen

      • Management Science (MS), 2025.

• • • A Hitting Time Analysis for Stochastic Time-Varying Functions with Applications to Adversarial Attacks on Computation of Markov Decision Processes.

      • Ali Yekkehkhany, Han Feng, Donghao Ying, Javad Lavaei.

      • IEEE Transactions on Automatic Control (TAC), 2023.

• • • Almost Envy-free Allocations of Unweighted Items. 

      • Zhijie Zhang*, Donghao Ying*, Xiaoming Sun, and Jialin Zhang.

      • SCIENTIA SINICA Informationis, 2022.

Working Papers

• • • Subsampled Ensemble Can Improve Generalization Tail Exponentially

  • Huajie Qian*, Donghao Ying*, Henry Lam, Wotao Yin

  • Under review, 2024.

• • • Few-Shot Test-Time Optimization Without Retraining for Semiconductor Recipe Generation and Beyond.

  • Shangding Gu, Donghao Ying, Ming Jin, Yu Joe Lu, Jun Wang, Javad Lavaei, Costas Spanos

  • Under review, 2025.

• • • Reward-Safety Balance in Offline Safe RL Via Diffusion Regularization.

  • Junyu Guo, Zhi Zheng, Donghao Ying, Ming Jin, Shangding Gu, Costas Spanos, Javad Lavaei

  • Under review, 2025.

• • • M4R: Measuring Massive Multi-Modal Understanding and Reasoning in Open Space.

  • Shangding Gu, Xiaohan Wang, Donghao Ying, Haoyu Zhao, Runing Yang, Boyi Li, Ming Jin, Marco Pavone, Serena Yeung-Levy, Jun Wang, Dawn Song, Costas Spanos

  • Under review, 2025.