Publications
Accepted Publications
The Role of Lookahead and Approximate Policy Evaluation in Reinforcement Learning with Linear Value Function Approximation
Anna Winnicki, Joseph Lubars, Michael Livesay, R. Srikant
Operations Research (OR), 2024
https://arxiv.org/abs/2109.13419
On The Convergence Of Policy Iteration-Based Reinforcement Learning With Monte Carlo Policy Evaluation
Anna Winnicki, R. Srikant
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Finalist, INFORMS Applied Probability Society Best Student Paper Competition, 2023
https://arxiv.org/abs/2301.09709
3. Pricing Economic Dispatch with AC Power Flow via Local Multipliers and Conic Relaxation
Mariola Ndrio, Anna Winnicki, Subhonmesh Bose
IEEE Transactions on Control of Network Systems, 2022
https://arxiv.org/pdf/1910.10673.pdf
4. On Convex Relaxation-Based Distribution Locational Marginal Prices
Anna Winnicki, Mariola Ndrio, Subhonmesh Bose
IEEE Power and Energy Society Innovative Smart Grid Technologies Conference, 2020
https://ieeexplore.ieee.org/document/9087752
5. On Privatizing Equilibrium Computation in Aggregate Games over Networks
Shripad Gade, Anna Winnicki, Subhonmesh Bose
IFAC World Congress, 2020
https://www.sciencedirect.com/science/article/pii/S2405896320315196
6. Performance Bounds For Policy-Based Reinforcement Learning Methods in Zero-Sum Markov Games With Linear Function Approximation
Anna Winnicki, R. Srikant
IEEE Conference on Decision and Control (CDC), 2023
7. Reinforcement Learning with Unbiased Policy Evaluation and Linear Function Approximation
Anna Winnicki, R. Srikant
IEEE Conference on Decision and Control (CDC), 2022
https://arxiv.org/pdf/2210.07338.pdf
Publications Under Review
8. A New Policy Iteration Algorithm For Reinforcement Learning in Zero-Sum Markov Games
Anna Winnicki, R. Srikant
Submitted to IEEE Transactions on Automatic Control (TAC), 2023
https://arxiv.org/abs/2303.09716
Ongoing Work
9. Convergence of Optimistic Policy Iteration for MDPs with Acyclic Transient State Structure
Joseph Lubars, Anna Winnicki, Michael Livesay, R. Srikant
https://arxiv.org/abs/2102.00030