Donghwan Lee, "Final iteration convergence bound of Q-Learning: switching system approach," IEEE Transactions on Automatic Control, vol. 69, no. 7, 2024 [link]
Donghwan Lee, Jianghai Hu, and Niao He, “A discrete-time switching system analysis of Q-learning,” SIAM Journal on Control and Optimization, vol. 61, no. 3, 2023 [link] [online extension]
Donghwan Lee, "Convergence of dynamic programming on the semidefininte cone for discrete-time infinite-horizon LQR," IEEE Transactions on Automatic Control, vol. 67, no. 10, 2022 [link]
Donghwan Lee, Han-Dong Lim, Jihoon Park, and Okyong Choi, "New versions of gradient temporal-difference learning," IEEE Transactions on Automatic Control, vol. 68, no. 8, 2023 [link] [online extension]
Donghwan Lee and Niao He, ``A unified switching system perspective and convergence analysis of Q-learning algorithms,'' NeurIPS2020 [link] [Online extension]