Selected Publications
Reinforcement Learning
Hyunjun Na, Donghwan Lee, "Finite-time analysis of double Q-learning using switching system model," 2024
Narim Jeong, Donghwan Lee, "Finite-time error analysis of soft Q-learning: switching system approach," 2024 [link]
Han-Dong Lim, Hyeann Lee, Donghwan Lee, "Finite-time error analysis of online model-based Q-learning with a relaxed sampling model" 2024 [link]
Donghwan Lee, "Unified ODE analysis of smooth Q-learning algorithms," 2024 [link]
Donghwan Lee, "Analysis of off-policy multi-step TD-learning with linear function approximation," 2024 [link]
Hyeann Lee, Donghwan Lee, "Suppressing overestimation in Q-learning through adversarial behaviors," 2023 [link]
Han-Dong Lim, Donghwan Lee, "Finite-time analysis of asynchronous Q-learning under diminishing step-size from control-theoretic view" 2022 [link]
Han-Dong Lim, Donghwan Lee, "Temporal difference learning with experience replay," 2023 [link]
Han-Dong Lim, Donghwan Lee, "A primal-dual perspective for distributed TD-learning," 2023 [link]
Han-Dong Lim, Donghwan Lee, "Convergent Q-learning with linear function approximation using regularization term," 2022 [link]
Donghwan Lee, "Finite-time analysis of minimax Q-learning for two-player zero-sum Markov games: switching system approach," 2023 [link].
Donghwan Lee and Do Wan Kim, "Finite-time analysis of temporal difference learning: discrete-time linear system perspective," 2022 [link]
Donghwan Lee, "Final iterate convergence of Q-learning: switching system approach," IEEE Transactions on Automatic Control, 2024 (accepted) [link]
Donghwan Lee, "On some geometric behaior of value iteration on the orthant: switching system perspective" CDC2023, Dec. 13-15, 2023, Singapore [link]
Han-Dong Lim, Donghwan Lee, "Backstepping temporal-difference learning " ICLR2023, Kigali, Rwanda, May 1-5, 2023 [link]
Donghwan Lee, Jianghai Hu, and Niao He, “A discrete-time switching system analysis of Q-learning,” SIAM Journal on Control and Optimization, vol. 61, no. 3, 2023 [link] [online extension]
Donghwan Lee, Han-Dong Lim, Jihoon Park, and Okyong Choi, "New versions of gradient temporal-difference learning," IEEE Transactions on Automatic Control, vol. 68, no. 8, 2023 [link] [online extension]
Kanwal Naveed, Muhammad Latif Anjum, Wajahat Hussain, Donghwan Lee, "Deep introspective SLAM: Deep reinforcement learning based approach to avoid tracking failure in visual SLAM," Autonomous Robots, vol. 46, pp. 705-724, 2022 [link]
Donghwan Lee, Do Wan Kim, Jianghai Hu, "Distributed off-policy temporal difference learning using primal-dual method," IEEE Access, vol. 10, 2022 [link].
Donghwan Lee and Niao He, ``A unified switching system perspective and convergence analysis of Q-learning algorithms,'' NeurIPS2020 [link] [Online extension].
Donghwan Lee and Niao He, ``Periodic Q-learning,'' L4DC2020, Berkeley, CA, June, 2020 [link].
Donghwan Lee, Niao He, Kamal Parameswaran, and Volkan Cevher, "Optimization for reinforcement learning: from single agent to cooperative agents," IEEE Signal Processing Magazine, vol. 37, no. 3, pp. 123-135, 2020 [link].
Donghwan Lee and Niao He , "Target-based temporal difference learning," ICML2019, Long beach, CA, June 11-15, 2019 [link] [online extension].
Donghwan Lee and Niao He, "Stochastic primal-dual Q-learning algorithm for discounted MDPs," ACC2019, Philadelphia, PA, USA, July 10-12, 2019 [link]
Donghwan Lee and Niao He, "Stochastic primal-dual Q-learning," Arxiv [link]
Control
Donghwan Lee, Han-Dong Lim, and Do Wan Kim, "Continuous-time distributed dynamic programming for networked multi-agent Markov decision processes," IEEE ICCA2024, Iceland [link].
Jianghai Hu, Jinglai Shen, Donghwan Lee, "Optimal stabilizing rates of switched linear control systems under arbitrary known switchings," Automatica, vol. 154, 2024 [link]
Donghwan Lee and Do Wan Kim, "Data-driven control design with LMIs and dynamic programming," IEEE Access, vol. 10, 2023 [link].
Donghwan Lee, "Convergence of dynamic programming on the semidefininte cone for discrete-time infinite-horizon LQR," IEEE Transactions on Automatic Control, vol. 67, no. 10, pp. 5661-5668, 2022 [link]
Donghwan Lee, Geir E Dullerud, Jianghai Hu, "Graph Lyapunov function for switching stabilization and distributed computation," Automatica, vol. 116, 2020 [link].
Donghwan Lee and Jianghai Hu, ``Primal-dual Q-learning framework for LQR design,'' IEEE Transactions on Automatic Control, vol. 64, no. 9, pp. 3756-3763, 2019 [link].
Donghwan Lee and Jianghai Hu, "Stabilizability of discrete-time controlled switched linear systems," IEEE Transactions on Automatic Control, vol. 63, no. 10, pp. 3516-3522, 2018 [link].
Jianghai Hu, Jinglai Shen, and Donghwan Lee, Resilient stabilization of switched linear control systems against adversarial switching," IEEE Transactions on Automatic Control, vol. 62, no. 8, pp. 3820-3834, 2017 [link].
Donghwan Lee and Jianghai Hu, "Periodic stabilization of discrete-time switched linear systems," IEEE Transactions on Automatic Control, vol. 62, no. 7, pp. 3382-3394, 2017 [link].
Donghwan Lee and Young Hoon Joo, "A note on sampled-data stabilization of LTI systems with aperiodic sampling," IEEE Transactions on Automatic Control, vol. 60, no. 10, pp. 2746-2751, 2015.
Dong Hwan Lee, Young Hoon Joo, Myung Hwan Tak, "Periodically time-varying memory static output feedback control design for discrete-time LTI systems," Automatica, vol. 52, pp. 47-54, 2015.
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, "Periodically time-varying H infinity memory filter design for discrete-time LTI systems with polytopic uncertainty," IEEE Transactions on Automatic Control, vol. 59, no. 5, pp. 1380-1385, 2014.
Donghwan Lee, "An improved finite frequency approach to robust H infinity filter design for LTI systems with polytopic uncertainties," International Journal of Adaptive Control and Signal Processing, vol. 27, no. 11, pp. 944-956, 2013
Donghwan Lee, Jin Bae Park, Young Hoon Joo, and Kuo Chi Lin, "Lifted versions of robust D-stability and D-stabilization conditions for uncertain polytopic linear systems," IET Control Theory and Applications, vol. 6, no. 1, pp. 24-36, 2012.
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "A less conservative LMI condition for robust D-stability of polynomial matrix polytopes- A projection approach," IEEE Transactions on Automatic Control, vol. 56, no. 4, pp. 868-873, 2011.
Fuzzy Control
Do Wan Kim, Donghwan Lee, "Relaxed conditions for parameterized linear matrix inequality in the form of nested fuzzy summations" 2023 [link]
Moon Hwan Kim, Dong Hwan Lee, Do Wan Kim, "3D Path following control of autonomous underwater vehicles: A fuzzy-model-based approach" 2023
Donghwan Lee, Do Wan Kim, "Harnessing membership function dynamics for stability analysis of T-S fuzzy systems," 2024 [link]
Donghwan Lee, Do Wan Kim, "On the local quadratic stabiltiy of T-S fuzzy systems in the vicinity of the origin," 2023 [link]
Yara Q. Marinho, Dong-Hwan Lee, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, "Local stability analysis and estimation of domains of attraction for discrete-time Takagi-Sugeno fuzzy systems via fuzzy-modeled membership functions" ACC2024 July 10-12, 2024, Toronto.
Do Wan Kim, Donghwan Lee, "Relaxed conditions for parameterized linear matrix inequality in the form of double sum" IEEE Transactions on Fuzzy Systems, 2023 [link]
Donghwan Lee and Jianghai Hu, "Local model predictive control for T-S fuzzy systems," IEEE Transactions on Cybernetics, vol. 47, no. 9, 2017.
Donghwan Lee and Jianghai Hu, "Local stabilization of discrete-Time T-S fuzzy systems with magnitude and energy-bounded disturbances," Information Sciences, vol. 369, no. 10, pp. 304-316, 2016
Donghwan Lee, Young Hoon Joo, and In-Ho Ra, "Local stability and local stabilization of discrete-time T-S fuzzy systems with time-delay," International Journal of Control, Automation, and Systems, vol. 14, no. 1, pp. 29-38, 2016
Donghwan Lee and Young Hoon Joo, "On the generalized local stability and local stabilization conditions for discrete-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Fuzzy Systems, vol. 22, no. 6, pp. 1654-1668, 2014 [link].
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, "Local stability analysis of continuous-time Takagi-Sugeno fuzzy systems: A fuzzy Lyapunov function approach," Information Sciences, vol. 257, no. 1, pp. 163-175, 2014 [link]
Donghwan Lee and Do Wan Kim, "Relaxed LMI conditions for local stability and local stabilization of continuous-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, vol. 44, no. 3, pp. 394-405, 2014 [link].
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, "Linear matrix inequality approach to local stability analysis of discrete-time Takagi-Sugeno fuzzy systems," IET Control Theory and Applications, vol. 7, no. 9, pp. 1309-1318, 2013
Donghwan Lee, "Local stability and stabilization of discrete-time Takagi-Sugeno fuzzy systems using bounded variation rates of the membership functions", 2013 IEEE Symposium on Computational Intelligence in Control and Automation (CICA), [link]
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Further theoretical justification of the k-samples variation approach for discrete-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Fuzzy Systems, vol. 19, no. 3, pp. 594-597, 2011.
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "A new fuzzy Lyapunov function for relaxed stability condition of continuous-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Fuzzy Systems, vol. 19, no. 4, pp. 785-791, 2011.
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "A fuzzy Lyapunov function approach to estimating the domain of attraction for continuous-time Takagi-Sugeno fuzzy systems," Information Sciences, vol. 185, no. 1, pp. 230-248, 2011 [link]
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Further improvement of periodic control approach for relaxed stabilization condition of discrete-time Takagi-Sugeno fuzzy systems," Fuzzy Sets and Systems, vol. 174, no. 1, pp. 50-65, 2011 [link].
Donghwan Lee, Jin Bae Par, and Young Hoon Joo, "Approaches to extended non-quadratic stability and stabilization conditions for discrete-time Takagi–Sugeno fuzzy systems," Automatica, vol. 47, no. 3, pp. 534-538, 2011 [link].
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Improvement on nonquadratic stabilization of discrete-time Takagi-Sugeno fuzzy systems: Multiple-parameterization approach," IEEE Transactions on Fuzzy Systems, vol. 18, no. 2, pp. 425-444, 2010 [link].
Optimization
Donghwan Lee, "Lossless convexification and duality, 2022 [link]
Donghwan Lee and Jianghai Hu, "Sequential parametric convex approximation algorithm for bilinear matrix inequality problem," Optimization Letter, vol. 13, no. 4, pp. 741-759, 2019 [link]
Donghwan Lee and Jianghai Hu, "A sequential parametric convex approximation method for solving bilinear matrix inequalities," CDC2016, December 12-14, 2016, Las Vegas, USA, [link]