[*: corresponding author / _ : advising student]
Yeeun Im, Narim Jeong, and Donghwan Lee*, "Simple safe Q-learning with safe exploration," 2025
Hyukjun Yang and Donghwan Lee*, "Asynchronous value iteration with weighted p-norm for Markov decision process," 2025
Hyunjun Na, Donghwan Lee*, "Relaxed gradient temporal difference learning," 2025
Han-Dong Lim, Hyunjun Na, Taeho Lee, Donghwan Lee*, "Survey on convergence analysis of TD-learning and Q-learning"
Taeho Lee, Donghwan Lee*, "Robust deterministic policy gradient for disturbance attenuation," 2025
Taeho Lee, Donghwan Lee*, "Robust deterministic policy gradient for disturbance attenuation and its application to quadrotor control," submitted [link]
Narim Jeong, Donghwan Lee* and Niao He, "Stochastic primal-dual Q-learning," [link]
Bum Geun Park, Taeho Lee, Donghwan Lee*, "Deep Q-learning with gradient target tracking," [link]
Bum Geun Park, Donghwan Lee*, Adaptive policy backbone via shared network, 2025 [link]
Jongeui Park, Young-Chul Sung, Donghwan Lee, "Offline reinforcement learning through trajectory clustering and lower bound penalisation" submitted 2025
Min-Gyu Park, Donghwan Lee*, "Improving visual generalization in model-based reinforcement learning," submitted 2025
Bum Geun Park, Donghwan Lee*, Explore beyond the boundary using entropic information," submitted,2024
Hyunjun Na, Donghwan Lee*, "Finite-time analysis of simultaneous double Q-learning," submitted,2024 [link]
Han-Dong Lim, Donghwan Lee*, "Understanding the theoretical properties of projected Bellman equation, linear Q-learning, and approximate value iteration," 2025 [link]
Han-Dong Lim, Donghwan Lee*, "Analysis of off-policy n-step TD-learning with linear function approximation," submitted 2024 [link]
Han-Dong Lim, Hyeann Lee, Donghwan Lee*, "Finite-time error analysis of online model-based Q-learning with a relaxed sampling model" submitted,2024 [link]
Yara Q. Marinho, Donghwan Lee, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, "Regional output-feedback PDC control for discrete-time T-S fuzzy systems via fuzzy-modeled membership functions," submitted, 2024
Yara Q. Marinho, Donghwan Lee, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, "Local output-feedback PDC control for T-S fuzzy systems through polynomially membership and state dependent Lyapunov functions," submitted, 2024
Kanwal Naveed, Wajahat Hussain, Irfan Hussain, Donghwan Lee, Muhammad Latif Anjum , "Thinking too much: relaxing the reward for improving reinforcement learning based introspective SLAM," submitted, 2024
Jinwoo Kim, Kyounghwan An, Donghwan Lee, "VL-iRoSA: Vision-Language Instruction-Based Road Semantic Awareness for Autonomous Driving Guidance in Construction Zones"
Donghwan Lee, Hyukjun Yang, Bum Geun Park, "Analysis of approximate linear programming solution to Markov decision problem with log barrier function," 2025 [link]
Donghwan Lee, "Unified ODE analysis of smooth Q-learning algorithms," submitted,2024 [link]
Donghwan Lee and Do Wan Kim, "Finite-time analysis of temporal difference learning: discrete-time linear system perspective," submitted, 2022 [link]
Jong-Chan Park, Min-Gyu Park, Donghwan Lee*, "Pretraining for offline reinforcement learning with features of transition dynamics," NeurIPS2025 [link] (accepted)
Jinwoo Kim, Hayeon O, Yongmin Oh, Kyounghwan An, Donghwan Lee, "SADWA: fine-grained weather awareness with vision-language models for seamless autonomous driving in real time," ICCV2025 Workshop (best paper award).
Narim Jeong, Donghwan Lee*, "Finite-time analysis of minimax Q-learning," RLC2025, RLJ2025 [link]
Han-Dong Lim, Donghwan Lee*, "A finite-time analysis of distributed Q-learning" RLC2025, RLJ2025 [link]
Heechan Chung, Yeeun Im, Jongchan Park, Taeho Lee, Tae-Young Kim, Hyungjun Kim, and Donghwan Lee*, "Power consumption optimization of GPU server with offline reinforcement learning," IEEE Access 2025 [link]
Han-Dong Lim, Donghwan Lee*, "A primal-dual perspective for distributed TD-learning," IJCAI2025 [link]
Kanwal Naveed, Wajahat Hussain, Irfan Hussain, Donghwan Lee, Muhammad Latif Anjum , "Help me through: imitation learning based active view planning to avoid SLAM tracking failures," IEEE Transactions on Robotics, 2025 [link]
Yara Q. Marinho, Donghwan Lee*, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, " Harnessing membership function dynamics for stability analysis of discrete-time T-S fuzzy systems," IEEE Control Systems Letters, 2025 [link]
Yara Q. Marinho, Donghwan Lee*, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, " Harnessing membership function dynamics for stability analysis of discrete-time T-S fuzzy systems," IEEE CDC 2025
Yara Q. Marinho, Donghwan Lee*, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, " Harnessing membership function dynamics for output-feedback stabilization of T-S fuzzy systems," IEEE International Conference on Fuzzy Systems, 2025 [link]
Narim Jeong, Donghwan Lee,* "Unified finite-time error analysis of soft Q-learning," Neurocomputing, 2025 [link]
Moon Hwan Kim, Do Wan Kim, Donghwan Lee, "Three-dimensional path following control of nonlinear autonomous underwater vehicles with actuator saturation", Ocean Engineering, 2025 [link]
Do Wan Kim, Donghwan Lee*, "Relaxed conditions for parameterized linear matrix inequality in the form of nested fuzzy summations", Applied Mathematics and Computation, vol. 487, 2025 [link]
Han-Dong Lim, Donghwan Lee*, "Regularized Q-learning," NeurIPS2024 [link]
Han-Dong Lim, Donghwan Lee*, "Finite-time analysis of asynchronous Q-learning under diminishing step-size from control-theoretic view" IEEE Access 2024 [link]
Han-Dong Lim, Donghwan Lee*, "Finite-time analysis of temporal difference learning with experience replay," Transactions on Machine Learning Research (TMLR), 2024 [link]
Hyeann Lee, Donghwan Lee*, "Suppressing overestimation in Q-learning through adversarial behaviors," Annual Allerton Conference on Communication, Control, and Computing, 2024 [link]
Narim Jeong, Donghwan Lee*, "Finite-time error analysis of soft Q-learning: switching system approach," IEEE CDC2024 [link]
Donghwan Lee, "Analysis of off-policy multi-step TD-learning with linear function approximation," IEEE CDC2024 [link]
Donghwan Lee, "Final iteration convergence bound of Q-Learning: switching system approach," IEEE Transactions on Automatic Control, vol. 69, no. 7, 2024 [link]
Donghwan Lee, "Lossless convexification and duality," Journal of the Franklin Institute, vol. 361, no. 14, 2024 [link].
Donghwan Lee, Han-Dong Lim, and Do Wan Kim, "Continuous-time distributed dynamic programming for networked multi-agent Markov decision processes," IEEE ICCA2024, Iceland [link].
Donghwan Lee, Do Wan Kim, "On the local quadratic stability of T-S fuzzy systems in the vicinity of the origin," Fuzzy Sets and Systems, vol. 497, 2024 [link]
Donghwan Lee, Do Wan Kim, "Harnessing membership function dynamics for stability analysis of T-S fuzzy systems" Information Science, vol. 681, 2024 [link]
Jianghai Hu, Jinglai Shen, Donghwan Lee, "Optimal stabilizing rates of switched linear control systems under arbitrary known switchings," Automatica, vol. 159, 2024 [link]
Kanwal Naveed, Wajahat Hussain, Irfan Hussain, Donghwan Lee, Muhammad Latif Anjum, "Sequential SLAM: avoiding tracking failures in visual SLAM using recurrent reinforcement learning," IROS2024, October 14-18, Abu Dhabi, UAE, 2024.
Jinwoo Kim, Kyounghwan An, Donghwan Lee, RoSA Dataset: Road construct zone Segmentation for Autonomous Driving, ECCV 2024 W-CODA Workshop 2024 [link]
Yara Q. Marinho, Donghwan Lee, Ricardo C. L. F. Oliveira, Pedro L. D. Peres, "Local stability analysis and estimation of domains of attraction for discrete-time Takagi-Sugeno fuzzy systems via fuzzy-modeled membership functions," ACC2024 , July 10-12, 2024, Toronto, Canada [link]
Mingyu Park, Donghwan Lee*, "A combination of dueling architecture with alternative smooth max operator in reinforcement learning," KCC2024, South Korea, 2024.
Heechan Chung, Taeho Lee, Jongchan Park, Yeeun Lee, Tae-Young Kim, Hyungjun Kim, Donghwan Lee*, "Optimizing power consumption of GPU server by reinforcement learning algorithms," KCC2024, SouthKorea, 2024.
Han-Dong Lim, Donghwan Lee*, "Backstepping temporal-difference learning," ICLR2023, Kigali, Rwanda, May 1-5, 2023 [link]
Donghwan Lee, Jianghai Hu, and Niao He, “A discrete-time switching system analysis of Q-learning,” SIAM Journal on Control and Optimization, vol. 61, no. 3, 2023 [link] [online extension]
Donghwan Lee, Han-Dong Lim, Jihoon Park, and Okyong Choi, "New versions of gradient temporal-difference learning," IEEE Transactions on Automatic Control, vol. 68, no. 8, 2023 [link] [online extension]
Donghwan Lee and Do Wan Kim, "Data-driven control design with LMIs and dynamic programming," IEEE Access, vol. 11, 2023 [link].
Donghwan Lee, "Multi-objective LQG design with primal-dual method," MDPI mathematics, vol. 11, no. 8, 2023.
Donghwan Lee, "On some geometric behaior of value iteration on the orthant: switching system perspective," CDC2023, Dec. 13-15, 2023, Singapore [link] [online version with corrections]
Do Wan Kim, Donghwan Lee*, "Relaxed conditions for parameterized linear matrix inequality in the form of double sum" IEEE Transactions on Fuzzy Systems, vol. 32, no. 3, 2023 [link]
Donghwan Lee, "Convergence of dynamic programming on the semidefininte cone for discrete-time infinite-horizon LQR," IEEE Transactions on Automatic Control, vol. 67, no. 10, 2022 [link]
Donghwan Lee, Do Wan Kim, Jianghai Hu, "Distributed off-policy temporal difference learning using primal-dual method," IEEE Access, vol. 10, 2022 [link].
Donghwan Lee and Do Wan Kim "Formulations for data-driven control design and reinforcement learning," ICCA2022, June 27-30, 2022, Naples, Italy.
Kanwal Naveed, Muhammad Latif Anjum, Wajahat Hussain, Donghwan Lee, "Deep introspective SLAM: deep reinforcement learning based approach to avoid tracking failure in visual SLAM," Autonomous Robots, vol. 46, 2022 [link].
Junmo Cho, Donghwan Lee, Young-Gyu Yoon, ``Inducing functions through reinforcement learning without task specification,'' NeurIPS2023 workshop, 2022 [link]
Donghwan Lee and Niao He, ``A unified switching system perspective and convergence analysis of Q-learning algorithms,'' NeurIPS2020 [link] [Online extension].
Donghwan Lee and Niao He, ``Periodic Q-learning,'' L4DC2020, Berkeley, CA, June, 2020 [link].
Donghwan Lee, Niao He, Kamal Parameswaran, and Volkan Cevher, "Optimization for reinforcement learning: from single agent to cooperative agents," IEEE Signal Processing Magazine, vol. 37, no. 3, 2020 [link].
Donghwan Lee, Geir E Dullerud, Jianghai Hu, "Graph Lyapunov function for switching stabilization and distributed computation," Automatica, vol. 116, 2020 [link].
Donghwan Lee and Niao He , "Target-based temporal difference learning," ICML2019, Long beach, CA, June 11-15, 2019 [link] [online extension].
Donghwan Lee and Niao He, "Stochastic primal-dual Q-learning algorithm for discounted MDPs," ACC2019, Philadelphia, PA, USA, July 10-12, 2019 [link]
Donghwan Lee and Jianghai Hu, ``Primal-dual Q-learning framework for LQR design,'' IEEE Transactions on Automatic Control, vol. 64, no. 9, 2019 [link].
Donghwan Lee and Jianghai Hu, "Sequential parametric convex approximation algorithm for bilinear matrix inequality problem," Optimization Letter, vol. 13, no. 4, pp. 741-759, 2019
Donghwan Lee, Niao He, and Jianghai Hu, "Dynamic programming for POMDP with jointly discrete and continuous state-spaces," IEEE American Control Conference (IEEE ACC2019), July 10-12, Philadelphia, PA, USA.
Hyung-Jin Yoon, Huaiyu Chen, Kehan Long, Heling Zhang, Donghwan Lee, Aditya Gahlawat, and Naira Hovakimyan, "Learning to communicate: A machine learning framework for heterogeneous multi-agent robotic systems," in Proc. AIAA Guidance, Navigation, and Control Conference, January 7-11, 2019, San Diago, CA, USA.
Hyungjin Yoon, Donghwan Lee, and Naira Hovakimyan, "Hidden Markov model estimation-based Q-learning for partially observable Markov decision process," IEEE American Control Conference (IEEE ACC2019), July 10-12, Philadelphia, PA, USA.
Donghwan Lee and Jianghai Hu, "Stabilizability of discrete-time controlled switched linear systems," IEEE Transactions on Automatic Control, 2018 [link].
Jianghai Hu, Jinglai Shen, Donghwan Lee, "Stabilization of switched linear systems using continuous control input against known adversarial switching," in Proc. 14th IEEE International Conference on Control and Automation, June 12-15, Anchorage, Alaska, USA, 2018
Donghwan Lee, Seungjae Lee, Panagiota Karava, and Jianghai Hu, "Simulation-based policy gradient and its building control application," in Proc. IEEE American Control Conference (IEEE ACC2018), June 27-29, Milwaukee, WI, USA.
Donghwan Lee, Seungjae Lee, Panagiota Karava, and Jianghai Hu, "Approximate dynamic programming for building control problems with occupant interactions," in Proc. IEEE American Control Conference (IEEE ACC2018), June 27-29, Milwaukee, WI, USA.
Donghwan Lee, Hyungjin Yoon, and Naira Hovakimyan, "Primal-dual algorithm for distributed reinforcement learning: distributed GTD," in Proc. IEEE Conference on Decision and Control 2018 (IEEE CDC2018), September 17-19, 2018, Miami beach, FL, USA
Jianghai Hu, Jinglai Shen, and Donghwan Lee, Resilient stabilization of switched linear control systems against adversarial switching," IEEE Transactions on Automatic Control, 2017 [link].
Donghwan Lee and Jianghai Hu, "Periodic stabilization of discrete-time switched linear systems," IEEE Transactions on Automatic Control, 2017 [link].
Donghwan Lee and Jianghai Hu, "Local model predictive control for T-S fuzzy systems," IEEE Transactions on Cybernetics, 2017.
Donghwan Lee and Jianghai Hu, "On the graph control Lyapunov function for stabilization of discrete-time switched linear systems," in Proc. IEEE American Control Conference (IEEE ACC2017), May 24-26, Seattle, WA, USA.
Donghwan Lee and Jianghai Hu, "Periodic stabilization of discrete-time controlled switched linear systems," in Proc. IEEE American Control Conference (IEEE ACC2017), May 24-26, Seattle, WA, USA
Donghwan Lee and Jianghai Hu, "A sequential parametric convex approximation method for solving BMIs," in Proc. 55th IEEE Conference on Decision and Control 2016 (IEEE CDC2016), Las Vegas, USA, December 12-14, 2016.
Donghwan Lee and Jianghai Hu, "Graph control Lyapunov function for stabilization of discrete-time switched linear systems," in Proc. IEEE American Control Conference (IEEE ACC2016), Boston, USA.
Donghwan Lee and Jianghai Hu, "Periodic stabilization of discrete-time switched linear systems revisited," in Proc. IEEE American Control Conference (IEEE ACC2016), Boston, USA.
Donghwan Lee and Jianghai Hu, "Local state-feedback stabilization of nonlinear fuzzy systems with errors in the measured state," in Proc. IEEE World Congress on Computational Intelligence (IEEE WCCI2016), Vancouver, Canada, July 2016.
Donghwan Lee and Jianghai Hu, "Local stabilization of discrete-Time T-S fuzzy systems with magnitude- and energy-bounded disturbances," Information Sciences, vol. 369, no. 10, pp. 304-316, 2016
Donghwan Lee, Young Hoon Joo, and In-Ho Ra, "Local stability and local stabilization of discrete-time T-S fuzzy systems with time-delay," International Journal of Control, Automation, and Systems, vol. 14, no. 1, pp. 29-38, 2016
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "FIR-Type state-feedback control law for discrete-time LTI systems with polytopic uncertainties," International Journal of Control, Automation, and Systems, vol. 13, no. 5, pp. 1047-1056, 2016
Jianghai Hu, Donghwan Lee, and Jinglai Shen, "Stabilizing switched linear systems under adversarial switching,"in Proc. IEEE Conference on Decision and Control 2015 (IEEE CDC2015), Osaka, Japan, December 15-18 2015
Donghwan Lee and Jianghai Hu, "Periodic stabilization of discrete-time switched linear systems," in Proc. IEEE Conference on Decision and Control 2015 (IEEE CDC2015), Osaka, Japan, December 15-18 2015.
Donghwan Lee and Young Hoon Joo, "A note on sampled-data stabilization of LTI systems with aperiodic sampling," IEEE Transactions on Automatic Control, 2015 [link].
Dong Hwan Lee, Young Hoon Joo, Myung Hwan Tak, "Periodically time-varying memory static output feedback control design for discrete-time LTI systems," Automatica, 2015 [link].
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Robust discretization of LTI systems with polytopic uncertainties and aperiodic sampling," Journal of Electrical Engineering and Technology, vol. 10, no. 3, pp. 1255-1263, 2015
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, “A convex optimization approach to adaptive stabilization of discrete-time LTI systems with polytopic uncertainties,” International Journal of Adaptive Control and Signal Processing, vol. 29, no. 9, pp. 1116-1134, 2015.
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, "Periodically time-varying H infinity memory filter design for discrete-time LTI systems with polytopic uncertainty," IEEE Transactions on Automatic Control, 2014 [link].
Donghwan Lee and Young Hoon Joo, "On the generalized local stability and local stabilization conditions for discrete-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Fuzzy Systems, 2014 [link].
Donghwan Lee and Do Wan Kim, "Relaxed LMI conditions for local stability and local stabilization of continuous-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 2014 [link].
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, "An asymptotically exact LMI solution to the robust discretization of LTI systems with polytopic uncertainties and its application to sampled-data control," International Journal of Systems Science, vol. 46, no. 15, pp. 2702-2714, 2014
Donghwan Lee, Young Hoon Joo, and Myung Hwan Tak, “Local stability analysis of continuous-time Takagi–Sugeno fuzzy systems: A fuzzy Lyapunov function approach,” Information Sciences, vol. 257, no. 1, pp. 163-175, 2014.
Donghwan Lee and Young Hoon Joo, “Extended robust H2 and H∞ filter design for discrete time-invariant linear systems with polytopic uncertainty,” Circuits, Systems, and Signal Processing, vol. 33, no. 2, pp. 393-419, 2014.
Donghwan Lee, "An improved finite frequency approach to robust H infinity filter design for LTI systems with polytopic uncertainties," International Journal of Adaptive Control and Signal Processing, 2013 [link]
Donghwan Lee, "Local stability analysis of continuous-time Takagi-Sugeno fuzzy systems: An LMI approach," in Proc. IEEE American Control Conference (IEEE ACC2013), Washington, DC, June 2013.
Donghwan Lee, "Local stability and stabilization of discrete-time Takagi-Sugeno fuzzy systems using bounded variation rates of the membership functions," in Proc. 2013 IEEE Symposium Series on Computational Intelligence (IEEE SSCI 2013), Singapore, April 2013.
Donghwan Lee, Jin Bae Park, Young Hoon Joo, and Kuo Chi Lin, "Lifted versions of robust D-stability and D-stabilization conditions for uncertain polytopic linear systems," IET Control Theory and Applications, 2012.
Donghwan Lee, "Domain of attraction analysis for continuous-time Takagi-Sugeno fuzzy systems: An LMI approach," in Proc. IEEE Conference on Decision and Control 2012 (IEEE CDC2012), Grand Wailea, Maui, Hawaii, December 10-13 2012.
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "A less conservative LMI condition for robust D-stability of polynomial matrix polytopes- A projection approach," IEEE Transactions on Automatic Control, 2011 [link]
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Further theoretical justification of the k-samples variation approach for discrete-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Fuzzy Systems, 2011.
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "A new fuzzy Lyapunov function for relaxed stability condition of continuous-time Takagi-Sugeno fuzzy systems," IEEE Transactions on Fuzzy Systems,2011.
Donghwan Lee, Jin Bae Par, and Young Hoon Joo, "Approaches to extended non-quadratic stability and stabilization conditions for discrete-time Takagi–Sugeno fuzzy systems," Automatica, 2011 [link].
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "A fuzzy Lyapunov function approach to estimating the domain of attraction for continuous-time Takagi-Sugeno fuzzy systems," Information Sciences, vol. 185, no. 1, pp. 230-248, 2011
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Fundamental connections among the stability conditions using higher-order time-derivatives of Lyapunov functions for the case of linear time-invariant systems," Systems and Control Letters, vol. 60, no. 9, pp. 778-785, 2011
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Further improvement of periodic control approach for relaxed stabilization condition of discrete-time Takagi-Sugeno fuzzy systems," Fuzzy Sets and Systems, vol. 174, no. 1, pp. 50-65, 2011
Donghwan Lee, Jin Bae Park, and Young Hoon Joo, "Improvement on nonquadratic stabilization of discrete-time Takagi-Sugeno fuzzy systems: Multiple-parameterization approach," IEEE Transactions on Fuzzy Systems, 2010 [link].
Donghwan Lee, Jin Bae Park, Young Hoon Joo, Kuo Chi Lin, and Chan Ho Ham, "Robust H infinity control for uncertain nonlinear active magnetic bearing systems via Takagi-Sugeno fuzzy models," International Journal of Control, Automation, and Systems, vol. 8, no. 3, pp. 636-646, 2010
Donghwan Lee, Jin Bae Park, Young Hoon Joo, and Hyun Suk Jeong, "A less conservative LMI condition for stability analysis of continuous-time Takagi-Sugeno fuzzy systems via a new fuzzy Lyapunov function," in Proc. 2010 IEEE World Congress on Computational Intelligence (IEEE WCCI2010), Barcelona, Spain, Jul. 2010, pp. 248-253.
Donghwan Lee, Jin Bae Park, Young Hoon Joo, and Hyun Soon Moon, "Further studies on stabilization conditions for discrete-time Takagi{Sugeno fuzzy systems," in Proc. 2009 IEEE International Conference on Fuzzy Systems (IEEE FUZZ2009), ICC Jeju, Jeju Island, Korea, Aug. 2009, pp. 831-835.