Reinforcement Learning Applications in Unmanned Vehicle Control: A Comprehensive Overview
H. Liu, B. Kiumarsi, Y. Kartal, A. T. Koru, H. Modares and F. Lewis, Unmanned Systems, 2023.
Reinforcement Learning With Safety and Stability Guarantees During Exploration For Linear Systems
Z. Marvi and B. Kiumarsi, IEEE Open Journal of Control Systems, 2022.
Designing Safety Certificated for H∞ Control of Unknown Linear Systems
P. Tooranjipour and B. Kiumarsi, IEEE Ccntrol Systems Letters, 2022.
Robust satisficing cooperative control barrier functions for multirobots systems using information-gap theory
Z. Marvi and B. Kiumarsi, International Journal of Robust and Nonlinear Control, 2022.
Barrier-Certified Learning-Enabled Safe Control Design for Systems Operating in Uncertain Environments
Z. Marvi and B. Kiumarsi, IEEE/CAA Journal of Automatica Sinica, 2021.
Fully Heterogeneous Containment Control of a Network of Leader–Follower Systems
M. Mazouchi, F. Tatari, B. Kiumarsi and H. Modares, IEEE Transactions on Automatic Control, 2021.
Model-Free λ-Policy Iteration for Discrete-Time Linear Quadratic Regulation
Y. Yang, B. Kiumarsi, H. Modares and C. Xu, IEEE Transactions on Neural Networks and Learning Systems, 2021
Safe Reinforcement Learning: A Control Barrier Function Optimization Approach
Z. Marvi and B. Kiumarsi. International Journal of Robust and Nonlinear Control, 2021.
A Safety-Certified Policy Iteration Algorithm for Control of Constrained Nonlinear Systems
N. M. Yazdani, R. K. Moghaddam, B. Kiumarsi and H. Modares. IEEE Control Systems Letters, 4(3), 686-691, 2020.
Resilient and Robust Synchronization of Multi-agent Systems Under Attacks on Sensors and Actuators
H. Modares , B. Kiumarsi, F. L. Lewis, F. Ferrese, and A. Davoudi. IEEE Transactions on Cybernetics. 50(3), 1240-1250, 2020.
Optimal Control Using Adaptive Resonance Theory and Q-learning
B. Kiumarsi, B. AlQaudi, H. Modares, F. L. Lewis, D. S. Levine. Neurocomputing, 361, 119-125, 2019.
Optimal Output Regulation of Linear Discrete-Time Systems With Unknown Dynamics Using Reinforcement Learning
Y. Jiang, B. Kiumarsi, J. Fan, T. Chai, J. Li and F. L. Lewis. IEEE Transactions on Cybernetics. 50(7), 3147-3156, 2020.
Optimal and Autonomous Control Using Reinforcement Learning: A Survey
B. Kiumarsi, K. Vamvoudakis, H. Modares, and F. L. Lewis. IEEE Transactions on Neural Networks and Learning Systems. 29(6), 2042-2062, 2018.
Off-Policy Reinforcement Learning: Optimal Operational Control for Two-Time-Scale Industrial Processes
J. Li, B. Kiumarsi, T. Chai, F. L. Lewis, and J. Fan. IEEE Transactions on Cybernetics. 47, 4547-4558, 2017.
Output Synchronization of Heterogeneous Discrete-time Systems: A Model-free Optimal Approach
B. Kiumarsi and F. L. Lewis. Automatica. 84, 86-94, 2017.
H∞ Control of Unknown Linear Discrete-time Systems Using Off-policy Reinforcement Learning
B. Kiumarsi, F. L. Lewis, and Z. P. Jiang. Automatica. 78, 144-152, 2017.
Game Theory-Based Control System Algorithms with Real Time Reinforcement Learning: How to Solve Multiplayer Games Online
K. Vamvoudakis, H. Modares, B. Kiumarsi, and F. L. Lewis. IEEE Control Systems Magazine. 37(1), 33-52, 2017.
Multiple-objective Actor-critic Off-policy Learning for Optimal Control of Discrete-time Systems
Jan Skach, B. Kiumarsi, F. L. Lewis, and Ondrej Straka. IEEE Transaction on Cybernetics. 48(1), 29-40,2016.
H∞ Control of Non-affine Aerial Systems Using Off-policy Reinforcement Learning
B. Kiumarsi, W. Kang, and F. L. Lewis. Unmanned Systems. 4(1), 1-10, 2016.
Data-driven Optimal Control of Operational Indices for a Class of Industrial Processes
X. Lu, B. Kiumarsi, T. Chai, and F. L. Lewis. IET Control Theory and Applications. 10(12), 1348-1358, 2016.
Approximate Dynamic Programming for Optimal Tracking Control of Unknown Linear Systems Using Measured Data
B. Kiumarsi, F. L. Lewis, M.B. Naghibi-Sistani, and A. Karimpour. IEEE Transactions on Cybernetics. 45(12), 2770-2779, 2015.
Adaptive Optimal Control of Nonlinear Discrete Time varying Systems Using Reinforcement Learning
B. Kiumarsi, F. L. Lewis, and D. Levine. Neurocomputing. 156, 157-165, 2015.
Actor-Critic Based Optimal Tracking for Partially Unknown Nonlinear Discrete-time Systems
B. Kiumarsi and F. L. Lewis. IEEE Transactions on Neural Networks and Learning Systems. 26(1), 140-159, 2014.
Reinforcement Q-learning for Optimal Tracking Control of Linear Discrete-time Systems with Unknown Dynamics
B. Kiumarsi, F. L. Lewis, H. Modares, A. Karimpour, and M. B. Naghibi-Sistani. Automatica. 50(4), 1167-1175, 2014.
Employing Adaptive Particle Swarm Optimization Algorithm for Parameter Estimation of an Exciter Machine
A. Darabi, A. Alfi, B. Kiumarsi, and H. Modares. Journal of Dynamic Systems, Measurement, and Control. 134(1), 2012.
Safe Off-policy Reinforcement Learning Using Barrier Functions
Z. Marvi and B. Kiumarsi. American Control Conference (ACC). 2020
Secure Linear Quadratic Regulator Using Sparse Model-Free Reinforcement Learning
B. Kiumarsi and T. Başar. IEEE Conference on Decision and Control (CDC). 2019.
Heterogeneous Formation Control of Multiple Rotorcrafts with Unknown Dynamics using Reinforcement Learning
H. Liu, F. Peng, H. Modares, B. Kiumarsi and F. L. Lewis,. IEEE Conference on Decision and Control (CDC). 2019.
Safety Planning Using Control Barrier Function: A Model Predictive Control Scheme
Z. Marvi and B. Kiumarsi. IEEE Connected and Automated Vehicles Symposium (CAVS). 2019.
Human-in-the-loop Control of Distributed Multi-Agent Systems: A Relative Input-Output Approach
B. Kiumarsi and T. Başar. IEEE Conference on Decision and Control (CDC). 2018.
Distributed Aggregative Games on Graphs in Adversarial Environments
B. Kiumarsi and T. Basar. International Conference on Decision and Game Theory for Security. 2018.
Off-policy Reinforcement Learning for Distributed Output Synchronization of Linear Multi-agent Discrete-time Systems
B. Kiumarsi and F. L. Lewis. IEEE Symposium Series on Computational Intelligence. 2017.
H∞ Optimal Control of Unknown Linear Discrete-time Systems: An Off-policy Reinforcement Learning Approach
B. Kiumarsi, H. Modares, F. L. Lewis, and Z. P. Jiang. 7th IEEE Conference on Cybernetics and Intelligent Systems. 2015.
Reinforcement Learning for Optimal Tracking and Regulation: An Unified Framework
F. L. Lewis, H. Modares, and B. Kiumarsi. American Control Conference (ACC). 2015.
Autonomy and Machine Intelligence in Complex Systems: A Tutorial
K. G. Vamvoudakis, P. J. Antsaklis, W. E. Dixon, J. P. Hespanha, F. L. Lewis, H. Modares, and B. Kiumarsi. American Control Conference (ACC). 2015.
Optimal Tracking Control for Linear Discrete-time Systems Using Reinforcement Learning
B. Kiumarsi, F. L. Lewis, M.B. Naghibi-Sistani, and A. Karimpour. IEEE Conference on Decision and Control (CDC). 2013.