Speakers

Samuel Coogan

Talk title: Efficient Interaction-Aware Interval Analysis of Neural Network Feedback Loops

Talk abstract: In this talk, we show how efficient reachability methods enable safety assurances for learning-enabled systems. We focus on interconnected and/or high dimensional robotic systems and we leverage reachability techniques enabled by mixed monotone systems theory to efficiently compute interval-valued reachable sets. Mixed monotonicity decomposes a dynamical system's vector field into cooperative and competitive elements, resulting in a larger dimensional monotone system for which powerful results from monotone systems theory are applicable. Notably, these methods offer two key properties: they enable reachable set over-approximations that can be computed very fast for, e.g., inclusion at runtime in feedback controllers, and they scale to high dimensional systems such as neural networks. We demonstrate how both of these appealing features enable safety assurances mechanisms with provable guarantees for learning-enabled control systems.  

Bio: Sam Coogan received the B.S. degree in Electrical Engineering from Georgia Tech and the M.S. and Ph.D. degrees in Electrical Engineering from the University of California, Berkeley. In 2015, he was a postdoctoral research engineer at Sensys Networks, Inc., and in 2012 he spent time at NASA's Jet Propulsion Lab. Before joining Georgia Tech in 2017, he was an assistant professor in the Electrical Engineering department at UCLA from 2015–2017. His awards and recognitions include the 2020 Donald P Eckman Award from the American Automatic Control Council recognizing "an outstanding young engineer in the field of automatic control", a Young Investigator Award from the Air Force Office of Scientific Research in 2019, a CAREER Award from the National Science Foundation in 2018, and the Outstanding paper award for the IEEE Transactions on Control of Network Systems in 2017. 

Georgia Tech, 

USA

Jana Tumova

KTH Royal Institute of Technology, Sweden

Talk title: From provably safe to risk-aware robot planning and control  

Talk abstract: How can we ensure that autonomous robots work as expected and how can we even specify what it means to work as expected? Formal methods have shown to be useful in addressing these questions; temporal logics provide rich, rigorous, yet user-friendly specification formalism and formal synthesis offers a way to automatically generate a plan or a controller that provably satisfies the specification — under certain assumptions. However, these assumptions (e.g., on having perfect knowledge of the robot’s state) may be hard to achieve when moving into uncontrolled environments, and relaxing them may (e.g., by considering the worst-case scenarios) may leave us with the answer that provable, “perfect" safety is not achievable. In this talk, we focus on moving from provably safe to minimum-violation to risk-aware formal methods-based planning and control. We will discuss the use of temporal logics (LTL and STL) and their quantitative semantics in order to measure to what exten a robots meets a desired task; and show formal methods-based techniques that maximize a specification satisfaction.  

Bio: Jana Tumova is an associate professor at the School of Electrical Engineering and Computer Science at KTH Royal Institute of Technology. She received PhD in computer science from Masaryk University and was awarded ACCESS postdoctoral fellowship at KTH in 2013. She was also a visiting researcher at MIT, Boston University, and Singapore-MIT Alliance for Research and Technology. Her research interests include formal methods applied in decision making, motion planning, and control of autonomous systems. Among other projects, she is a recipient of a Swedish Research Council Starting Grant to explore compositional planning for multi-agent systems under temporal logic goals and a WASP Expeditions project focusing on design of correct-by-design and socially acceptable autonomous systems. She was selected to give an Early Career Spotlight talk at Robotics: Science and Systems 2021. 


Yasser Shoukry

Talk title: Provably-Correct Neurosymbolic Controllers for Autonomous Cyber-Physical Systems 

Talk abstract: While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles, and goals) that were not considered during the design or the training of these agents. In this spirit, we consider the problem of training a provably safe Neural Network (NN) controller for uncertain nonlinear dynamical systems that can generalize to new tasks that were not present in the training data while preserving strong safety and correctness guarantees. I will present two complementary neurosymbolic approaches. In the first approach, I will show how to use ideas from symbolic control to provide guarantees on the training of NN controllers. In the second approach, I will show how to use NN to guide the design of symbolic controllers. I will discuss the theoretical guarantees governing the correctness and optimality of these neurosymbolic controllers and show experimental validation of our approach.

Bio: Yasser Shoukry is an Assistant Professor in the Department of Electrical Engineering and Computer Science at the University of California, Irvine, where he leads the Resilient Cyber-Physical Systems Lab. Before joining UCI, he spent two years as an assistant professor at the University of Maryland, College Park. He received his Ph.D. in Electrical Engineering from the University of California, Los Angeles, in 2015. Between September 2015 and July 2017, Yasser was a joint postdoctoral researcher at UC Berkeley, UCLA, and UPenn. His current research focuses on designing and implementing resilient, AI-enabled, cyber-physical systems and IoT. His work in this domain was recognized by the Early Career Award from the IEEE Technical Committee on Cyber-Physical Systems in 2021, the NSF CAREER Award in 2019, the Best Demo Award from the International Conference on Information Processing in Sensor Networks (IPSN) in 2017, the Best Paper Award from the International Conference on Cyber-Physical Systems (ICCPS) in 2016, and the Distinguished Dissertation Award from UCLA EE department in 2016. In 2015, he led the UCLA/Caltech/CMU team to win the NSF Early Career Investigators (NSF-ECI) research challenge. His team represented the NSF- ECI in the NIST Global Cities Technology Challenge, an initiative designed to advance the deployment of Internet of Things (IoT) technologies within a smart city. He is also the recipient of the 2019 George Corcoran Memorial Award from the University of Maryland for his contributions to teaching and educational leadership in the field of CPS and IoT.

 

University of California,
USA

Kai-Chieh Hsu

Princeton University,
USA 

Talk title: Role of Safety: from safety-critical control to safety-informed motion forecasting 

Talk abstract: The rapid advancement of machine learning and computation tools has brought promises of deploying fully autonomous robots beyond controlled factory floors. Ensuring their safe operation across various environments, particularly in uncertain, unseen, and unforgiving scenarios, is of paramount importance. In this talk, I will discuss the overarching concept of a safety filter: an automatic process that monitors the operation of an autonomous system at runtime and intervenes, when deemed necessary, by modifying its originally intended control to prevent a potential catastrophic failure. We will see that the guarantees provided by a safety filter depend significantly on its underpinning formal machinery. In the second part of the talk, we switch gears to look at the development of safety-informed human-centered interactive robot autonomy, specifically in the context of autonomous driving. I will show how the safety concepts discussed in the first half of the talk can be used to quantify the responsibility of road users in actual and counterfactual safety-critical events. I will demonstrate that the responsibility metrics can serve as an interpretable layer for an underlying trajectory predictor, which can integrate into the software stack for responsibility-aware autonomy.

Bio:  Kai-Chieh Hsu is a 5th-year Ph.D. candidate in electrical and computer engineering at Princeton University. He is fortunate to work with Prof. Jaime Fernández Fisac at Safe Robotics Lab. His research interests broadly lie in safe learning, safe multiagent planning, and prediction-planning integration. He obtained his B.S. in electrical engineering from National Taiwan University in 2019, where he worked on digital circuit design for healthcare and direction-of-arrival estimation.

Necmiye Ozay

Talk title: Learning temporal logic constraints from suboptimal demonstrations 

Talk abstract: In this talk, I will present a method for learning multi-stage tasks from demonstrations by learning the logical structure and atomic propositions of a consistent linear temporal logic (LTL) formula. The learner is given successful but potentially suboptimal demonstrations, where the demonstrator is optimizing a cost function while satisfying the LTL formula. Our algorithm uses the Karush-Kuhn-Tucker (KKT) optimality conditions of the demonstrations together with a counterexample-guided falsification strategy to learn the atomic proposition parameters and logical structure of the LTL formula, respectively. We provide theoretical guarantees on the conservativeness of the recovered atomic proposition sets, as well as completeness (in the limit) in the search for finding an LTL formula consistent with the demonstrations. We will illustrate the method both with simulated and hardware experiments.

Bio: Necmiye Ozay (Senior Member, IEEE) received the B.S. degree in electrical engineering from Bogazici University, Istanbul, Turkey, in 2004, the M.S. degree in electrical engineering from Pennsylvania State University, University Park, PA, USA, in 2006 and the Ph.D. degree in electrical engineering from Northeastern University, Boston, MA, USA, in 2010. She was a Postdoctoral Scholar with the California Institute of Technology, Pasadena, CA, USA, between 2010 and 2013. She joined the University of Michigan, Ann Arbor, MI, USA, in 2013, where she is currently an Associate Professor of electrical engineering and computer science. She is also a Member of the Michigan Robotics Institute. Her research interests include hybrid dynamical systems, control, optimization and formal methods with applications in cyber-physical systems, system identification, verification and validation, autonomy, and dynamic data analysis. She was the recipient of the 1938E Award and a Henry Russel Award from the University of Michigan for her contributions to teaching and research, and five young investigator awards, including NSF CAREER, and the 2021 Antonio Ruberti Young Researcher Prize from the IEEE Control Systems Society for her fundamental contributions to the control and identification of hybrid and cyber-physical systems. Her papers have received several awards. 

University of Michigan, USA

Sushant Veer

NVIDIA,
USA

Talk title: Traffic Law Abiding Autonomous Vehicles

Talk abstract:  Injecting traffic-law awareness in autonomous vehicle (AV) motion planners is crucial for ensuring their safe operation. A significant obstacle to achieving this is the complex nature of the traffic law which permits traffic-rule violation under certain exceptional situations. The sheer abundance of these exceptions makes a comprehensive classficiation and enumeration infeasible. In this talk, I will present an approach to express the traffic law in the form of a signal temporal logic (STL) rule hierarchy. I will delve into how this hierarchical representation can be effectively utilized for motion planning and elaborate on integrating these rule hierarchies with learning-based trajectory predictors.

Bio: Sushant Veer is a Research Scientist with the Autonomous Vehicle Research Group at NVIDIA Research. Broadly, his research interests lie in ensuring the safety of complex autonomous robotic systems. He is currently interested in improving the safety of autonomous vehicles by equipping them with the ability to detect and safely address edge cases that lie beyond the operational design domain. He was a Postdoctoral Research Associate in the Mechanical and Aerospace Engineering Department at Princeton University and received his Ph.D. in Mechanical Engineering from the University of Delaware in 2018 and a B.Tech. in Mechanical Engineering from the Indian Institute of Technology, Madras in 2013. In the past, He has worked on providing performance guarantees for learning-based motion planners, safe planning and control of dynamic-legged robots, and the development of assistive biomechanical devices.

Jen Jen Chung

Talk title: Fun with predicates: Discovering the rules of the road and the effect of robot actions 

Talk abstract: TBD

Bio: Jen Jen Chung (Member, IEEE) received the B.E. degree in aeronautical (space) engineering from the University of Sydney, Camperdown, NSW, Australia, in 2010, and the Ph.D. degree in information-based exploration–exploitation strategies for autonomous soaring platforms from the Australian Centre for Field Robotics, University of Sydney in 2014. She is currently an Associate Professor of Mechatronics with the School of Information Technology and Electrical Engineering, University of Queensland, Brisbane, QLD, Australia. From 2018 to 2022, she was a Senior Researcher with the Autonomous Systems Lab, ETH Zürich, Zürich, Switzerland. From 2014 to 2017, she was a Postdoctoral Scholar with Oregon State University, Corvallis, OR, USA, where she researched multiagent learning methods. Her current research interests include perception, planning, and learning for robotic mobile manipulation, algorithms for robot navigation through human crowds, informative path planning, and adaptive sampling.

 

The University of Queensland, Australia

Angela Schoellig

MIRMI, Technical University of Munich. Germany

Talk title: Safe Learning in Robotics: From Learning-based Control to Safe Reinforcement Learning

Talk abstract: Advancements in machine learning techniques have presented new opportunities for robotics, but applying these methods to real-world robotics applications remains challenging. Both the controls and the reinforcement learning communities have been addressing the challenge of safety in robot learning. Their efforts have been summarized in our recent review paper, “Safe Learning in Robotics: From Learning-based Control to Safe Reinforcement Learning.” In this talk, I will present the key findings of our review paper, highlight my team’s research in this context, and show experimental demonstrations of safe learning algorithms on flying robots, ground vehicles, and mobile manipulators. I will conclude by highlighting the many open questions in this field and hope to convince you to help solve these challenges. Finally, I will introduce the open-source simulation environment “safe-control-gym” developed by my team with the goal of facilitating the development of safe learning algorithms and accelerating progress in this field.

Bio: Angela Schoellig is an Alexander von Humboldt Professor for Robotics and Artificial Intelligence at the Technical University of Munich. She is also an Associate Professor at the University of Toronto Institute for Aerospace Studies and a Faculty Member of the Vector Institute in Toronto. Angela conducts research at the intersection of robotics, controls, and machine learning. Her goal is to enhance the performance, safety, and autonomy of robots by enabling them to learn from past experiments and from each other. In Canada, she has held a Canada Research Chair (Tier 2) in Machine Learning for Robotics and Control and a Canada CIFAR Chair in Artificial Intelligence, and has been a principal investigator of the NSERC Canadian Robotics Network. She is a recipient of the Robotics: Science and Systems Early Career Spotlight Award (2019), a Sloan Research Fellowship (2017), and an Ontario Early Researcher Award (2017). She is one of MIT Technology Review’s Innovators Under 35 (2017), a Canada Science Leadership Program Fellow (2014), and one of Robohub’s “25 women in robotics you need to know about (2013)”. Her team is the four-time winner of the North-American SAE AutoDrive Challenge (2018-21).

Her PhD at ETH Zurich (2013) was awarded the ETH Medal and the Dimitris N. Chorafas Foundation Award. She holds both an M.Sc. in Engineering Cybernetics from the University of Stuttgart (2008) and an M.Sc. in Engineering Science and Mechanics from the Georgia Institute of Technology (2007).