Pittsburgh, PA, USA
Session SuBT3, Room Brighton II
Register Here (Zoom)
Foundation models (large language models, LLMs, and vision-language models, VLMs) now demonstrate an ability to understand, reason about, and generate artifacts tied to control systems. Leveraging them promises more natural human-machine interfaces, faster controller prototyping, and enhanced monitoring. Yet rigorous understanding of their capabilities, limitations, and safety implications remains scarce within the classical control community. This workshop gathers researchers from data-driven AI and control theory to chart a path that couples foundation-model expressiveness with principled modeling, estimation, and control.
Topics of interest include:
Natural Language Interfaces for Control Specification
Commonsense Constraints via Vision–Language Models
FMs as Control Design Assistants
Monitoring, Fault Detection and Diagnosis
Generative Assets for Simulation and Testing
Applications including robotics & manipulation, autonomous vehicles, traffic signal networks, smart–grid control, industrial manufacturing, healthcare automation
13:10-13:40 Prof. Chuchu Fan -- Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Tools
13:40-14:10 Prof. Chen Tang -- Customizing Pre-Trained Control Policies for Personalized and Safe Deployment
14:10-14:40 Prof. Ziran Wang -- On-Board Vision-Language Models for Personalized Autonomous Vehicle Motion Control: System Design and Real-World Validation
14:40-15:10 Coffee break
15:10-15:40 Dr. Neel P. Bhatt -- In-context Refinement of LLMs and VLMs Using Verification and Uncertainty Feedback
15:40-16:10 Prof. Yorie Nakahira -- LLM-Guided Control and Adaptation for Dynamical Systems
16:10-16:40 Panel discussion
16:40-16:50 Closing Remarks
Address: Sheraton Pittsburgh Hotel at Station Square 300 W Station Square Dr, Pittsburgh, PA 15219, USA