Student: Nathan Rodriguez
Research mentor: Tony Alarcon
Drones are indispensable tools across a variety of applications, especially in urgent scenarios like search and rescue operations where rapid response is crucial. However, the effectiveness of drones is often compromised by complex user interfaces that delay critical maneuvers. Typically, the pilot-in-command (P.I.C) must juggle focusing on intricate drone operations with monitoring its status, a demanding task that significantly hampers efficiency. With the advent of artificial intelligence (AI) technologies, the interaction paradigms between humans and machines are evolving. Leveraging large language models (LLMs) and AI can transform drone interfaces, enhancing operational efficiency by enabling voice commands for direct information retrieval and action initiation, thus minimizing the need for manual interface navigation. For instance, setting up a geo-fence could transition from manual map inputs to verbal instructions, allowing the P.I.C to maintain attention on the drone’s flight rather than the interface. This shift towards AI-enhanced interfaces represents a significant advancement in drone technology, promising to optimize response times and streamline operations. By integrating AI, especially voice-activated controls, into drone systems, we can substantially reduce the cognitive load on operators, thereby increasing both the speed and safety of mission-critical deployments. As we continue to refine these technologies, the future of drone operations will likely see a dramatic shift towards more autonomous, reliable, and user-friendly systems, ultimately broadening the scope of their application and effectiveness in real-world scenarios.
Tony Alarcon is a Ph.D. Student in Computer Science and Engineering at the University of Notre Dame, advised by Dr Jane Cleland-Huang. Before that, he obtained his B.S. degree from the University of California majoring in astrophysics. His research fields are in Cyberphysical Systems, Machine Learning, Artificial Intelligence, with experience with reinforcement learning and LLMs.
Dr Jane Cleland-Huang is the lead researcher on the Drone Response project — a system for managing and monitoring the flights of semi-autonomous small Unmanned Aerial Systems (sUAS). As part of this project, she is involved in Smart and Connected Communities (SCC) research and is working closely with the South Bend Fire Department to co-design a system in which sUAS serve as full-mission partners for emergency response scenarios.