NASA astronauts are routinely faced with long, complex procedures and often have to call ground control for guidance. This presents a major problem for prospective missions: messages from Mars, for instance, have an up to 20-minute flight-time from one planet to the other. In collaboration with NASA's Ames Research Center, our project, Watchdog, aims to pioneer solutions by using AI to verify astronauts' fidelity to standard operating procedure and offer suggestions during deviation. The project fuses two approaches: neural network-based real-time video semantic analysis and a network of sensors embedded in astronaut equipment. It aims to identify specific subtasks and understand the ordinal relationships between them in a reliable and generalizable way, with the goal of laying the foundation for a more comprehensive autonomous mission guidance system.
We are a group of senior undergraduate students in Computer Engineering at UCSB. We would also like to thank and acknowledge UCSB faculty Dr. Yoga Isukapalli, graduate students Carrie Segal and Brandon Pon, and NASA researchers Dr. Jessica Marquez and Dr. Richard Joyce.
Team Lead | Computer Vision
UX | Embedded Software
PCB Design | Peripheral Interfacing
PCB Design | Peripheral Interfacing
UX | Embedded Software