ME326 Collaborative Robotics

Project Goal

The goal of this project was to develop a robotic assistant using the Locobot platform which can collaborate effectively with human partners to retrieve objects for the human. In particular, this robotic assistant needed to process natural human speech, perceive and navigate its environment, identify and grasp objects, and give them to the user in order to accomplish the following core tasks.  

1. Object retrieval: The robotic assistant must identify and grasp an object requested by a human (i.e. by saying "Retreive the strawberry").

2. Sequential task: The robot assistant must perform a series of actions requested by a human. In particular, the robot must locate, navigate to, and pick up an object identified by a human, and then hand this object to the human. 

3. User-defined Task - A robotic "nurse": The robotic assistant must help a human user take his or her medicine. In particular, the robot must pour the medicine into the human's hand.