Collaborators: Joyce Moon, Joyce Wang, Ritika Srivastava, Corey Zhou, Alex Hong
General Topic Outline: Our group has decided to work on teleoperations with the Baxter robot in which we will be developing a controller to move Baxter. We can use Leap Motion to get the movement of the hand, and the robot can consequently move its arms to move the way our hand moved. Baxter robot can automatically adjust the angles of the joint to locate its 0hand in certain position. So, only with information of where the hand should be, it can perform the movement without the information of how to move provided (angle,etc). So leap motion can give us accurate location in 3d space and if we send that information to the robot, it can process it.
Motivation:
Idea:
Purpose:
Shopping List:
Project Plan
Project Plan:
Progress:
We started off with getting leap motion to work in an appropriate manner. It took a lot of trial, error, and experimentation before we got it to wok.
Virtual Reality Aspect: Camera on Ceiling
Early Attempts
Later Attempts, Baxter is able to recognize motion much better than before.
Final Results: Multiple perspectives
Findings:
Preprocessing raw Leap Motion data
Displacement calculation
RPI Livestreaming -> Local Computer -> Phone
Final Thoughts on Project:
We were all exposed to various technologies we had not dealt with before.
Final Presentation Deck