Baxter dataset consists totally 100 real-world images, with 20 different arm configurations (5 frames per pose). Joint angles and ground-truth end-effector positions are provided.

Surgical Tool Tracking dataset consists 80 hand-labeled tool masks. The raw rosbag is provided, which includes the recording of stereo-endoscopic images and the encoder readings from the surgical robot. More details can be found on here.