We finetune Octo on an air hockey task for which it is crucial to adhere to multiple safety constraints, such as keeping the end-effector on the table surface, preventing the arm from colliding with the table, and ensuring joint position limits.
The robot successfully hits the puck into the goal without any collisions with the table surface.
Given language instructions and goal images, our finetuned Octo model executes various hitting behaviors.