All the rollouts shown on this page are from the same ToolFlowNet-trained policy for ScoopBall (6DoF action space). These are all test-time rollouts. We show the RGB images (left), segmented point cloud inputs (middle) and the tool points with predicted flow vectors in red (right), where the red flow vectors are enlarged for visual clarity.
The following rollouts are a success.
The following rollouts are failures.