Learning to Generate 6-DoF Grasp Poses with Reachability Awareness

Introductory video with audio

Publication

  • Learning to Generate 6-DoF Grasp Poses with Reachability Awareness [IEEE Xplore, arXiv]

Xibai Lou, Yang Yang and Changhyun Choi

BibTex

@inproceedings{lou2020learning,

title={Learning to Generate 6-DoF Grasp Poses with Reachability Awareness},

author={Lou, Xibai and Yang, Yang and Choi, Changhyun},

booktitle={2020 IEEE International Conference on Robotics and Automation (ICRA)},

year={2020},

organization={IEEE}

}

Abstract

Motivated by the stringent requirements of unstructured real-world where a plethora of unknown objects reside in arbitrary locations of the surface, we propose a voxel-based deep 3D Convolutional Neural Network (3D CNN) that generates feasible 6-DoF grasp poses in unrestricted workspace with reachability awareness. Unlike the majority of works that predict if a proposed grasp pose within the restricted workspace will be successful solely based on grasp pose stability, our approach further learns a reachability predictor that evaluates if the grasp pose is reachable or not from robot's own experience. To avoid the laborious real training data collection, we exploit the power of simulation to train our networks on a large-scale synthetic dataset. This work is an early attempt that simultaneously learns grasping reachability while proposing feasible grasp poses with 3D CNN. Experimental results in both simulation and real-world demonstrate that our approach outperforms several other methods and achieves 82.5\% grasping success rate on unknown objects.

Figure 1: Grasping Pipeline. Object point cloud P' is obtained from planar segmentation of point cloud P. For each of the sampled grasp poses X, the object point cloud P' is voxelized to voxel grid and transformed by the corresponding grasp pose candidate X. The input voxel grid is then passed to 3D CNN while the grasp candidate X is fed to reachability predictor for evaluation. The most probable grasp pose is chosen and executed by the robot manipulator.