A self-supervised learning-based 6-DOF grasp planning method for manipulator.pdf (3.15 MB)

A self-supervised learning-based 6-DOF grasp planning method for manipulator

Download (3.15 MB)
Version 2 2022-06-20, 00:23
Version 1 2022-06-20, 00:19
journal contribution
posted on 2022-06-20, 00:23 authored by Gang Peng, Zhenyu Ren, Hao Wang, Xinde Li, Mohammad KhyamMohammad Khyam
To realize a robust robotic grasping system for unknown objects in an unstructured environment, large amounts of grasp data and 3D model data for the object are required; the sizes of these data directly affect the rate of successful grasps. To reduce the time cost of data acquisition and labeling and increase the rate of successful grasps, we developed a self-supervised learning mechanism to control grasp tasks performed by manipulators. First, a manipulator automatically collects the point cloud for the objects from multiple perspectives to increase the efficiency of data acquisition. The complete point cloud for the objects is obtained using the hand-eye vision of the manipulator and the truncated signed distance function algorithm. Then, the point cloud data for the objects are used to generate a series of six-degrees-of-freedom grasp poses, and the force-closure decision algorithm is used to add the grasp quality label to each grasp pose to realize the automatic labeling of grasp data. Finally, the point cloud in the gripper closing area corresponding to each grasp pose is obtained and used to train the grasp-quality classification model for the manipulator. The results of performing actual grasping experiments demonstrate that the proposed self-supervised learning method can increase the rate of successful grasps for the manipulator.


Start Page


End Page


Number of Pages







Institute of Electrical and Electronics Engineers

Additional Rights

CC BY 4.0

Peer Reviewed

  • Yes

Open Access

  • Yes

Acceptance Date


External Author Affiliations

Southeast University Huazhong University of Science and Technology, China

Era Eligible

  • Yes


IEEE Transactions on Automation Science and Engineering