Research on Fast Target Positioning Method of Self-Calibration Manipulator

Hand-eye calibration and three-dimensional space target positioning are the keys to realize the automatic grasping of the manipulator. Aiming at the problems of a difficult camera manipulator calibration and poor real-time segmentation and positioning of stacked targets in industrial environment, a...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Xuhui Ye, Yuxuan Tang, Xinyu Hu, Daode Zhang, Qi Chen
Formato:	article
Lenguaje:	EN
Publicado:	MDPI AG 2021
Materias:	self-calibration trajectory planning point cloud registration point cloud segmentation of stacked objects Mask R-CNN Mathematics QA1-939
Acceso en línea:	https://doaj.org/article/fdeaa8b3a96242e0b27bd9ae39ecde96
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:fdeaa8b3a96242e0b27bd9ae39ecde96
record_format	dspace
spelling	oai:doaj.org-article:fdeaa8b3a96242e0b27bd9ae39ecde962021-11-25T19:07:00ZResearch on Fast Target Positioning Method of Self-Calibration Manipulator10.3390/sym131121352073-8994https://doaj.org/article/fdeaa8b3a96242e0b27bd9ae39ecde962021-11-01T00:00:00Zhttps://www.mdpi.com/2073-8994/13/11/2135https://doaj.org/toc/2073-8994Hand-eye calibration and three-dimensional space target positioning are the keys to realize the automatic grasping of the manipulator. Aiming at the problems of a difficult camera manipulator calibration and poor real-time segmentation and positioning of stacked targets in industrial environment, a rapid target positioning method of self-calibration manipulator is proposed. Firstly, the spatial spherical autonomous path planning is carried out based on the quaternion linear interpolation method to calculate spatially symmetric path trajectory of the calibrator. The RGB-D camera mounted at the end of the manipulator is used to obtain multiple groups of RGB and depth images of the calibration plate. Combined with the position and attitude of the manipulator end, the internal and external parameters of the camera and the hand-eye conversion matrix are automatically calibrated. Then, based on KD tree algorithm, the holes in the point cloud are extracted to plan the shooting pose of the complementary image, and the target object is photographed from multiple symmetric angles. Combined with the iterative shooting pose of the manipulator, the rapid registration of the point cloud is realized and the complete outer surface model of the target object is obtained. Finally, the improved double pyramid feature fusion depth image is used to segment the RGB image through Mask R-CNN and mapped to the point cloud space, to achieve fast target segmentation of end-to-end 3D point cloud. The experimental results show that the eye-in-hand manipulator system can be self-calibrated to greatly simplify the calibration process and achieve the calibration accuracy of the traditional calibration method. The average error in each direction of the calibration result is less than 2 mm, which can achieve the acquisition accuracy of the vision sensor. It can also register and reconstruct point clouds for complex scenes in 1 s. The improved Mask-RCNN increases the segmentation accuracy of stacking objects by 8%. Compared with the physical error of hardware, the positioning error is no more than 0.89% and can meet the requirements of practical applications.Xuhui YeYuxuan TangXinyu HuDaode ZhangQi ChenMDPI AGarticleself-calibrationtrajectory planningpoint cloud registrationpoint cloud segmentation of stacked objectsMask R-CNNMathematicsQA1-939ENSymmetry, Vol 13, Iss 2135, p 2135 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	self-calibration trajectory planning point cloud registration point cloud segmentation of stacked objects Mask R-CNN Mathematics QA1-939
spellingShingle	self-calibration trajectory planning point cloud registration point cloud segmentation of stacked objects Mask R-CNN Mathematics QA1-939 Xuhui Ye Yuxuan Tang Xinyu Hu Daode Zhang Qi Chen Research on Fast Target Positioning Method of Self-Calibration Manipulator
description	Hand-eye calibration and three-dimensional space target positioning are the keys to realize the automatic grasping of the manipulator. Aiming at the problems of a difficult camera manipulator calibration and poor real-time segmentation and positioning of stacked targets in industrial environment, a rapid target positioning method of self-calibration manipulator is proposed. Firstly, the spatial spherical autonomous path planning is carried out based on the quaternion linear interpolation method to calculate spatially symmetric path trajectory of the calibrator. The RGB-D camera mounted at the end of the manipulator is used to obtain multiple groups of RGB and depth images of the calibration plate. Combined with the position and attitude of the manipulator end, the internal and external parameters of the camera and the hand-eye conversion matrix are automatically calibrated. Then, based on KD tree algorithm, the holes in the point cloud are extracted to plan the shooting pose of the complementary image, and the target object is photographed from multiple symmetric angles. Combined with the iterative shooting pose of the manipulator, the rapid registration of the point cloud is realized and the complete outer surface model of the target object is obtained. Finally, the improved double pyramid feature fusion depth image is used to segment the RGB image through Mask R-CNN and mapped to the point cloud space, to achieve fast target segmentation of end-to-end 3D point cloud. The experimental results show that the eye-in-hand manipulator system can be self-calibrated to greatly simplify the calibration process and achieve the calibration accuracy of the traditional calibration method. The average error in each direction of the calibration result is less than 2 mm, which can achieve the acquisition accuracy of the vision sensor. It can also register and reconstruct point clouds for complex scenes in 1 s. The improved Mask-RCNN increases the segmentation accuracy of stacking objects by 8%. Compared with the physical error of hardware, the positioning error is no more than 0.89% and can meet the requirements of practical applications.
format	article
author	Xuhui Ye Yuxuan Tang Xinyu Hu Daode Zhang Qi Chen
author_facet	Xuhui Ye Yuxuan Tang Xinyu Hu Daode Zhang Qi Chen
author_sort	Xuhui Ye
title	Research on Fast Target Positioning Method of Self-Calibration Manipulator
title_short	Research on Fast Target Positioning Method of Self-Calibration Manipulator
title_full	Research on Fast Target Positioning Method of Self-Calibration Manipulator
title_fullStr	Research on Fast Target Positioning Method of Self-Calibration Manipulator
title_full_unstemmed	Research on Fast Target Positioning Method of Self-Calibration Manipulator
title_sort	research on fast target positioning method of self-calibration manipulator
publisher	MDPI AG
publishDate	2021
url	https://doaj.org/article/fdeaa8b3a96242e0b27bd9ae39ecde96
work_keys_str_mv	AT xuhuiye researchonfasttargetpositioningmethodofselfcalibrationmanipulator AT yuxuantang researchonfasttargetpositioningmethodofselfcalibrationmanipulator AT xinyuhu researchonfasttargetpositioningmethodofselfcalibrationmanipulator AT daodezhang researchonfasttargetpositioningmethodofselfcalibrationmanipulator AT qichen researchonfasttargetpositioningmethodofselfcalibrationmanipulator
_version_	1718410318518943744

Research on Fast Target Positioning Method of Self-Calibration Manipulator

Ejemplares similares