Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface

At present, feature-based 3D reconstruction and tracking technology is widely applied in the medical field. In minimally invasive surgery, the surgeon can achieve three-dimensional reconstruction through the images obtained by the endoscope in the human body, restore the three-dimensional scene of t...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Ziyan Zhang, Yan Liu, Jiawei Tian, Shan Liu, Bo Yang, Longhai Xiang, Lirong Yin, Wenfeng Zheng
Formato:	article
Lenguaje:	EN
Publicado:	MDPI AG 2021
Materias:	Delaunay triangulation reconstruction of three-dimensional surface feature tracking convolutional neural network Chemical technology TP1-1185
Acceso en línea:	https://doaj.org/article/cbb18823070b483695b03751762ed02a
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:cbb18823070b483695b03751762ed02a
record_format	dspace
spelling	oai:doaj.org-article:cbb18823070b483695b03751762ed02a2021-11-25T18:57:31ZStudy on Reconstruction and Feature Tracking of Silicone Heart 3D Surface10.3390/s212275701424-8220https://doaj.org/article/cbb18823070b483695b03751762ed02a2021-11-01T00:00:00Zhttps://www.mdpi.com/1424-8220/21/22/7570https://doaj.org/toc/1424-8220At present, feature-based 3D reconstruction and tracking technology is widely applied in the medical field. In minimally invasive surgery, the surgeon can achieve three-dimensional reconstruction through the images obtained by the endoscope in the human body, restore the three-dimensional scene of the area to be operated on, and track the motion of the soft tissue surface. This enables doctors to have a clearer understanding of the location depth of the surgical area, greatly reducing the negative impact of 2D image defects and ensuring smooth operation. In this study, firstly, the 3D coordinates of each feature point are calculated by using the parameters of the parallel binocular endoscope and the spatial geometric constraints. At the same time, the discrete feature points are divided into multiple triangles using the Delaunay triangulation method. Then, the 3D coordinates of feature points and the division results of each triangle are combined to complete the 3D surface reconstruction. Combined with the feature matching method based on convolutional neural network, feature tracking is realized by calculating the three-dimensional coordinate changes of the same feature point in different frames. Finally, experiments are carried out on the endoscope image to complete the 3D surface reconstruction and feature tracking.Ziyan ZhangYan LiuJiawei TianShan LiuBo YangLonghai XiangLirong YinWenfeng ZhengMDPI AGarticleDelaunay triangulationreconstruction of three-dimensional surfacefeature trackingconvolutional neural networkChemical technologyTP1-1185ENSensors, Vol 21, Iss 7570, p 7570 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Delaunay triangulation reconstruction of three-dimensional surface feature tracking convolutional neural network Chemical technology TP1-1185
spellingShingle	Delaunay triangulation reconstruction of three-dimensional surface feature tracking convolutional neural network Chemical technology TP1-1185 Ziyan Zhang Yan Liu Jiawei Tian Shan Liu Bo Yang Longhai Xiang Lirong Yin Wenfeng Zheng Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface
description	At present, feature-based 3D reconstruction and tracking technology is widely applied in the medical field. In minimally invasive surgery, the surgeon can achieve three-dimensional reconstruction through the images obtained by the endoscope in the human body, restore the three-dimensional scene of the area to be operated on, and track the motion of the soft tissue surface. This enables doctors to have a clearer understanding of the location depth of the surgical area, greatly reducing the negative impact of 2D image defects and ensuring smooth operation. In this study, firstly, the 3D coordinates of each feature point are calculated by using the parameters of the parallel binocular endoscope and the spatial geometric constraints. At the same time, the discrete feature points are divided into multiple triangles using the Delaunay triangulation method. Then, the 3D coordinates of feature points and the division results of each triangle are combined to complete the 3D surface reconstruction. Combined with the feature matching method based on convolutional neural network, feature tracking is realized by calculating the three-dimensional coordinate changes of the same feature point in different frames. Finally, experiments are carried out on the endoscope image to complete the 3D surface reconstruction and feature tracking.
format	article
author	Ziyan Zhang Yan Liu Jiawei Tian Shan Liu Bo Yang Longhai Xiang Lirong Yin Wenfeng Zheng
author_facet	Ziyan Zhang Yan Liu Jiawei Tian Shan Liu Bo Yang Longhai Xiang Lirong Yin Wenfeng Zheng
author_sort	Ziyan Zhang
title	Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface
title_short	Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface
title_full	Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface
title_fullStr	Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface
title_full_unstemmed	Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface
title_sort	study on reconstruction and feature tracking of silicone heart 3d surface
publisher	MDPI AG
publishDate	2021
url	https://doaj.org/article/cbb18823070b483695b03751762ed02a
work_keys_str_mv	AT ziyanzhang studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT yanliu studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT jiaweitian studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT shanliu studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT boyang studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT longhaixiang studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT lirongyin studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface AT wenfengzheng studyonreconstructionandfeaturetrackingofsiliconeheart3dsurface
_version_	1718410490323927040

Study on Reconstruction and Feature Tracking of Silicone Heart 3D Surface

Ejemplares similares