Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators

Augmented reality medical training simulators can provide a realistic and immersive experience by overlapping the virtual scene on to the real world. Latency in augmented reality (AR) medical training simulators is an important issue as it can lead to motion sickness for users. This paper proposes a...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Myeongjin Kim, Fernando Bello
Formato:	article
Lenguaje:	EN
Publicado:	MDPI AG 2021
Materias:	augmented reality latency head-mounted display medical simulation free-form deformation Technology T Engineering (General). Civil engineering (General) TA1-2040 Biology (General) QH301-705.5 Physics QC1-999 Chemistry QD1-999
Acceso en línea:	https://doaj.org/article/5715d60331c54a8f99cac7e1294412b0
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:5715d60331c54a8f99cac7e1294412b0
record_format	dspace
spelling	oai:doaj.org-article:5715d60331c54a8f99cac7e1294412b02021-11-11T15:01:19ZMulti-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators10.3390/app112199252076-3417https://doaj.org/article/5715d60331c54a8f99cac7e1294412b02021-10-01T00:00:00Zhttps://www.mdpi.com/2076-3417/11/21/9925https://doaj.org/toc/2076-3417Augmented reality medical training simulators can provide a realistic and immersive experience by overlapping the virtual scene on to the real world. Latency in augmented reality (AR) medical training simulators is an important issue as it can lead to motion sickness for users. This paper proposes a framework that can achieve real-time rendering of the 3D scene aligned to the real world using a head-mounted display (HMD). Model deformation in the 3D scene is categorised into local deformation derived from user interaction and global deformation determined by the simulation scenario. Target shapes are predefined by a simulation scenario, and control points are placed to embed the predefined shapes. Free-form deformation (FFD) is applied to multiple shapes to efficiently transfer the simulated model to the HMD. Global deformation is computed by blending a mapping matrix of each FFD with an assigned weighting value. The local and global deformation are then transferred through the control points updated from a deformed surface mesh and its corresponding weighting value. The proposed framework is verified in terms of latency caused by data transmission and the accuracy of a transmitted surface mesh in a vaginal examination (VE) training simulation. The average latency is reduced to 7 ms, less than the latency causing motion sickness in virtual reality simulations. The maximum relative error is less than 3%. Our framework allows seamless rendering of a virtual scene to the real world with substantially reduced latency and without the need for an external tracking system.Myeongjin KimFernando BelloMDPI AGarticleaugmented realitylatencyhead-mounted displaymedical simulationfree-form deformationTechnologyTEngineering (General). Civil engineering (General)TA1-2040Biology (General)QH301-705.5PhysicsQC1-999ChemistryQD1-999ENApplied Sciences, Vol 11, Iss 9925, p 9925 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	augmented reality latency head-mounted display medical simulation free-form deformation Technology T Engineering (General). Civil engineering (General) TA1-2040 Biology (General) QH301-705.5 Physics QC1-999 Chemistry QD1-999
spellingShingle	augmented reality latency head-mounted display medical simulation free-form deformation Technology T Engineering (General). Civil engineering (General) TA1-2040 Biology (General) QH301-705.5 Physics QC1-999 Chemistry QD1-999 Myeongjin Kim Fernando Bello Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators
description	Augmented reality medical training simulators can provide a realistic and immersive experience by overlapping the virtual scene on to the real world. Latency in augmented reality (AR) medical training simulators is an important issue as it can lead to motion sickness for users. This paper proposes a framework that can achieve real-time rendering of the 3D scene aligned to the real world using a head-mounted display (HMD). Model deformation in the 3D scene is categorised into local deformation derived from user interaction and global deformation determined by the simulation scenario. Target shapes are predefined by a simulation scenario, and control points are placed to embed the predefined shapes. Free-form deformation (FFD) is applied to multiple shapes to efficiently transfer the simulated model to the HMD. Global deformation is computed by blending a mapping matrix of each FFD with an assigned weighting value. The local and global deformation are then transferred through the control points updated from a deformed surface mesh and its corresponding weighting value. The proposed framework is verified in terms of latency caused by data transmission and the accuracy of a transmitted surface mesh in a vaginal examination (VE) training simulation. The average latency is reduced to 7 ms, less than the latency causing motion sickness in virtual reality simulations. The maximum relative error is less than 3%. Our framework allows seamless rendering of a virtual scene to the real world with substantially reduced latency and without the need for an external tracking system.
format	article
author	Myeongjin Kim Fernando Bello
author_facet	Myeongjin Kim Fernando Bello
author_sort	Myeongjin Kim
title	Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators
title_short	Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators
title_full	Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators
title_fullStr	Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators
title_full_unstemmed	Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators
title_sort	multi-shape free-form deformation framework for efficient data transmission in ar-based medical training simulators
publisher	MDPI AG
publishDate	2021
url	https://doaj.org/article/5715d60331c54a8f99cac7e1294412b0
work_keys_str_mv	AT myeongjinkim multishapefreeformdeformationframeworkforefficientdatatransmissioninarbasedmedicaltrainingsimulators AT fernandobello multishapefreeformdeformationframeworkforefficientdatatransmissioninarbasedmedicaltrainingsimulators
_version_	1718437602047033344

Multi-Shape Free-Form Deformation Framework for Efficient Data Transmission in AR-Based Medical Training Simulators

Ejemplares similares