Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections

Nowadays, ultrasound (US) is increasingly being chosen as imaging modality for both diagnostic and interventional applications, owing to its positive characteristics in terms of safety, low footprint, and low cost. The combination of this imaging modality with wearable augmented reality (AR) systems...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Nadia Cattari, Sara Condino, Fabrizio Cutolo, Matteo Ghilli, Mauro Ferrari, Vincenzo Ferrari
Formato:	article
Lenguaje:	EN
Publicado:	IEEE 2021
Materias:	Augmented reality head-mounted display 3D ultrasound dissection surgical instrument tracking Electrical engineering. Electronics. Nuclear engineering TK1-9971
Acceso en línea:	https://doaj.org/article/1faae28ce57245d5b30d453db5ddb9ea
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:1faae28ce57245d5b30d453db5ddb9ea
record_format	dspace
spelling	oai:doaj.org-article:1faae28ce57245d5b30d453db5ddb9ea2021-12-02T00:00:54ZWearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections2169-353610.1109/ACCESS.2021.3129324https://doaj.org/article/1faae28ce57245d5b30d453db5ddb9ea2021-01-01T00:00:00Zhttps://ieeexplore.ieee.org/document/9620083/https://doaj.org/toc/2169-3536Nowadays, ultrasound (US) is increasingly being chosen as imaging modality for both diagnostic and interventional applications, owing to its positive characteristics in terms of safety, low footprint, and low cost. The combination of this imaging modality with wearable augmented reality (AR) systems, such as the head-mounted displays (HMD), comes forward as a breakthrough technological solution, as it allows for hands-free interaction with the augmented scene, which is an essential requirement for the execution of high-precision manual tasks, such as in surgery. What we propose in this study is the integration of an AR navigation system (HMD plus dedicated platform) with a 3D US imaging system to guide a dissection task that requires maintaining safety margins with respect to unexposed anatomical or pathological structures. For this purpose, a standard scalpel was sensorized to provide real-time feedback on the position of the instrument during the execution of the task. The accuracy of the system was quantitatively assessed with two different experimental studies: a targeting experiment, which revealed a median error of 2.53 mm in estimating the scalpel to target distance, and a preliminary user study simulating a dissection task that requires reaching a predefined distance to an occult lesion. The second experiment results showed that the system can be used to guide a dissection task with a mean accuracy of 0.65 mm, with a mean angular error between the ideal and actual cutting plane of 2.07°. The results encourage further studies to fully exploit the potential of wearable AR and intraoperative US imaging to accurately guide deep surgical tasks, such as to guide the excision of non-palpable breast tumors ensuring optimal margin clearance.Nadia CattariSara CondinoFabrizio CutoloMatteo GhilliMauro FerrariVincenzo FerrariIEEEarticleAugmented realityhead-mounted display3D ultrasounddissectionsurgical instrument trackingElectrical engineering. Electronics. Nuclear engineeringTK1-9971ENIEEE Access, Vol 9, Pp 156746-156757 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Augmented reality head-mounted display 3D ultrasound dissection surgical instrument tracking Electrical engineering. Electronics. Nuclear engineering TK1-9971
spellingShingle	Augmented reality head-mounted display 3D ultrasound dissection surgical instrument tracking Electrical engineering. Electronics. Nuclear engineering TK1-9971 Nadia Cattari Sara Condino Fabrizio Cutolo Matteo Ghilli Mauro Ferrari Vincenzo Ferrari Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections
description	Nowadays, ultrasound (US) is increasingly being chosen as imaging modality for both diagnostic and interventional applications, owing to its positive characteristics in terms of safety, low footprint, and low cost. The combination of this imaging modality with wearable augmented reality (AR) systems, such as the head-mounted displays (HMD), comes forward as a breakthrough technological solution, as it allows for hands-free interaction with the augmented scene, which is an essential requirement for the execution of high-precision manual tasks, such as in surgery. What we propose in this study is the integration of an AR navigation system (HMD plus dedicated platform) with a 3D US imaging system to guide a dissection task that requires maintaining safety margins with respect to unexposed anatomical or pathological structures. For this purpose, a standard scalpel was sensorized to provide real-time feedback on the position of the instrument during the execution of the task. The accuracy of the system was quantitatively assessed with two different experimental studies: a targeting experiment, which revealed a median error of 2.53 mm in estimating the scalpel to target distance, and a preliminary user study simulating a dissection task that requires reaching a predefined distance to an occult lesion. The second experiment results showed that the system can be used to guide a dissection task with a mean accuracy of 0.65 mm, with a mean angular error between the ideal and actual cutting plane of 2.07°. The results encourage further studies to fully exploit the potential of wearable AR and intraoperative US imaging to accurately guide deep surgical tasks, such as to guide the excision of non-palpable breast tumors ensuring optimal margin clearance.
format	article
author	Nadia Cattari Sara Condino Fabrizio Cutolo Matteo Ghilli Mauro Ferrari Vincenzo Ferrari
author_facet	Nadia Cattari Sara Condino Fabrizio Cutolo Matteo Ghilli Mauro Ferrari Vincenzo Ferrari
author_sort	Nadia Cattari
title	Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections
title_short	Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections
title_full	Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections
title_fullStr	Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections
title_full_unstemmed	Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections
title_sort	wearable ar and 3d ultrasound: towards a novel way to guide surgical dissections
publisher	IEEE
publishDate	2021
url	https://doaj.org/article/1faae28ce57245d5b30d453db5ddb9ea
work_keys_str_mv	AT nadiacattari wearablearand3dultrasoundtowardsanovelwaytoguidesurgicaldissections AT saracondino wearablearand3dultrasoundtowardsanovelwaytoguidesurgicaldissections AT fabriziocutolo wearablearand3dultrasoundtowardsanovelwaytoguidesurgicaldissections AT matteoghilli wearablearand3dultrasoundtowardsanovelwaytoguidesurgicaldissections AT mauroferrari wearablearand3dultrasoundtowardsanovelwaytoguidesurgicaldissections AT vincenzoferrari wearablearand3dultrasoundtowardsanovelwaytoguidesurgicaldissections
_version_	1718403970697789440

Wearable AR and 3D Ultrasound: Towards a Novel Way to Guide Surgical Dissections

Ejemplares similares