iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks
Accurate and safe neurosurgical intervention can be affected by intra-operative tissue deformation, known as brain-shift. In this study, we propose an automatic, fast, and accurate deformable method, called iRegNet, for registering pre-operative magnetic resonance images to intra-operative ultrasoun...
Guardado en:
Autores principales: | , , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
IEEE
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/b1bbf5bbb9cd4e6fa898e6363daf2102 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:b1bbf5bbb9cd4e6fa898e6363daf2102 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:b1bbf5bbb9cd4e6fa898e6363daf21022021-11-18T00:10:53ZiRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks2169-353610.1109/ACCESS.2021.3120306https://doaj.org/article/b1bbf5bbb9cd4e6fa898e6363daf21022021-01-01T00:00:00Zhttps://ieeexplore.ieee.org/document/9570282/https://doaj.org/toc/2169-3536Accurate and safe neurosurgical intervention can be affected by intra-operative tissue deformation, known as brain-shift. In this study, we propose an automatic, fast, and accurate deformable method, called iRegNet, for registering pre-operative magnetic resonance images to intra-operative ultrasound volumes to compensate for brain-shift. iRegNet is a robust end-to-end deep learning approach for the non-linear registration of MRI-iUS images in the context of image-guided neurosurgery. Pre-operative MRI (as moving image) and iUS (as fixed image) are first appended to our convolutional neural network, after which a non-rigid transformation field is estimated. The MRI image is then transformed using the output displacement field to the iUS coordinate system. Extensive experiments have been conducted on two multi-location databases, which are the BITE and the RESECT. Quantitatively, iRegNet reduced the mean landmark errors from pre-registration value of (4.18 ± 1.84 and 5.35 ± 4.19 mm) to the lowest value of (1.47 ± 0.61 and 0.84 ± 0.16 mm) for the BITE and RESECT datasets, respectively. Additional qualitative validation of this study was conducted by two expert neurosurgeons through overlaying MRI-iUS pairs before and after the deformable registration. Experimental findings show that our proposed iRegNet is fast and achieves state-of-the-art accuracies outperforming state-of-the-art approaches. Furthermore, the proposed iRegNet can deliver competitive results, even in the case of non-trained images as proof of its generality and can therefore be valuable in intra-operative neurosurgical guidance.Ramy A. ZeineldinMohamed E. KararZiad ElshaerMarkus SchmidhammerJan CoburgerChristian R. WirtzOliver BurgertFranziska Mathis-UllrichIEEEarticleBrain-Shiftcomputer-aided diagnosismedical image registrationneurosurgeryintra-operative ultrasoundElectrical engineering. Electronics. Nuclear engineeringTK1-9971ENIEEE Access, Vol 9, Pp 147579-147590 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Brain-Shift computer-aided diagnosis medical image registration neurosurgery intra-operative ultrasound Electrical engineering. Electronics. Nuclear engineering TK1-9971 |
spellingShingle |
Brain-Shift computer-aided diagnosis medical image registration neurosurgery intra-operative ultrasound Electrical engineering. Electronics. Nuclear engineering TK1-9971 Ramy A. Zeineldin Mohamed E. Karar Ziad Elshaer Markus Schmidhammer Jan Coburger Christian R. Wirtz Oliver Burgert Franziska Mathis-Ullrich iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
description |
Accurate and safe neurosurgical intervention can be affected by intra-operative tissue deformation, known as brain-shift. In this study, we propose an automatic, fast, and accurate deformable method, called iRegNet, for registering pre-operative magnetic resonance images to intra-operative ultrasound volumes to compensate for brain-shift. iRegNet is a robust end-to-end deep learning approach for the non-linear registration of MRI-iUS images in the context of image-guided neurosurgery. Pre-operative MRI (as moving image) and iUS (as fixed image) are first appended to our convolutional neural network, after which a non-rigid transformation field is estimated. The MRI image is then transformed using the output displacement field to the iUS coordinate system. Extensive experiments have been conducted on two multi-location databases, which are the BITE and the RESECT. Quantitatively, iRegNet reduced the mean landmark errors from pre-registration value of (4.18 ± 1.84 and 5.35 ± 4.19 mm) to the lowest value of (1.47 ± 0.61 and 0.84 ± 0.16 mm) for the BITE and RESECT datasets, respectively. Additional qualitative validation of this study was conducted by two expert neurosurgeons through overlaying MRI-iUS pairs before and after the deformable registration. Experimental findings show that our proposed iRegNet is fast and achieves state-of-the-art accuracies outperforming state-of-the-art approaches. Furthermore, the proposed iRegNet can deliver competitive results, even in the case of non-trained images as proof of its generality and can therefore be valuable in intra-operative neurosurgical guidance. |
format |
article |
author |
Ramy A. Zeineldin Mohamed E. Karar Ziad Elshaer Markus Schmidhammer Jan Coburger Christian R. Wirtz Oliver Burgert Franziska Mathis-Ullrich |
author_facet |
Ramy A. Zeineldin Mohamed E. Karar Ziad Elshaer Markus Schmidhammer Jan Coburger Christian R. Wirtz Oliver Burgert Franziska Mathis-Ullrich |
author_sort |
Ramy A. Zeineldin |
title |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
title_short |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
title_full |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
title_fullStr |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
title_full_unstemmed |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
title_sort |
iregnet: non-rigid registration of mri to interventional us for brain-shift compensation using convolutional neural networks |
publisher |
IEEE |
publishDate |
2021 |
url |
https://doaj.org/article/b1bbf5bbb9cd4e6fa898e6363daf2102 |
work_keys_str_mv |
AT ramyazeineldin iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT mohamedekarar iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT ziadelshaer iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT markusschmidhammer iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT jancoburger iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT christianrwirtz iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT oliverburgert iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT franziskamathisullrich iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks |
_version_ |
1718425186612543488 |