iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks
Accurate and safe neurosurgical intervention can be affected by intra-operative tissue deformation, known as brain-shift. In this study, we propose an automatic, fast, and accurate deformable method, called iRegNet, for registering pre-operative magnetic resonance images to intra-operative ultrasoun...
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | article |
| Lenguaje: | EN |
| Publicado: |
IEEE
2021
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/b1bbf5bbb9cd4e6fa898e6363daf2102 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:b1bbf5bbb9cd4e6fa898e6363daf2102 |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:b1bbf5bbb9cd4e6fa898e6363daf21022021-11-18T00:10:53ZiRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks2169-353610.1109/ACCESS.2021.3120306https://doaj.org/article/b1bbf5bbb9cd4e6fa898e6363daf21022021-01-01T00:00:00Zhttps://ieeexplore.ieee.org/document/9570282/https://doaj.org/toc/2169-3536Accurate and safe neurosurgical intervention can be affected by intra-operative tissue deformation, known as brain-shift. In this study, we propose an automatic, fast, and accurate deformable method, called iRegNet, for registering pre-operative magnetic resonance images to intra-operative ultrasound volumes to compensate for brain-shift. iRegNet is a robust end-to-end deep learning approach for the non-linear registration of MRI-iUS images in the context of image-guided neurosurgery. Pre-operative MRI (as moving image) and iUS (as fixed image) are first appended to our convolutional neural network, after which a non-rigid transformation field is estimated. The MRI image is then transformed using the output displacement field to the iUS coordinate system. Extensive experiments have been conducted on two multi-location databases, which are the BITE and the RESECT. Quantitatively, iRegNet reduced the mean landmark errors from pre-registration value of (4.18 ± 1.84 and 5.35 ± 4.19 mm) to the lowest value of (1.47 ± 0.61 and 0.84 ± 0.16 mm) for the BITE and RESECT datasets, respectively. Additional qualitative validation of this study was conducted by two expert neurosurgeons through overlaying MRI-iUS pairs before and after the deformable registration. Experimental findings show that our proposed iRegNet is fast and achieves state-of-the-art accuracies outperforming state-of-the-art approaches. Furthermore, the proposed iRegNet can deliver competitive results, even in the case of non-trained images as proof of its generality and can therefore be valuable in intra-operative neurosurgical guidance.Ramy A. ZeineldinMohamed E. KararZiad ElshaerMarkus SchmidhammerJan CoburgerChristian R. WirtzOliver BurgertFranziska Mathis-UllrichIEEEarticleBrain-Shiftcomputer-aided diagnosismedical image registrationneurosurgeryintra-operative ultrasoundElectrical engineering. Electronics. Nuclear engineeringTK1-9971ENIEEE Access, Vol 9, Pp 147579-147590 (2021) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN |
| topic |
Brain-Shift computer-aided diagnosis medical image registration neurosurgery intra-operative ultrasound Electrical engineering. Electronics. Nuclear engineering TK1-9971 |
| spellingShingle |
Brain-Shift computer-aided diagnosis medical image registration neurosurgery intra-operative ultrasound Electrical engineering. Electronics. Nuclear engineering TK1-9971 Ramy A. Zeineldin Mohamed E. Karar Ziad Elshaer Markus Schmidhammer Jan Coburger Christian R. Wirtz Oliver Burgert Franziska Mathis-Ullrich iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
| description |
Accurate and safe neurosurgical intervention can be affected by intra-operative tissue deformation, known as brain-shift. In this study, we propose an automatic, fast, and accurate deformable method, called iRegNet, for registering pre-operative magnetic resonance images to intra-operative ultrasound volumes to compensate for brain-shift. iRegNet is a robust end-to-end deep learning approach for the non-linear registration of MRI-iUS images in the context of image-guided neurosurgery. Pre-operative MRI (as moving image) and iUS (as fixed image) are first appended to our convolutional neural network, after which a non-rigid transformation field is estimated. The MRI image is then transformed using the output displacement field to the iUS coordinate system. Extensive experiments have been conducted on two multi-location databases, which are the BITE and the RESECT. Quantitatively, iRegNet reduced the mean landmark errors from pre-registration value of (4.18 ± 1.84 and 5.35 ± 4.19 mm) to the lowest value of (1.47 ± 0.61 and 0.84 ± 0.16 mm) for the BITE and RESECT datasets, respectively. Additional qualitative validation of this study was conducted by two expert neurosurgeons through overlaying MRI-iUS pairs before and after the deformable registration. Experimental findings show that our proposed iRegNet is fast and achieves state-of-the-art accuracies outperforming state-of-the-art approaches. Furthermore, the proposed iRegNet can deliver competitive results, even in the case of non-trained images as proof of its generality and can therefore be valuable in intra-operative neurosurgical guidance. |
| format |
article |
| author |
Ramy A. Zeineldin Mohamed E. Karar Ziad Elshaer Markus Schmidhammer Jan Coburger Christian R. Wirtz Oliver Burgert Franziska Mathis-Ullrich |
| author_facet |
Ramy A. Zeineldin Mohamed E. Karar Ziad Elshaer Markus Schmidhammer Jan Coburger Christian R. Wirtz Oliver Burgert Franziska Mathis-Ullrich |
| author_sort |
Ramy A. Zeineldin |
| title |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
| title_short |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
| title_full |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
| title_fullStr |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
| title_full_unstemmed |
iRegNet: Non-Rigid Registration of MRI to Interventional US for Brain-Shift Compensation Using Convolutional Neural Networks |
| title_sort |
iregnet: non-rigid registration of mri to interventional us for brain-shift compensation using convolutional neural networks |
| publisher |
IEEE |
| publishDate |
2021 |
| url |
https://doaj.org/article/b1bbf5bbb9cd4e6fa898e6363daf2102 |
| work_keys_str_mv |
AT ramyazeineldin iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT mohamedekarar iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT ziadelshaer iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT markusschmidhammer iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT jancoburger iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT christianrwirtz iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT oliverburgert iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks AT franziskamathisullrich iregnetnonrigidregistrationofmritointerventionalusforbrainshiftcompensationusingconvolutionalneuralnetworks |
| _version_ |
1718425186612543488 |