Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation

Abstract Multi-modal image co-registration via optimizing mutual information (MI) is based on the assumption that intensity distributions of multi-modal images follow a consistent relationship. However, images with a substantial difference in appearance violate this assumption, thus MI directly base...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Lin Li, Shivani Pahwa, Gregory Penzias, Mirabela Rusu, Jay Gollamudi, Satish Viswanath, Anant Madabhushi
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2017
Materias:
R
Q
Acceso en línea:https://doaj.org/article/25abe5deed62450c9d569b039a493217
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:25abe5deed62450c9d569b039a493217
record_format dspace
spelling oai:doaj.org-article:25abe5deed62450c9d569b039a4932172021-12-02T12:32:19ZCo-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation10.1038/s41598-017-08969-w2045-2322https://doaj.org/article/25abe5deed62450c9d569b039a4932172017-08-01T00:00:00Zhttps://doi.org/10.1038/s41598-017-08969-whttps://doaj.org/toc/2045-2322Abstract Multi-modal image co-registration via optimizing mutual information (MI) is based on the assumption that intensity distributions of multi-modal images follow a consistent relationship. However, images with a substantial difference in appearance violate this assumption, thus MI directly based on image intensity alone may be inadequate to drive similarity based co-registration. To address this issue, we introduce a novel approach for multi-modal co-registration called Multi-scale Spectral Embedding Registration (MSERg). MSERg involves the construction of multi-scale spectral embedding (SE) representations from multimodal images via texture feature extraction, scale selection, independent component analysis (ICA) and SE to create orthogonal representations that decrease the dissimilarity between the fixed and moving images to facilitate better co-registration. To validate the MSERg method, we aligned 45 pairs of in vivo prostate MRI and corresponding ex vivo histopathology images. The dataset was split into a learning set and a testing set. In the learning set, length scales of 5 × 5, 7 × 7 and 17 × 17 were selected. In the independent testing set, we compared MSERg with intensity-based registration, multi-attribute combined mutual information (MACMI) registration and scale-invariant feature transform (SIFT) flow registration. Our results suggest that multi-scale SE representations generated by MSERg are found to be more appropriate for radiology-pathology co-registration.Lin LiShivani PahwaGregory PenziasMirabela RusuJay GollamudiSatish ViswanathAnant MadabhushiNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 7, Iss 1, Pp 1-12 (2017)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Lin Li
Shivani Pahwa
Gregory Penzias
Mirabela Rusu
Jay Gollamudi
Satish Viswanath
Anant Madabhushi
Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation
description Abstract Multi-modal image co-registration via optimizing mutual information (MI) is based on the assumption that intensity distributions of multi-modal images follow a consistent relationship. However, images with a substantial difference in appearance violate this assumption, thus MI directly based on image intensity alone may be inadequate to drive similarity based co-registration. To address this issue, we introduce a novel approach for multi-modal co-registration called Multi-scale Spectral Embedding Registration (MSERg). MSERg involves the construction of multi-scale spectral embedding (SE) representations from multimodal images via texture feature extraction, scale selection, independent component analysis (ICA) and SE to create orthogonal representations that decrease the dissimilarity between the fixed and moving images to facilitate better co-registration. To validate the MSERg method, we aligned 45 pairs of in vivo prostate MRI and corresponding ex vivo histopathology images. The dataset was split into a learning set and a testing set. In the learning set, length scales of 5 × 5, 7 × 7 and 17 × 17 were selected. In the independent testing set, we compared MSERg with intensity-based registration, multi-attribute combined mutual information (MACMI) registration and scale-invariant feature transform (SIFT) flow registration. Our results suggest that multi-scale SE representations generated by MSERg are found to be more appropriate for radiology-pathology co-registration.
format article
author Lin Li
Shivani Pahwa
Gregory Penzias
Mirabela Rusu
Jay Gollamudi
Satish Viswanath
Anant Madabhushi
author_facet Lin Li
Shivani Pahwa
Gregory Penzias
Mirabela Rusu
Jay Gollamudi
Satish Viswanath
Anant Madabhushi
author_sort Lin Li
title Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation
title_short Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation
title_full Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation
title_fullStr Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation
title_full_unstemmed Co-Registration of ex vivo Surgical Histopathology and in vivo T2 weighted MRI of the Prostate via multi-scale spectral embedding representation
title_sort co-registration of ex vivo surgical histopathology and in vivo t2 weighted mri of the prostate via multi-scale spectral embedding representation
publisher Nature Portfolio
publishDate 2017
url https://doaj.org/article/25abe5deed62450c9d569b039a493217
work_keys_str_mv AT linli coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
AT shivanipahwa coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
AT gregorypenzias coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
AT mirabelarusu coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
AT jaygollamudi coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
AT satishviswanath coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
AT anantmadabhushi coregistrationofexvivosurgicalhistopathologyandinvivot2weightedmrioftheprostateviamultiscalespectralembeddingrepresentation
_version_ 1718394084093067264