Compressive spectral image fusion via a single aperture high throughput imaging system

Abstract Spectral image fusion techniques combine the detailed spatial information of a multispectral (MS) image and the rich spectral information of a hyperspectral (HS) image into a high-spatial and high-spectral resolution image. Due to the data deluge entailed by such images, new imaging modalit...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Hoover Rueda-Chacon, Fernando Rojas, Henry Arguello
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/69e8b1f665bf4050bc8aa4d69d018a92
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:69e8b1f665bf4050bc8aa4d69d018a92
record_format dspace
spelling oai:doaj.org-article:69e8b1f665bf4050bc8aa4d69d018a922021-12-02T15:43:23ZCompressive spectral image fusion via a single aperture high throughput imaging system10.1038/s41598-021-89788-y2045-2322https://doaj.org/article/69e8b1f665bf4050bc8aa4d69d018a922021-05-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-89788-yhttps://doaj.org/toc/2045-2322Abstract Spectral image fusion techniques combine the detailed spatial information of a multispectral (MS) image and the rich spectral information of a hyperspectral (HS) image into a high-spatial and high-spectral resolution image. Due to the data deluge entailed by such images, new imaging modalities have exploited their intrinsic correlations in such a way that, a computational algorithm can fuse them from few multiplexed linear projections. The latter has been coined compressive spectral image fusion. State-of-the-art research work have focused mainly on the algorithmic part, simulating instrumentation characteristics and assuming independently registered sensors to conduct compressed MS and HS imaging. In this manuscript, we report on the construction of a unified computational imaging framework that includes a proof-of-concept optical testbed to simultaneously acquire MS and HS compressed projections, and an alternating direction method of multipliers algorithm to reconstruct high-spatial and high-spectral resolution images from the fused compressed measurements. The testbed employs a digital micro-mirror device (DMD) to encode and split the input light towards two compressive imaging arms, which collect MS and HS measurements, respectively. This strategy entails full light throughput sensing since no light is thrown away by the coding process. Further, different resolutions can be dynamically tested by binning the DMD and sensors pixels. Real spectral responses and optical characteristics of the employed equipment are obtained through a per-pixel point spread function calibration approach to enable accurate compressed image fusion performance. The proposed framework is demonstrated through real experiments within the visible spectral range using as few as 5% of the data.Hoover Rueda-ChaconFernando RojasHenry ArguelloNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-12 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Hoover Rueda-Chacon
Fernando Rojas
Henry Arguello
Compressive spectral image fusion via a single aperture high throughput imaging system
description Abstract Spectral image fusion techniques combine the detailed spatial information of a multispectral (MS) image and the rich spectral information of a hyperspectral (HS) image into a high-spatial and high-spectral resolution image. Due to the data deluge entailed by such images, new imaging modalities have exploited their intrinsic correlations in such a way that, a computational algorithm can fuse them from few multiplexed linear projections. The latter has been coined compressive spectral image fusion. State-of-the-art research work have focused mainly on the algorithmic part, simulating instrumentation characteristics and assuming independently registered sensors to conduct compressed MS and HS imaging. In this manuscript, we report on the construction of a unified computational imaging framework that includes a proof-of-concept optical testbed to simultaneously acquire MS and HS compressed projections, and an alternating direction method of multipliers algorithm to reconstruct high-spatial and high-spectral resolution images from the fused compressed measurements. The testbed employs a digital micro-mirror device (DMD) to encode and split the input light towards two compressive imaging arms, which collect MS and HS measurements, respectively. This strategy entails full light throughput sensing since no light is thrown away by the coding process. Further, different resolutions can be dynamically tested by binning the DMD and sensors pixels. Real spectral responses and optical characteristics of the employed equipment are obtained through a per-pixel point spread function calibration approach to enable accurate compressed image fusion performance. The proposed framework is demonstrated through real experiments within the visible spectral range using as few as 5% of the data.
format article
author Hoover Rueda-Chacon
Fernando Rojas
Henry Arguello
author_facet Hoover Rueda-Chacon
Fernando Rojas
Henry Arguello
author_sort Hoover Rueda-Chacon
title Compressive spectral image fusion via a single aperture high throughput imaging system
title_short Compressive spectral image fusion via a single aperture high throughput imaging system
title_full Compressive spectral image fusion via a single aperture high throughput imaging system
title_fullStr Compressive spectral image fusion via a single aperture high throughput imaging system
title_full_unstemmed Compressive spectral image fusion via a single aperture high throughput imaging system
title_sort compressive spectral image fusion via a single aperture high throughput imaging system
publisher Nature Portfolio
publishDate 2021
url https://doaj.org/article/69e8b1f665bf4050bc8aa4d69d018a92
work_keys_str_mv AT hooverruedachacon compressivespectralimagefusionviaasingleaperturehighthroughputimagingsystem
AT fernandorojas compressivespectralimagefusionviaasingleaperturehighthroughputimagingsystem
AT henryarguello compressivespectralimagefusionviaasingleaperturehighthroughputimagingsystem
_version_ 1718385811393609728