A virtual reality interface for the immersive manipulation of live microscopic systems

Abstract For more than three centuries we have been watching and studying microscopic phenomena behind a microscope. We discovered that cells live in a physical environment whose predominant factors are no longer those of our scale and for which we lack a direct experience and consequently a deep in...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Stefano Ferretti, Silvio Bianchi, Giacomo Frangipane, Roberto Di Leonardo
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/7d0ef7da79854650b865425d315452eb
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:7d0ef7da79854650b865425d315452eb
record_format dspace
spelling oai:doaj.org-article:7d0ef7da79854650b865425d315452eb2021-12-02T14:15:53ZA virtual reality interface for the immersive manipulation of live microscopic systems10.1038/s41598-021-87004-52045-2322https://doaj.org/article/7d0ef7da79854650b865425d315452eb2021-04-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-87004-5https://doaj.org/toc/2045-2322Abstract For more than three centuries we have been watching and studying microscopic phenomena behind a microscope. We discovered that cells live in a physical environment whose predominant factors are no longer those of our scale and for which we lack a direct experience and consequently a deep intuition. Here we demonstrate a new instrument which, by integrating holographic and virtual reality technologies, allows the user to be completely immersed in a dynamic virtual world which is a simultaneous replica of a real system under the microscope. We use holographic microscopy for fast 3D imaging and real-time rendering on a virtual reality headset. At the same time, hand tracking data is used to dynamically generate holographic optical traps that can be used as virtual projections of the user hands to interactively grab and manipulate ensembles of microparticles or living motile cells.Stefano FerrettiSilvio BianchiGiacomo FrangipaneRoberto Di LeonardoNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-9 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Stefano Ferretti
Silvio Bianchi
Giacomo Frangipane
Roberto Di Leonardo
A virtual reality interface for the immersive manipulation of live microscopic systems
description Abstract For more than three centuries we have been watching and studying microscopic phenomena behind a microscope. We discovered that cells live in a physical environment whose predominant factors are no longer those of our scale and for which we lack a direct experience and consequently a deep intuition. Here we demonstrate a new instrument which, by integrating holographic and virtual reality technologies, allows the user to be completely immersed in a dynamic virtual world which is a simultaneous replica of a real system under the microscope. We use holographic microscopy for fast 3D imaging and real-time rendering on a virtual reality headset. At the same time, hand tracking data is used to dynamically generate holographic optical traps that can be used as virtual projections of the user hands to interactively grab and manipulate ensembles of microparticles or living motile cells.
format article
author Stefano Ferretti
Silvio Bianchi
Giacomo Frangipane
Roberto Di Leonardo
author_facet Stefano Ferretti
Silvio Bianchi
Giacomo Frangipane
Roberto Di Leonardo
author_sort Stefano Ferretti
title A virtual reality interface for the immersive manipulation of live microscopic systems
title_short A virtual reality interface for the immersive manipulation of live microscopic systems
title_full A virtual reality interface for the immersive manipulation of live microscopic systems
title_fullStr A virtual reality interface for the immersive manipulation of live microscopic systems
title_full_unstemmed A virtual reality interface for the immersive manipulation of live microscopic systems
title_sort virtual reality interface for the immersive manipulation of live microscopic systems
publisher Nature Portfolio
publishDate 2021
url https://doaj.org/article/7d0ef7da79854650b865425d315452eb
work_keys_str_mv AT stefanoferretti avirtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT silviobianchi avirtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT giacomofrangipane avirtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT robertodileonardo avirtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT stefanoferretti virtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT silviobianchi virtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT giacomofrangipane virtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
AT robertodileonardo virtualrealityinterfacefortheimmersivemanipulationoflivemicroscopicsystems
_version_ 1718391736472961024