Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device

Abstract Sensory substitution devices aim at restoring visual functions by converting visual information into auditory or tactile stimuli. Although these devices show promise in the range of behavioral abilities they allow, the processes underlying their use remain underspecified. In particular, whi...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Jacques Pesnot Lerousseau, Gabriel Arnold, Malika Auvray
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2021
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/21363ad782a54bc0983f016a0b04d51a
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:21363ad782a54bc0983f016a0b04d51a
record_format	dspace
spelling	oai:doaj.org-article:21363ad782a54bc0983f016a0b04d51a2021-12-02T16:26:22ZTraining-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device10.1038/s41598-021-94133-42045-2322https://doaj.org/article/21363ad782a54bc0983f016a0b04d51a2021-07-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-94133-4https://doaj.org/toc/2045-2322Abstract Sensory substitution devices aim at restoring visual functions by converting visual information into auditory or tactile stimuli. Although these devices show promise in the range of behavioral abilities they allow, the processes underlying their use remain underspecified. In particular, while an initial debate focused on the visual versus auditory or tactile nature of sensory substitution, since over a decade, the idea that it reflects a mixture of both has emerged. In order to investigate behaviorally the extent to which visual and auditory processes are involved, participants completed a Stroop-like crossmodal interference paradigm before and after being trained with a conversion device which translates visual images into sounds. In addition, participants' auditory abilities and their phenomenologies were measured. Our study revealed that, after training, when asked to identify sounds, processes shared with vision were involved, as participants’ performance in sound identification was influenced by the simultaneously presented visual distractors. In addition, participants’ performance during training and their associated phenomenology depended on their auditory abilities, revealing that processing finds its roots in the input sensory modality. Our results pave the way for improving the design and learning of these devices by taking into account inter-individual differences in auditory and visual perceptual strategies.Jacques Pesnot LerousseauGabriel ArnoldMalika AuvrayNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-11 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Jacques Pesnot Lerousseau Gabriel Arnold Malika Auvray Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
description	Abstract Sensory substitution devices aim at restoring visual functions by converting visual information into auditory or tactile stimuli. Although these devices show promise in the range of behavioral abilities they allow, the processes underlying their use remain underspecified. In particular, while an initial debate focused on the visual versus auditory or tactile nature of sensory substitution, since over a decade, the idea that it reflects a mixture of both has emerged. In order to investigate behaviorally the extent to which visual and auditory processes are involved, participants completed a Stroop-like crossmodal interference paradigm before and after being trained with a conversion device which translates visual images into sounds. In addition, participants' auditory abilities and their phenomenologies were measured. Our study revealed that, after training, when asked to identify sounds, processes shared with vision were involved, as participants’ performance in sound identification was influenced by the simultaneously presented visual distractors. In addition, participants’ performance during training and their associated phenomenology depended on their auditory abilities, revealing that processing finds its roots in the input sensory modality. Our results pave the way for improving the design and learning of these devices by taking into account inter-individual differences in auditory and visual perceptual strategies.
format	article
author	Jacques Pesnot Lerousseau Gabriel Arnold Malika Auvray
author_facet	Jacques Pesnot Lerousseau Gabriel Arnold Malika Auvray
author_sort	Jacques Pesnot Lerousseau
title	Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
title_short	Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
title_full	Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
title_fullStr	Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
title_full_unstemmed	Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
title_sort	training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device
publisher	Nature Portfolio
publishDate	2021
url	https://doaj.org/article/21363ad782a54bc0983f016a0b04d51a
work_keys_str_mv	AT jacquespesnotlerousseau traininginducedplasticityenablesvisualizingsoundswithavisualtoauditoryconversiondevice AT gabrielarnold traininginducedplasticityenablesvisualizingsoundswithavisualtoauditoryconversiondevice AT malikaauvray traininginducedplasticityenablesvisualizingsoundswithavisualtoauditoryconversiondevice
_version_	1718384038685704192

Training-induced plasticity enables visualizing sounds with a visual-to-auditory conversion device

Ejemplares similares