Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness

Abstract Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Patrycja Delong, Uta Noppeney
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/634ebc7f3bba4780b7f0add7429f6497
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:634ebc7f3bba4780b7f0add7429f6497
record_format dspace
spelling oai:doaj.org-article:634ebc7f3bba4780b7f0add7429f64972021-12-02T15:49:53ZSemantic and spatial congruency mould audiovisual integration depending on perceptual awareness10.1038/s41598-021-90183-w2045-2322https://doaj.org/article/634ebc7f3bba4780b7f0add7429f64972021-05-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-90183-whttps://doaj.org/toc/2045-2322Abstract Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in the presence and absence of visual awareness by combining forward–backward masking with spatial ventriloquism. Observers were presented with object pictures and synchronous sounds that were spatially and/or semantically congruent or incongruent. On each trial observers located the sound, identified the picture and rated the picture’s visibility. We observed a robust ventriloquist effect for subjectively visible and invisible pictures indicating that pictures that evade our perceptual awareness influence where we perceive sounds. Critically, semantic congruency enhanced these visual biases on perceived sound location only when the picture entered observers’ awareness. Our results demonstrate that crossmodal influences operating from vision to audition and vice versa are interactively controlled by spatial and semantic congruency in the presence of awareness. However, when visual processing is disrupted by masking procedures audiovisual interactions no longer depend on semantic correspondences.Patrycja DelongUta NoppeneyNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-14 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Patrycja Delong
Uta Noppeney
Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
description Abstract Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in the presence and absence of visual awareness by combining forward–backward masking with spatial ventriloquism. Observers were presented with object pictures and synchronous sounds that were spatially and/or semantically congruent or incongruent. On each trial observers located the sound, identified the picture and rated the picture’s visibility. We observed a robust ventriloquist effect for subjectively visible and invisible pictures indicating that pictures that evade our perceptual awareness influence where we perceive sounds. Critically, semantic congruency enhanced these visual biases on perceived sound location only when the picture entered observers’ awareness. Our results demonstrate that crossmodal influences operating from vision to audition and vice versa are interactively controlled by spatial and semantic congruency in the presence of awareness. However, when visual processing is disrupted by masking procedures audiovisual interactions no longer depend on semantic correspondences.
format article
author Patrycja Delong
Uta Noppeney
author_facet Patrycja Delong
Uta Noppeney
author_sort Patrycja Delong
title Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
title_short Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
title_full Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
title_fullStr Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
title_full_unstemmed Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
title_sort semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
publisher Nature Portfolio
publishDate 2021
url https://doaj.org/article/634ebc7f3bba4780b7f0add7429f6497
work_keys_str_mv AT patrycjadelong semanticandspatialcongruencymouldaudiovisualintegrationdependingonperceptualawareness
AT utanoppeney semanticandspatialcongruencymouldaudiovisualintegrationdependingonperceptualawareness
_version_ 1718385693482287104