Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness
Abstract Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in...
Guardado en:
Autores principales: | , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Nature Portfolio
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/634ebc7f3bba4780b7f0add7429f6497 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:634ebc7f3bba4780b7f0add7429f6497 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:634ebc7f3bba4780b7f0add7429f64972021-12-02T15:49:53ZSemantic and spatial congruency mould audiovisual integration depending on perceptual awareness10.1038/s41598-021-90183-w2045-2322https://doaj.org/article/634ebc7f3bba4780b7f0add7429f64972021-05-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-90183-whttps://doaj.org/toc/2045-2322Abstract Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in the presence and absence of visual awareness by combining forward–backward masking with spatial ventriloquism. Observers were presented with object pictures and synchronous sounds that were spatially and/or semantically congruent or incongruent. On each trial observers located the sound, identified the picture and rated the picture’s visibility. We observed a robust ventriloquist effect for subjectively visible and invisible pictures indicating that pictures that evade our perceptual awareness influence where we perceive sounds. Critically, semantic congruency enhanced these visual biases on perceived sound location only when the picture entered observers’ awareness. Our results demonstrate that crossmodal influences operating from vision to audition and vice versa are interactively controlled by spatial and semantic congruency in the presence of awareness. However, when visual processing is disrupted by masking procedures audiovisual interactions no longer depend on semantic correspondences.Patrycja DelongUta NoppeneyNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-14 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Patrycja Delong Uta Noppeney Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
description |
Abstract Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in the presence and absence of visual awareness by combining forward–backward masking with spatial ventriloquism. Observers were presented with object pictures and synchronous sounds that were spatially and/or semantically congruent or incongruent. On each trial observers located the sound, identified the picture and rated the picture’s visibility. We observed a robust ventriloquist effect for subjectively visible and invisible pictures indicating that pictures that evade our perceptual awareness influence where we perceive sounds. Critically, semantic congruency enhanced these visual biases on perceived sound location only when the picture entered observers’ awareness. Our results demonstrate that crossmodal influences operating from vision to audition and vice versa are interactively controlled by spatial and semantic congruency in the presence of awareness. However, when visual processing is disrupted by masking procedures audiovisual interactions no longer depend on semantic correspondences. |
format |
article |
author |
Patrycja Delong Uta Noppeney |
author_facet |
Patrycja Delong Uta Noppeney |
author_sort |
Patrycja Delong |
title |
Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
title_short |
Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
title_full |
Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
title_fullStr |
Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
title_full_unstemmed |
Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
title_sort |
semantic and spatial congruency mould audiovisual integration depending on perceptual awareness |
publisher |
Nature Portfolio |
publishDate |
2021 |
url |
https://doaj.org/article/634ebc7f3bba4780b7f0add7429f6497 |
work_keys_str_mv |
AT patrycjadelong semanticandspatialcongruencymouldaudiovisualintegrationdependingonperceptualawareness AT utanoppeney semanticandspatialcongruencymouldaudiovisualintegrationdependingonperceptualawareness |
_version_ |
1718385693482287104 |