Synchronized audio-visual transients drive efficient visual search for motion-in-depth.

In natural audio-visual environments, a change in depth is usually correlated with a change in loudness. In the present study, we investigated whether correlating changes in disparity and loudness would provide a functional advantage in binding disparity and sound amplitude in a visual search paradi...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Marina Zannoli, John Cass, Pascal Mamassian, David Alais
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2012
Materias:
R
Q
Acceso en línea:https://doaj.org/article/aa8866c7ca0546ac8eeb0ef9dab3275f
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:aa8866c7ca0546ac8eeb0ef9dab3275f
record_format dspace
spelling oai:doaj.org-article:aa8866c7ca0546ac8eeb0ef9dab3275f2021-11-18T07:18:18ZSynchronized audio-visual transients drive efficient visual search for motion-in-depth.1932-620310.1371/journal.pone.0037190https://doaj.org/article/aa8866c7ca0546ac8eeb0ef9dab3275f2012-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/22615939/pdf/?tool=EBIhttps://doaj.org/toc/1932-6203In natural audio-visual environments, a change in depth is usually correlated with a change in loudness. In the present study, we investigated whether correlating changes in disparity and loudness would provide a functional advantage in binding disparity and sound amplitude in a visual search paradigm. To test this hypothesis, we used a method similar to that used by van der Burg et al. to show that non-spatial transient (square-wave) modulations of loudness can drastically improve spatial visual search for a correlated luminance modulation. We used dynamic random-dot stereogram displays to produce pure disparity modulations. Target and distractors were small disparity-defined squares (either 6 or 10 in total). Each square moved back and forth in depth in front of the background plane at different phases. The target's depth modulation was synchronized with an amplitude-modulated auditory tone. Visual and auditory modulations were always congruent (both sine-wave or square-wave). In a speeded search task, five observers were asked to identify the target as quickly as possible. Results show a significant improvement in visual search times in the square-wave condition compared to the sine condition, suggesting that transient auditory information can efficiently drive visual search in the disparity domain. In a second experiment, participants performed the same task in the absence of sound and showed a clear set-size effect in both modulation conditions. In a third experiment, we correlated the sound with a distractor instead of the target. This produced longer search times, indicating that the correlation is not easily ignored.Marina ZannoliJohn CassPascal MamassianDavid AlaisPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 7, Iss 5, p e37190 (2012)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Marina Zannoli
John Cass
Pascal Mamassian
David Alais
Synchronized audio-visual transients drive efficient visual search for motion-in-depth.
description In natural audio-visual environments, a change in depth is usually correlated with a change in loudness. In the present study, we investigated whether correlating changes in disparity and loudness would provide a functional advantage in binding disparity and sound amplitude in a visual search paradigm. To test this hypothesis, we used a method similar to that used by van der Burg et al. to show that non-spatial transient (square-wave) modulations of loudness can drastically improve spatial visual search for a correlated luminance modulation. We used dynamic random-dot stereogram displays to produce pure disparity modulations. Target and distractors were small disparity-defined squares (either 6 or 10 in total). Each square moved back and forth in depth in front of the background plane at different phases. The target's depth modulation was synchronized with an amplitude-modulated auditory tone. Visual and auditory modulations were always congruent (both sine-wave or square-wave). In a speeded search task, five observers were asked to identify the target as quickly as possible. Results show a significant improvement in visual search times in the square-wave condition compared to the sine condition, suggesting that transient auditory information can efficiently drive visual search in the disparity domain. In a second experiment, participants performed the same task in the absence of sound and showed a clear set-size effect in both modulation conditions. In a third experiment, we correlated the sound with a distractor instead of the target. This produced longer search times, indicating that the correlation is not easily ignored.
format article
author Marina Zannoli
John Cass
Pascal Mamassian
David Alais
author_facet Marina Zannoli
John Cass
Pascal Mamassian
David Alais
author_sort Marina Zannoli
title Synchronized audio-visual transients drive efficient visual search for motion-in-depth.
title_short Synchronized audio-visual transients drive efficient visual search for motion-in-depth.
title_full Synchronized audio-visual transients drive efficient visual search for motion-in-depth.
title_fullStr Synchronized audio-visual transients drive efficient visual search for motion-in-depth.
title_full_unstemmed Synchronized audio-visual transients drive efficient visual search for motion-in-depth.
title_sort synchronized audio-visual transients drive efficient visual search for motion-in-depth.
publisher Public Library of Science (PLoS)
publishDate 2012
url https://doaj.org/article/aa8866c7ca0546ac8eeb0ef9dab3275f
work_keys_str_mv AT marinazannoli synchronizedaudiovisualtransientsdriveefficientvisualsearchformotionindepth
AT johncass synchronizedaudiovisualtransientsdriveefficientvisualsearchformotionindepth
AT pascalmamassian synchronizedaudiovisualtransientsdriveefficientvisualsearchformotionindepth
AT davidalais synchronizedaudiovisualtransientsdriveefficientvisualsearchformotionindepth
_version_ 1718423685032837120