Substituting facial movements in singers changes the sounds of musical intervals

Abstract Cross-modal integration is ubiquitous within perception and, in humans, the McGurk effect demonstrates that seeing a person articulating speech can change what we hear into a new auditory percept. It remains unclear whether cross-modal integration of sight and sound generalizes to other vis...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Bruno Laeng, Sarjo Kuyateh, Tejaswinee Kelkar
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2021
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/548d301fdebf41d49deafd0953091d6d
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:548d301fdebf41d49deafd0953091d6d
record_format	dspace
spelling	oai:doaj.org-article:548d301fdebf41d49deafd0953091d6d2021-11-21T12:17:09ZSubstituting facial movements in singers changes the sounds of musical intervals10.1038/s41598-021-01797-z2045-2322https://doaj.org/article/548d301fdebf41d49deafd0953091d6d2021-11-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-01797-zhttps://doaj.org/toc/2045-2322Abstract Cross-modal integration is ubiquitous within perception and, in humans, the McGurk effect demonstrates that seeing a person articulating speech can change what we hear into a new auditory percept. It remains unclear whether cross-modal integration of sight and sound generalizes to other visible vocal articulations like those made by singers. We surmise that perceptual integrative effects should involve music deeply, since there is ample indeterminacy and variability in its auditory signals. We show that switching videos of sung musical intervals changes systematically the estimated distance between two notes of a musical interval so that pairing the video of a smaller sung interval to a relatively larger auditory led to compression effects on rated intervals, whereas the reverse led to a stretching effect. In addition, after seeing a visually switched video of an equally-tempered sung interval and then hearing the same interval played on the piano, the two intervals were judged often different though they differed only in instrument. These findings reveal spontaneous, cross-modal, integration of vocal sounds and clearly indicate that strong integration of sound and sight can occur beyond the articulations of natural speech.Bruno LaengSarjo KuyatehTejaswinee KelkarNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-10 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Bruno Laeng Sarjo Kuyateh Tejaswinee Kelkar Substituting facial movements in singers changes the sounds of musical intervals
description	Abstract Cross-modal integration is ubiquitous within perception and, in humans, the McGurk effect demonstrates that seeing a person articulating speech can change what we hear into a new auditory percept. It remains unclear whether cross-modal integration of sight and sound generalizes to other visible vocal articulations like those made by singers. We surmise that perceptual integrative effects should involve music deeply, since there is ample indeterminacy and variability in its auditory signals. We show that switching videos of sung musical intervals changes systematically the estimated distance between two notes of a musical interval so that pairing the video of a smaller sung interval to a relatively larger auditory led to compression effects on rated intervals, whereas the reverse led to a stretching effect. In addition, after seeing a visually switched video of an equally-tempered sung interval and then hearing the same interval played on the piano, the two intervals were judged often different though they differed only in instrument. These findings reveal spontaneous, cross-modal, integration of vocal sounds and clearly indicate that strong integration of sound and sight can occur beyond the articulations of natural speech.
format	article
author	Bruno Laeng Sarjo Kuyateh Tejaswinee Kelkar
author_facet	Bruno Laeng Sarjo Kuyateh Tejaswinee Kelkar
author_sort	Bruno Laeng
title	Substituting facial movements in singers changes the sounds of musical intervals
title_short	Substituting facial movements in singers changes the sounds of musical intervals
title_full	Substituting facial movements in singers changes the sounds of musical intervals
title_fullStr	Substituting facial movements in singers changes the sounds of musical intervals
title_full_unstemmed	Substituting facial movements in singers changes the sounds of musical intervals
title_sort	substituting facial movements in singers changes the sounds of musical intervals
publisher	Nature Portfolio
publishDate	2021
url	https://doaj.org/article/548d301fdebf41d49deafd0953091d6d
work_keys_str_mv	AT brunolaeng substitutingfacialmovementsinsingerschangesthesoundsofmusicalintervals AT sarjokuyateh substitutingfacialmovementsinsingerschangesthesoundsofmusicalintervals AT tejaswineekelkar substitutingfacialmovementsinsingerschangesthesoundsofmusicalintervals
_version_	1718419064854937600

Substituting facial movements in singers changes the sounds of musical intervals

Ejemplares similares