Speakers exhibit a multimodal Lombard effect in noise

Abstract In everyday conversation, we are often challenged with communicating in non-ideal settings, such as in noise. Increased speech intensity and larger mouth movements are used to overcome noise in constrained settings (the Lombard effect). How we adapt to noise in face-to-face interaction, the...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	James Trujillo, Asli Özyürek, Judith Holler, Linda Drijvers
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2021
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/8be156d3ce0f4253b9c405c6bdb00439
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:8be156d3ce0f4253b9c405c6bdb00439
record_format	dspace
spelling	oai:doaj.org-article:8be156d3ce0f4253b9c405c6bdb004392021-12-02T17:08:44ZSpeakers exhibit a multimodal Lombard effect in noise10.1038/s41598-021-95791-02045-2322https://doaj.org/article/8be156d3ce0f4253b9c405c6bdb004392021-08-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-95791-0https://doaj.org/toc/2045-2322Abstract In everyday conversation, we are often challenged with communicating in non-ideal settings, such as in noise. Increased speech intensity and larger mouth movements are used to overcome noise in constrained settings (the Lombard effect). How we adapt to noise in face-to-face interaction, the natural environment of human language use, where manual gestures are ubiquitous, is currently unknown. We asked Dutch adults to wear headphones with varying levels of multi-talker babble while attempting to communicate action verbs to one another. Using quantitative motion capture and acoustic analyses, we found that (1) noise is associated with increased speech intensity and enhanced gesture kinematics and mouth movements, and (2) acoustic modulation only occurs when gestures are not present, while kinematic modulation occurs regardless of co-occurring speech. Thus, in face-to-face encounters the Lombard effect is not constrained to speech but is a multimodal phenomenon where the visual channel carries most of the communicative burden.James TrujilloAsli ÖzyürekJudith HollerLinda DrijversNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-12 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q James Trujillo Asli Özyürek Judith Holler Linda Drijvers Speakers exhibit a multimodal Lombard effect in noise
description	Abstract In everyday conversation, we are often challenged with communicating in non-ideal settings, such as in noise. Increased speech intensity and larger mouth movements are used to overcome noise in constrained settings (the Lombard effect). How we adapt to noise in face-to-face interaction, the natural environment of human language use, where manual gestures are ubiquitous, is currently unknown. We asked Dutch adults to wear headphones with varying levels of multi-talker babble while attempting to communicate action verbs to one another. Using quantitative motion capture and acoustic analyses, we found that (1) noise is associated with increased speech intensity and enhanced gesture kinematics and mouth movements, and (2) acoustic modulation only occurs when gestures are not present, while kinematic modulation occurs regardless of co-occurring speech. Thus, in face-to-face encounters the Lombard effect is not constrained to speech but is a multimodal phenomenon where the visual channel carries most of the communicative burden.
format	article
author	James Trujillo Asli Özyürek Judith Holler Linda Drijvers
author_facet	James Trujillo Asli Özyürek Judith Holler Linda Drijvers
author_sort	James Trujillo
title	Speakers exhibit a multimodal Lombard effect in noise
title_short	Speakers exhibit a multimodal Lombard effect in noise
title_full	Speakers exhibit a multimodal Lombard effect in noise
title_fullStr	Speakers exhibit a multimodal Lombard effect in noise
title_full_unstemmed	Speakers exhibit a multimodal Lombard effect in noise
title_sort	speakers exhibit a multimodal lombard effect in noise
publisher	Nature Portfolio
publishDate	2021
url	https://doaj.org/article/8be156d3ce0f4253b9c405c6bdb00439
work_keys_str_mv	AT jamestrujillo speakersexhibitamultimodallombardeffectinnoise AT asliozyurek speakersexhibitamultimodallombardeffectinnoise AT judithholler speakersexhibitamultimodallombardeffectinnoise AT lindadrijvers speakersexhibitamultimodallombardeffectinnoise
_version_	1718381510759809024

Speakers exhibit a multimodal Lombard effect in noise

Ejemplares similares