Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects

Abstract Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Saurabh Sonkusare, Michael Breakspear, Tianji Pang, Vinh Thai Nguyen, Sascha Frydman, Christine Cong Guo, Matthew J. Aburn
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2021
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/82f0b2c375ca459fa9ad58d3a446054b
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:82f0b2c375ca459fa9ad58d3a446054b
record_format	dspace
spelling	oai:doaj.org-article:82f0b2c375ca459fa9ad58d3a446054b2021-12-02T17:52:42ZData-driven analysis of facial thermal responses and multimodal physiological consistency among subjects10.1038/s41598-021-91578-52045-2322https://doaj.org/article/82f0b2c375ca459fa9ad58d3a446054b2021-06-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-91578-5https://doaj.org/toc/2045-2322Abstract Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a novel application of motion correction and the results of spatial independent component analysis of the thermal data. Three distinct spatial components are recovered associated with the nose, the cheeks and respiration. We first benchmark this methodology against a traditional nose-tip region-of-interest based technique showing an expected similarity of signals extracted by these methods. We then show significant correlation of all the physiological responses across subjects, including the thermal signals, suggesting common dynamic shifts in emotional state induced by the movie. In sum, this study introduces an innovative approach to analyse facial IRI data and highlights the potential of thermal imaging to robustly capture emotion-related changes induced by ecological stimuli.Saurabh SonkusareMichael BreakspearTianji PangVinh Thai NguyenSascha FrydmanChristine Cong GuoMatthew J. AburnNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-12 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Saurabh Sonkusare Michael Breakspear Tianji Pang Vinh Thai Nguyen Sascha Frydman Christine Cong Guo Matthew J. Aburn Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
description	Abstract Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a novel application of motion correction and the results of spatial independent component analysis of the thermal data. Three distinct spatial components are recovered associated with the nose, the cheeks and respiration. We first benchmark this methodology against a traditional nose-tip region-of-interest based technique showing an expected similarity of signals extracted by these methods. We then show significant correlation of all the physiological responses across subjects, including the thermal signals, suggesting common dynamic shifts in emotional state induced by the movie. In sum, this study introduces an innovative approach to analyse facial IRI data and highlights the potential of thermal imaging to robustly capture emotion-related changes induced by ecological stimuli.
format	article
author	Saurabh Sonkusare Michael Breakspear Tianji Pang Vinh Thai Nguyen Sascha Frydman Christine Cong Guo Matthew J. Aburn
author_facet	Saurabh Sonkusare Michael Breakspear Tianji Pang Vinh Thai Nguyen Sascha Frydman Christine Cong Guo Matthew J. Aburn
author_sort	Saurabh Sonkusare
title	Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
title_short	Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
title_full	Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
title_fullStr	Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
title_full_unstemmed	Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
title_sort	data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects
publisher	Nature Portfolio
publishDate	2021
url	https://doaj.org/article/82f0b2c375ca459fa9ad58d3a446054b
work_keys_str_mv	AT saurabhsonkusare datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT michaelbreakspear datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT tianjipang datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT vinhthainguyen datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT saschafrydman datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT christinecongguo datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects AT matthewjaburn datadrivenanalysisoffacialthermalresponsesandmultimodalphysiologicalconsistencyamongsubjects
_version_	1718379177163358208

Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects

Ejemplares similares