A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions

Abstract Recent progress in Affective Computing (AC) has enabled integration of physiological cues and spontaneous expressions to reveal a subject’s emotional state. Due to the lack of an effective technique for evaluating multimodal correlations, experience and intuition play a main role in present...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Fenglei Yang, Sijung Hu, Baomin Li, Vincent M. Dwyer, Harnani Hassan, Dong-Qing Wei, Ping Shi
Formato:	article
Lenguaje:	EN
Publicado:	Nature Portfolio 2017
Materias:	Medicine R Science Q
Acceso en línea:	https://doaj.org/article/03fbe706b9ad47cabecad88a36186ba9
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:03fbe706b9ad47cabecad88a36186ba9
record_format	dspace
spelling	oai:doaj.org-article:03fbe706b9ad47cabecad88a36186ba92021-12-02T16:06:23ZA Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions10.1038/s41598-017-07122-x2045-2322https://doaj.org/article/03fbe706b9ad47cabecad88a36186ba92017-08-01T00:00:00Zhttps://doi.org/10.1038/s41598-017-07122-xhttps://doaj.org/toc/2045-2322Abstract Recent progress in Affective Computing (AC) has enabled integration of physiological cues and spontaneous expressions to reveal a subject’s emotional state. Due to the lack of an effective technique for evaluating multimodal correlations, experience and intuition play a main role in present AC studies when fusing affective cues or modalities, resulting in unexpected outcomes. This study seeks to demonstrate a dynamic correlation between two such affective cues, physiological changes and spontaneous expressions, which were obtained by a combination of stereo vision based tracking and imaging photoplethysmography (iPPG), with a designed protocol involving 20 healthy subjects. The two cues obtained were sampled into a Statistical Association Space (SAS) to evaluate their dynamic correlation. It is found that the probability densities in the SAS increase as the peaks in two cues are approached. Also the complex form of the high probability density region in the SAS suggests a nonlinear correlation between two cues. Finally the cumulative distribution on the zero time-difference surface is found to be small (<0.047) demonstrating a lack of simultaneity. These results show that the two cues have a close interrelation, that is both asynchronous and nonlinear, in which a peak of one cue heralds a peak in the other.Fenglei YangSijung HuBaomin LiVincent M. DwyerHarnani HassanDong-Qing WeiPing ShiNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 7, Iss 1, Pp 1-12 (2017)
institution	DOAJ
collection	DOAJ
language	EN
topic	Medicine R Science Q
spellingShingle	Medicine R Science Q Fenglei Yang Sijung Hu Baomin Li Vincent M. Dwyer Harnani Hassan Dong-Qing Wei Ping Shi A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions
description	Abstract Recent progress in Affective Computing (AC) has enabled integration of physiological cues and spontaneous expressions to reveal a subject’s emotional state. Due to the lack of an effective technique for evaluating multimodal correlations, experience and intuition play a main role in present AC studies when fusing affective cues or modalities, resulting in unexpected outcomes. This study seeks to demonstrate a dynamic correlation between two such affective cues, physiological changes and spontaneous expressions, which were obtained by a combination of stereo vision based tracking and imaging photoplethysmography (iPPG), with a designed protocol involving 20 healthy subjects. The two cues obtained were sampled into a Statistical Association Space (SAS) to evaluate their dynamic correlation. It is found that the probability densities in the SAS increase as the peaks in two cues are approached. Also the complex form of the high probability density region in the SAS suggests a nonlinear correlation between two cues. Finally the cumulative distribution on the zero time-difference surface is found to be small (<0.047) demonstrating a lack of simultaneity. These results show that the two cues have a close interrelation, that is both asynchronous and nonlinear, in which a peak of one cue heralds a peak in the other.
format	article
author	Fenglei Yang Sijung Hu Baomin Li Vincent M. Dwyer Harnani Hassan Dong-Qing Wei Ping Shi
author_facet	Fenglei Yang Sijung Hu Baomin Li Vincent M. Dwyer Harnani Hassan Dong-Qing Wei Ping Shi
author_sort	Fenglei Yang
title	A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions
title_short	A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions
title_full	A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions
title_fullStr	A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions
title_full_unstemmed	A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions
title_sort	study of the dynamic relation between physiological changes and spontaneous expressions
publisher	Nature Portfolio
publishDate	2017
url	https://doaj.org/article/03fbe706b9ad47cabecad88a36186ba9
work_keys_str_mv	AT fengleiyang astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT sijunghu astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT baominli astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT vincentmdwyer astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT harnanihassan astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT dongqingwei astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT pingshi astudyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT fengleiyang studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT sijunghu studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT baominli studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT vincentmdwyer studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT harnanihassan studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT dongqingwei studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions AT pingshi studyofthedynamicrelationbetweenphysiologicalchangesandspontaneousexpressions
_version_	1718385004169396224

A Study of the Dynamic Relation between Physiological Changes and Spontaneous Expressions

Ejemplares similares