Speech-driven embodied entrainment character system with pupillary response

We have developed a speech-driven embodied entrainment character called “InterActor” that has functions of both speaker and listener for supporting human interaction and communication. This character would generate communicative actions and movements such as nodding, body movements, and eyeball move...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Yoshihiro SEJIMA, Yoichiro SATO, Tomio WATANABE, Mitsuru JINDAI
Formato:	article
Lenguaje:	EN
Publicado:	The Japan Society of Mechanical Engineers 2016
Materias:	human interaction nonverbal communication face-to-face communication line-of-sight pupillary response Mechanical engineering and machinery TJ1-1570
Acceso en línea:	https://doaj.org/article/ade2dd0cbf1549c481205b3790b8d21b
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:ade2dd0cbf1549c481205b3790b8d21b
record_format	dspace
spelling	oai:doaj.org-article:ade2dd0cbf1549c481205b3790b8d21b2021-11-26T06:53:45ZSpeech-driven embodied entrainment character system with pupillary response2187-974510.1299/mej.15-00314https://doaj.org/article/ade2dd0cbf1549c481205b3790b8d21b2016-07-01T00:00:00Zhttps://www.jstage.jst.go.jp/article/mej/3/4/3_15-00314/_pdf/-char/enhttps://doaj.org/toc/2187-9745We have developed a speech-driven embodied entrainment character called “InterActor” that has functions of both speaker and listener for supporting human interaction and communication. This character would generate communicative actions and movements such as nodding, body movements, and eyeball movements by using only speech input. In this study, we focus specifically on the pupillary responses related to human emotions in embodied interaction and communication. Pupillary responses in human face-to-face communication are analyzed using an embodied communication system with a line-of-sight measurement device. Based on the analysis results, we enhance the functions of the character and develop an advanced speech-driven embodied entrainment character system for conveying empathy. Using only speech input, this system changes the pupil size of characters based on the analysis. Through sensory evaluation, we perform experiments to determine the effects of the developed system. The results reveal that the system is effective in human interaction and communication.Yoshihiro SEJIMAYoichiro SATOTomio WATANABEMitsuru JINDAIThe Japan Society of Mechanical Engineersarticlehuman interactionnonverbal communicationface-to-face communicationline-of-sightpupillary responseMechanical engineering and machineryTJ1-1570ENMechanical Engineering Journal, Vol 3, Iss 4, Pp 15-00314-15-00314 (2016)
institution	DOAJ
collection	DOAJ
language	EN
topic	human interaction nonverbal communication face-to-face communication line-of-sight pupillary response Mechanical engineering and machinery TJ1-1570
spellingShingle	human interaction nonverbal communication face-to-face communication line-of-sight pupillary response Mechanical engineering and machinery TJ1-1570 Yoshihiro SEJIMA Yoichiro SATO Tomio WATANABE Mitsuru JINDAI Speech-driven embodied entrainment character system with pupillary response
description	We have developed a speech-driven embodied entrainment character called “InterActor” that has functions of both speaker and listener for supporting human interaction and communication. This character would generate communicative actions and movements such as nodding, body movements, and eyeball movements by using only speech input. In this study, we focus specifically on the pupillary responses related to human emotions in embodied interaction and communication. Pupillary responses in human face-to-face communication are analyzed using an embodied communication system with a line-of-sight measurement device. Based on the analysis results, we enhance the functions of the character and develop an advanced speech-driven embodied entrainment character system for conveying empathy. Using only speech input, this system changes the pupil size of characters based on the analysis. Through sensory evaluation, we perform experiments to determine the effects of the developed system. The results reveal that the system is effective in human interaction and communication.
format	article
author	Yoshihiro SEJIMA Yoichiro SATO Tomio WATANABE Mitsuru JINDAI
author_facet	Yoshihiro SEJIMA Yoichiro SATO Tomio WATANABE Mitsuru JINDAI
author_sort	Yoshihiro SEJIMA
title	Speech-driven embodied entrainment character system with pupillary response
title_short	Speech-driven embodied entrainment character system with pupillary response
title_full	Speech-driven embodied entrainment character system with pupillary response
title_fullStr	Speech-driven embodied entrainment character system with pupillary response
title_full_unstemmed	Speech-driven embodied entrainment character system with pupillary response
title_sort	speech-driven embodied entrainment character system with pupillary response
publisher	The Japan Society of Mechanical Engineers
publishDate	2016
url	https://doaj.org/article/ade2dd0cbf1549c481205b3790b8d21b
work_keys_str_mv	AT yoshihirosejima speechdrivenembodiedentrainmentcharactersystemwithpupillaryresponse AT yoichirosato speechdrivenembodiedentrainmentcharactersystemwithpupillaryresponse AT tomiowatanabe speechdrivenembodiedentrainmentcharactersystemwithpupillaryresponse AT mitsurujindai speechdrivenembodiedentrainmentcharactersystemwithpupillaryresponse
_version_	1718409739519393792

Speech-driven embodied entrainment character system with pupillary response

Ejemplares similares