Adaptive attention-based human machine interface system for teleoperation of industrial vehicle

Abstract This study proposes a Human Machine Interface (HMI) system with adaptive visual stimuli to facilitate teleoperation of industrial vehicles such as forklifts. The proposed system estimates the context/work state during teleoperation and presents the optimal visual stimuli on the display of H...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Jouh Yeong Chew, Mitsuru Kawamoto, Takashi Okuma, Eiichi Yoshida, Norihiko Kato
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/844ccb995b9e477f995ac4f2b74d030f
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:844ccb995b9e477f995ac4f2b74d030f
record_format dspace
spelling oai:doaj.org-article:844ccb995b9e477f995ac4f2b74d030f2021-12-02T18:53:19ZAdaptive attention-based human machine interface system for teleoperation of industrial vehicle10.1038/s41598-021-96682-02045-2322https://doaj.org/article/844ccb995b9e477f995ac4f2b74d030f2021-08-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-96682-0https://doaj.org/toc/2045-2322Abstract This study proposes a Human Machine Interface (HMI) system with adaptive visual stimuli to facilitate teleoperation of industrial vehicles such as forklifts. The proposed system estimates the context/work state during teleoperation and presents the optimal visual stimuli on the display of HMI. Such adaptability is supported by behavioral models which are developed from behavioral data of conventional/manned forklift operation. The proposed system consists of two models, i.e., gaze attention and work state transition models which are defined by gaze fixations and operation pattern of operators, respectively. In short, the proposed system estimates and shows the optimal visual stimuli on the display of HMI based on temporal operation pattern. The usability of teleoperation system is evaluated by comparing the perceived workload elicited by different types of HMI. The results suggest the adaptive attention-based HMI system outperforms the non-adaptive HMI, where the perceived workload is consistently lower as responded by different categories of forklift operators.Jouh Yeong ChewMitsuru KawamotoTakashi OkumaEiichi YoshidaNorihiko KatoNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-14 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Jouh Yeong Chew
Mitsuru Kawamoto
Takashi Okuma
Eiichi Yoshida
Norihiko Kato
Adaptive attention-based human machine interface system for teleoperation of industrial vehicle
description Abstract This study proposes a Human Machine Interface (HMI) system with adaptive visual stimuli to facilitate teleoperation of industrial vehicles such as forklifts. The proposed system estimates the context/work state during teleoperation and presents the optimal visual stimuli on the display of HMI. Such adaptability is supported by behavioral models which are developed from behavioral data of conventional/manned forklift operation. The proposed system consists of two models, i.e., gaze attention and work state transition models which are defined by gaze fixations and operation pattern of operators, respectively. In short, the proposed system estimates and shows the optimal visual stimuli on the display of HMI based on temporal operation pattern. The usability of teleoperation system is evaluated by comparing the perceived workload elicited by different types of HMI. The results suggest the adaptive attention-based HMI system outperforms the non-adaptive HMI, where the perceived workload is consistently lower as responded by different categories of forklift operators.
format article
author Jouh Yeong Chew
Mitsuru Kawamoto
Takashi Okuma
Eiichi Yoshida
Norihiko Kato
author_facet Jouh Yeong Chew
Mitsuru Kawamoto
Takashi Okuma
Eiichi Yoshida
Norihiko Kato
author_sort Jouh Yeong Chew
title Adaptive attention-based human machine interface system for teleoperation of industrial vehicle
title_short Adaptive attention-based human machine interface system for teleoperation of industrial vehicle
title_full Adaptive attention-based human machine interface system for teleoperation of industrial vehicle
title_fullStr Adaptive attention-based human machine interface system for teleoperation of industrial vehicle
title_full_unstemmed Adaptive attention-based human machine interface system for teleoperation of industrial vehicle
title_sort adaptive attention-based human machine interface system for teleoperation of industrial vehicle
publisher Nature Portfolio
publishDate 2021
url https://doaj.org/article/844ccb995b9e477f995ac4f2b74d030f
work_keys_str_mv AT jouhyeongchew adaptiveattentionbasedhumanmachineinterfacesystemforteleoperationofindustrialvehicle
AT mitsurukawamoto adaptiveattentionbasedhumanmachineinterfacesystemforteleoperationofindustrialvehicle
AT takashiokuma adaptiveattentionbasedhumanmachineinterfacesystemforteleoperationofindustrialvehicle
AT eiichiyoshida adaptiveattentionbasedhumanmachineinterfacesystemforteleoperationofindustrialvehicle
AT norihikokato adaptiveattentionbasedhumanmachineinterfacesystemforteleoperationofindustrialvehicle
_version_ 1718377337738756096