Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking

Noncontact human-computer interaction has an important value in wireless sensor networks. This work is aimed at achieving accurate interaction on a computer based on auto eye control, using a cheap webcam as the video source. A real-time accurate human-computer interaction system based on eye state...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Junhao Huang, Zhicheng Zhang, Guoping Xie, Hui He
Formato: article
Lenguaje:EN
Publicado: Hindawi-Wiley 2021
Materias:
T
Acceso en línea:https://doaj.org/article/6586367782ac4030b7a8f1d49898a486
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:6586367782ac4030b7a8f1d49898a486
record_format dspace
spelling oai:doaj.org-article:6586367782ac4030b7a8f1d49898a4862021-11-22T01:09:51ZReal-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking1530-867710.1155/2021/8213946https://doaj.org/article/6586367782ac4030b7a8f1d49898a4862021-01-01T00:00:00Zhttp://dx.doi.org/10.1155/2021/8213946https://doaj.org/toc/1530-8677Noncontact human-computer interaction has an important value in wireless sensor networks. This work is aimed at achieving accurate interaction on a computer based on auto eye control, using a cheap webcam as the video source. A real-time accurate human-computer interaction system based on eye state recognition, rough gaze estimation, and tracking is proposed. Firstly, binary classification of the eye states (opening or closed) is carried on using the SVM classification algorithm with HOG features of the input eye image. Second, rough appearance-based gaze estimation is implemented based on a simple CNN model. And the head pose is estimated to judge whether the user is facing the screen or not. Based on these recognition results, noncontact mouse control and character input methods are designed and developed to replace the standard mouse and keyboard hardware. Accuracy and speed of the proposed interaction system are evaluated by four subjects. The experimental results show that users can use only a common monocular camera to achieve gaze estimation and tracking and to achieve most functions of real-time precise human-computer interaction on the basis of auto eye control.Junhao HuangZhicheng ZhangGuoping XieHui HeHindawi-WileyarticleTechnologyTTelecommunicationTK5101-6720ENWireless Communications and Mobile Computing, Vol 2021 (2021)
institution DOAJ
collection DOAJ
language EN
topic Technology
T
Telecommunication
TK5101-6720
spellingShingle Technology
T
Telecommunication
TK5101-6720
Junhao Huang
Zhicheng Zhang
Guoping Xie
Hui He
Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
description Noncontact human-computer interaction has an important value in wireless sensor networks. This work is aimed at achieving accurate interaction on a computer based on auto eye control, using a cheap webcam as the video source. A real-time accurate human-computer interaction system based on eye state recognition, rough gaze estimation, and tracking is proposed. Firstly, binary classification of the eye states (opening or closed) is carried on using the SVM classification algorithm with HOG features of the input eye image. Second, rough appearance-based gaze estimation is implemented based on a simple CNN model. And the head pose is estimated to judge whether the user is facing the screen or not. Based on these recognition results, noncontact mouse control and character input methods are designed and developed to replace the standard mouse and keyboard hardware. Accuracy and speed of the proposed interaction system are evaluated by four subjects. The experimental results show that users can use only a common monocular camera to achieve gaze estimation and tracking and to achieve most functions of real-time precise human-computer interaction on the basis of auto eye control.
format article
author Junhao Huang
Zhicheng Zhang
Guoping Xie
Hui He
author_facet Junhao Huang
Zhicheng Zhang
Guoping Xie
Hui He
author_sort Junhao Huang
title Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
title_short Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
title_full Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
title_fullStr Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
title_full_unstemmed Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
title_sort real-time precise human-computer interaction system based on gaze estimation and tracking
publisher Hindawi-Wiley
publishDate 2021
url https://doaj.org/article/6586367782ac4030b7a8f1d49898a486
work_keys_str_mv AT junhaohuang realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking
AT zhichengzhang realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking
AT guopingxie realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking
AT huihe realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking
_version_ 1718418404637933568