Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking
Noncontact human-computer interaction has an important value in wireless sensor networks. This work is aimed at achieving accurate interaction on a computer based on auto eye control, using a cheap webcam as the video source. A real-time accurate human-computer interaction system based on eye state...
Guardado en:
Autores principales: | , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Hindawi-Wiley
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/6586367782ac4030b7a8f1d49898a486 |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:6586367782ac4030b7a8f1d49898a486 |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:6586367782ac4030b7a8f1d49898a4862021-11-22T01:09:51ZReal-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking1530-867710.1155/2021/8213946https://doaj.org/article/6586367782ac4030b7a8f1d49898a4862021-01-01T00:00:00Zhttp://dx.doi.org/10.1155/2021/8213946https://doaj.org/toc/1530-8677Noncontact human-computer interaction has an important value in wireless sensor networks. This work is aimed at achieving accurate interaction on a computer based on auto eye control, using a cheap webcam as the video source. A real-time accurate human-computer interaction system based on eye state recognition, rough gaze estimation, and tracking is proposed. Firstly, binary classification of the eye states (opening or closed) is carried on using the SVM classification algorithm with HOG features of the input eye image. Second, rough appearance-based gaze estimation is implemented based on a simple CNN model. And the head pose is estimated to judge whether the user is facing the screen or not. Based on these recognition results, noncontact mouse control and character input methods are designed and developed to replace the standard mouse and keyboard hardware. Accuracy and speed of the proposed interaction system are evaluated by four subjects. The experimental results show that users can use only a common monocular camera to achieve gaze estimation and tracking and to achieve most functions of real-time precise human-computer interaction on the basis of auto eye control.Junhao HuangZhicheng ZhangGuoping XieHui HeHindawi-WileyarticleTechnologyTTelecommunicationTK5101-6720ENWireless Communications and Mobile Computing, Vol 2021 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Technology T Telecommunication TK5101-6720 |
spellingShingle |
Technology T Telecommunication TK5101-6720 Junhao Huang Zhicheng Zhang Guoping Xie Hui He Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking |
description |
Noncontact human-computer interaction has an important value in wireless sensor networks. This work is aimed at achieving accurate interaction on a computer based on auto eye control, using a cheap webcam as the video source. A real-time accurate human-computer interaction system based on eye state recognition, rough gaze estimation, and tracking is proposed. Firstly, binary classification of the eye states (opening or closed) is carried on using the SVM classification algorithm with HOG features of the input eye image. Second, rough appearance-based gaze estimation is implemented based on a simple CNN model. And the head pose is estimated to judge whether the user is facing the screen or not. Based on these recognition results, noncontact mouse control and character input methods are designed and developed to replace the standard mouse and keyboard hardware. Accuracy and speed of the proposed interaction system are evaluated by four subjects. The experimental results show that users can use only a common monocular camera to achieve gaze estimation and tracking and to achieve most functions of real-time precise human-computer interaction on the basis of auto eye control. |
format |
article |
author |
Junhao Huang Zhicheng Zhang Guoping Xie Hui He |
author_facet |
Junhao Huang Zhicheng Zhang Guoping Xie Hui He |
author_sort |
Junhao Huang |
title |
Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking |
title_short |
Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking |
title_full |
Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking |
title_fullStr |
Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking |
title_full_unstemmed |
Real-Time Precise Human-Computer Interaction System Based on Gaze Estimation and Tracking |
title_sort |
real-time precise human-computer interaction system based on gaze estimation and tracking |
publisher |
Hindawi-Wiley |
publishDate |
2021 |
url |
https://doaj.org/article/6586367782ac4030b7a8f1d49898a486 |
work_keys_str_mv |
AT junhaohuang realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking AT zhichengzhang realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking AT guopingxie realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking AT huihe realtimeprecisehumancomputerinteractionsystembasedongazeestimationandtracking |
_version_ |
1718418404637933568 |