A Smart Mirror for Emotion Monitoring in Home Environments

Smart mirrors are devices that can display any kind of information and can interact with the user using touch and voice commands. Different kinds of smart mirrors exist: general purpose, medical, fashion, and other task specific ones. General purpose smart mirrors are suitable for home environments...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Simone Bianco, Luigi Celona, Gianluigi Ciocca, Davide Marelli, Paolo Napoletano, Stefano Yu, Raimondo Schettini
Formato: article
Lenguaje:EN
Publicado: MDPI AG 2021
Materias:
Acceso en línea:https://doaj.org/article/ad9eafc86f9a442dbbc8f3983a1bbf32
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:ad9eafc86f9a442dbbc8f3983a1bbf32
record_format dspace
spelling oai:doaj.org-article:ad9eafc86f9a442dbbc8f3983a1bbf322021-11-25T18:56:33ZA Smart Mirror for Emotion Monitoring in Home Environments10.3390/s212274531424-8220https://doaj.org/article/ad9eafc86f9a442dbbc8f3983a1bbf322021-11-01T00:00:00Zhttps://www.mdpi.com/1424-8220/21/22/7453https://doaj.org/toc/1424-8220Smart mirrors are devices that can display any kind of information and can interact with the user using touch and voice commands. Different kinds of smart mirrors exist: general purpose, medical, fashion, and other task specific ones. General purpose smart mirrors are suitable for home environments but the exiting ones offer similar, limited functionalities. In this paper, we present a general-purpose smart mirror that integrates several functionalities, standard and advanced, to support users in their everyday life. Among the advanced functionalities are the capabilities of detecting a person’s emotions, the short- and long-term monitoring and analysis of the emotions, a double authentication protocol to preserve the privacy, and the integration of Alexa Skills to extend the applications of the smart mirrors. We exploit a deep learning technique to develop most of the smart functionalities. The effectiveness of the device is demonstrated by the performances of the implemented functionalities, and the evaluation in terms of its usability with real users.Simone BiancoLuigi CelonaGianluigi CioccaDavide MarelliPaolo NapoletanoStefano YuRaimondo SchettiniMDPI AGarticlesmart mirroraffective computingmultimodal interactionRaspberry Pideep learninginternet of thingsChemical technologyTP1-1185ENSensors, Vol 21, Iss 7453, p 7453 (2021)
institution DOAJ
collection DOAJ
language EN
topic smart mirror
affective computing
multimodal interaction
Raspberry Pi
deep learning
internet of things
Chemical technology
TP1-1185
spellingShingle smart mirror
affective computing
multimodal interaction
Raspberry Pi
deep learning
internet of things
Chemical technology
TP1-1185
Simone Bianco
Luigi Celona
Gianluigi Ciocca
Davide Marelli
Paolo Napoletano
Stefano Yu
Raimondo Schettini
A Smart Mirror for Emotion Monitoring in Home Environments
description Smart mirrors are devices that can display any kind of information and can interact with the user using touch and voice commands. Different kinds of smart mirrors exist: general purpose, medical, fashion, and other task specific ones. General purpose smart mirrors are suitable for home environments but the exiting ones offer similar, limited functionalities. In this paper, we present a general-purpose smart mirror that integrates several functionalities, standard and advanced, to support users in their everyday life. Among the advanced functionalities are the capabilities of detecting a person’s emotions, the short- and long-term monitoring and analysis of the emotions, a double authentication protocol to preserve the privacy, and the integration of Alexa Skills to extend the applications of the smart mirrors. We exploit a deep learning technique to develop most of the smart functionalities. The effectiveness of the device is demonstrated by the performances of the implemented functionalities, and the evaluation in terms of its usability with real users.
format article
author Simone Bianco
Luigi Celona
Gianluigi Ciocca
Davide Marelli
Paolo Napoletano
Stefano Yu
Raimondo Schettini
author_facet Simone Bianco
Luigi Celona
Gianluigi Ciocca
Davide Marelli
Paolo Napoletano
Stefano Yu
Raimondo Schettini
author_sort Simone Bianco
title A Smart Mirror for Emotion Monitoring in Home Environments
title_short A Smart Mirror for Emotion Monitoring in Home Environments
title_full A Smart Mirror for Emotion Monitoring in Home Environments
title_fullStr A Smart Mirror for Emotion Monitoring in Home Environments
title_full_unstemmed A Smart Mirror for Emotion Monitoring in Home Environments
title_sort smart mirror for emotion monitoring in home environments
publisher MDPI AG
publishDate 2021
url https://doaj.org/article/ad9eafc86f9a442dbbc8f3983a1bbf32
work_keys_str_mv AT simonebianco asmartmirrorforemotionmonitoringinhomeenvironments
AT luigicelona asmartmirrorforemotionmonitoringinhomeenvironments
AT gianluigiciocca asmartmirrorforemotionmonitoringinhomeenvironments
AT davidemarelli asmartmirrorforemotionmonitoringinhomeenvironments
AT paolonapoletano asmartmirrorforemotionmonitoringinhomeenvironments
AT stefanoyu asmartmirrorforemotionmonitoringinhomeenvironments
AT raimondoschettini asmartmirrorforemotionmonitoringinhomeenvironments
AT simonebianco smartmirrorforemotionmonitoringinhomeenvironments
AT luigicelona smartmirrorforemotionmonitoringinhomeenvironments
AT gianluigiciocca smartmirrorforemotionmonitoringinhomeenvironments
AT davidemarelli smartmirrorforemotionmonitoringinhomeenvironments
AT paolonapoletano smartmirrorforemotionmonitoringinhomeenvironments
AT stefanoyu smartmirrorforemotionmonitoringinhomeenvironments
AT raimondoschettini smartmirrorforemotionmonitoringinhomeenvironments
_version_ 1718410546205687808