An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals

This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain–computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulatio...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Saugat Bhattacharyya, Mitsuhiro Hayashibe
Formato: article
Lenguaje:EN
Publicado: MDPI AG 2021
Materias:
Acceso en línea:https://doaj.org/article/5f944cc9a41f4c8cb8679b72c2c550ef
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:5f944cc9a41f4c8cb8679b72c2c550ef
record_format dspace
spelling oai:doaj.org-article:5f944cc9a41f4c8cb8679b72c2c550ef2021-11-25T16:56:26ZAn Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals10.3390/brainsci111113932076-3425https://doaj.org/article/5f944cc9a41f4c8cb8679b72c2c550ef2021-10-01T00:00:00Zhttps://www.mdpi.com/2076-3425/11/11/1393https://doaj.org/toc/2076-3425This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain–computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulation (FES) device and hence are somato-sensory in nature. The BCI system designed for this study activates an electrical stimulator placed on the left hand, right hand, left foot, and right foot of the user. Trials containing erroneous feedback can be detected from the neural signals in form of the error related potential (ErrP). The inclusion of neuro-feedback during the experiments indicated the possibility that ErrP signals can be evoked when the participant perceives an error from the feedback. Hence, to detect such feedback using ErrP, a transferable (offline) decoder based on optimal transport theory is introduced herein. The offline system detects single-trial erroneous trials from the feedback period of an online neuro-feedback BCI system. The results of the FES-based feedback BCI system were compared to a similar visual-based (VIS) feedback system. Using our framework, the error detector systems for both the FES and VIS feedback paradigms achieved an F1-score of 92.66% and 83.10%, respectively, and are significantly superior to a comparative system where an optimal transport was not used. It is expected that this form of transferable and automated error detection system compounded with a motor imagery system will augment the performance of a BCI and provide a better BCI-based neuro-rehabilitation protocol that has an error control mechanism embedded into it.Saugat BhattacharyyaMitsuhiro HayashibeMDPI AGarticlebrain–computer interfacingerror related potentialfunctional electrical stimulationsomato-sensory feedbackoptimal transporttransfer learningNeurosciences. Biological psychiatry. NeuropsychiatryRC321-571ENBrain Sciences, Vol 11, Iss 1393, p 1393 (2021)
institution DOAJ
collection DOAJ
language EN
topic brain–computer interfacing
error related potential
functional electrical stimulation
somato-sensory feedback
optimal transport
transfer learning
Neurosciences. Biological psychiatry. Neuropsychiatry
RC321-571
spellingShingle brain–computer interfacing
error related potential
functional electrical stimulation
somato-sensory feedback
optimal transport
transfer learning
Neurosciences. Biological psychiatry. Neuropsychiatry
RC321-571
Saugat Bhattacharyya
Mitsuhiro Hayashibe
An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
description This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain–computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulation (FES) device and hence are somato-sensory in nature. The BCI system designed for this study activates an electrical stimulator placed on the left hand, right hand, left foot, and right foot of the user. Trials containing erroneous feedback can be detected from the neural signals in form of the error related potential (ErrP). The inclusion of neuro-feedback during the experiments indicated the possibility that ErrP signals can be evoked when the participant perceives an error from the feedback. Hence, to detect such feedback using ErrP, a transferable (offline) decoder based on optimal transport theory is introduced herein. The offline system detects single-trial erroneous trials from the feedback period of an online neuro-feedback BCI system. The results of the FES-based feedback BCI system were compared to a similar visual-based (VIS) feedback system. Using our framework, the error detector systems for both the FES and VIS feedback paradigms achieved an F1-score of 92.66% and 83.10%, respectively, and are significantly superior to a comparative system where an optimal transport was not used. It is expected that this form of transferable and automated error detection system compounded with a motor imagery system will augment the performance of a BCI and provide a better BCI-based neuro-rehabilitation protocol that has an error control mechanism embedded into it.
format article
author Saugat Bhattacharyya
Mitsuhiro Hayashibe
author_facet Saugat Bhattacharyya
Mitsuhiro Hayashibe
author_sort Saugat Bhattacharyya
title An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
title_short An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
title_full An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
title_fullStr An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
title_full_unstemmed An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
title_sort optimal transport based transferable system for detection of erroneous somato-sensory feedback from neural signals
publisher MDPI AG
publishDate 2021
url https://doaj.org/article/5f944cc9a41f4c8cb8679b72c2c550ef
work_keys_str_mv AT saugatbhattacharyya anoptimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals
AT mitsuhirohayashibe anoptimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals
AT saugatbhattacharyya optimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals
AT mitsuhirohayashibe optimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals
_version_ 1718412838711590912