An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals
This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain–computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulatio...
Guardado en:
Autores principales: | , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
MDPI AG
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/5f944cc9a41f4c8cb8679b72c2c550ef |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:5f944cc9a41f4c8cb8679b72c2c550ef |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:5f944cc9a41f4c8cb8679b72c2c550ef2021-11-25T16:56:26ZAn Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals10.3390/brainsci111113932076-3425https://doaj.org/article/5f944cc9a41f4c8cb8679b72c2c550ef2021-10-01T00:00:00Zhttps://www.mdpi.com/2076-3425/11/11/1393https://doaj.org/toc/2076-3425This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain–computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulation (FES) device and hence are somato-sensory in nature. The BCI system designed for this study activates an electrical stimulator placed on the left hand, right hand, left foot, and right foot of the user. Trials containing erroneous feedback can be detected from the neural signals in form of the error related potential (ErrP). The inclusion of neuro-feedback during the experiments indicated the possibility that ErrP signals can be evoked when the participant perceives an error from the feedback. Hence, to detect such feedback using ErrP, a transferable (offline) decoder based on optimal transport theory is introduced herein. The offline system detects single-trial erroneous trials from the feedback period of an online neuro-feedback BCI system. The results of the FES-based feedback BCI system were compared to a similar visual-based (VIS) feedback system. Using our framework, the error detector systems for both the FES and VIS feedback paradigms achieved an F1-score of 92.66% and 83.10%, respectively, and are significantly superior to a comparative system where an optimal transport was not used. It is expected that this form of transferable and automated error detection system compounded with a motor imagery system will augment the performance of a BCI and provide a better BCI-based neuro-rehabilitation protocol that has an error control mechanism embedded into it.Saugat BhattacharyyaMitsuhiro HayashibeMDPI AGarticlebrain–computer interfacingerror related potentialfunctional electrical stimulationsomato-sensory feedbackoptimal transporttransfer learningNeurosciences. Biological psychiatry. NeuropsychiatryRC321-571ENBrain Sciences, Vol 11, Iss 1393, p 1393 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
brain–computer interfacing error related potential functional electrical stimulation somato-sensory feedback optimal transport transfer learning Neurosciences. Biological psychiatry. Neuropsychiatry RC321-571 |
spellingShingle |
brain–computer interfacing error related potential functional electrical stimulation somato-sensory feedback optimal transport transfer learning Neurosciences. Biological psychiatry. Neuropsychiatry RC321-571 Saugat Bhattacharyya Mitsuhiro Hayashibe An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals |
description |
This study is aimed at the detection of single-trial feedback, perceived as erroneous by the user, using a transferable classification system while conducting a motor imagery brain–computer interfacing (BCI) task. The feedback received by the users are relayed from a functional electrical stimulation (FES) device and hence are somato-sensory in nature. The BCI system designed for this study activates an electrical stimulator placed on the left hand, right hand, left foot, and right foot of the user. Trials containing erroneous feedback can be detected from the neural signals in form of the error related potential (ErrP). The inclusion of neuro-feedback during the experiments indicated the possibility that ErrP signals can be evoked when the participant perceives an error from the feedback. Hence, to detect such feedback using ErrP, a transferable (offline) decoder based on optimal transport theory is introduced herein. The offline system detects single-trial erroneous trials from the feedback period of an online neuro-feedback BCI system. The results of the FES-based feedback BCI system were compared to a similar visual-based (VIS) feedback system. Using our framework, the error detector systems for both the FES and VIS feedback paradigms achieved an F1-score of 92.66% and 83.10%, respectively, and are significantly superior to a comparative system where an optimal transport was not used. It is expected that this form of transferable and automated error detection system compounded with a motor imagery system will augment the performance of a BCI and provide a better BCI-based neuro-rehabilitation protocol that has an error control mechanism embedded into it. |
format |
article |
author |
Saugat Bhattacharyya Mitsuhiro Hayashibe |
author_facet |
Saugat Bhattacharyya Mitsuhiro Hayashibe |
author_sort |
Saugat Bhattacharyya |
title |
An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals |
title_short |
An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals |
title_full |
An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals |
title_fullStr |
An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals |
title_full_unstemmed |
An Optimal Transport Based Transferable System for Detection of Erroneous Somato-Sensory Feedback from Neural Signals |
title_sort |
optimal transport based transferable system for detection of erroneous somato-sensory feedback from neural signals |
publisher |
MDPI AG |
publishDate |
2021 |
url |
https://doaj.org/article/5f944cc9a41f4c8cb8679b72c2c550ef |
work_keys_str_mv |
AT saugatbhattacharyya anoptimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals AT mitsuhirohayashibe anoptimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals AT saugatbhattacharyya optimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals AT mitsuhirohayashibe optimaltransportbasedtransferablesystemfordetectionoferroneoussomatosensoryfeedbackfromneuralsignals |
_version_ |
1718412838711590912 |