Performance evaluation of an automated single-channel sleep–wake detection algorithm

Richard F Kaplan,1 Ying Wang,1 Kenneth A Loparo,1,2 Monica R Kelly,3 Richard R Bootzin3 1General Sleep Corporation, Euclid, OH, USA; 2Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH, USA; 3Department of Psychology, University of Arizona, Tuc...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Kaplan RF, Wang Y, Loparo KA, Kelly MR, Bootzin RR
Formato: article
Lenguaje:EN
Publicado: Dove Medical Press 2014
Materias:
Acceso en línea:https://doaj.org/article/827600b4bd394256b9bfc3598cb53219
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:827600b4bd394256b9bfc3598cb53219
record_format dspace
spelling oai:doaj.org-article:827600b4bd394256b9bfc3598cb532192021-12-02T01:32:41ZPerformance evaluation of an automated single-channel sleep–wake detection algorithm1179-1608https://doaj.org/article/827600b4bd394256b9bfc3598cb532192014-10-01T00:00:00Zhttp://www.dovepress.com/performance-evaluation-of-an-automated-single-channel-sleepndashwake-d-peer-reviewed-article-NSShttps://doaj.org/toc/1179-1608 Richard F Kaplan,1 Ying Wang,1 Kenneth A Loparo,1,2 Monica R Kelly,3 Richard R Bootzin3 1General Sleep Corporation, Euclid, OH, USA; 2Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH, USA; 3Department of Psychology, University of Arizona, Tucson, AZ, USA Background: A need exists, from both a clinical and a research standpoint, for objective sleep measurement systems that are both easy to use and can accurately assess sleep and wake. This study evaluates the output of an automated sleep–wake detection algorithm (Z-ALG) used in the Zmachine (a portable, single-channel, electroencephalographic [EEG] acquisition and analysis system) against laboratory polysomnography (PSG) using a consensus of expert visual scorers. Methods: Overnight laboratory PSG studies from 99 subjects (52 females/47 males, 18–60 years, median age 32.7 years), including both normal sleepers and those with a variety of sleep disorders, were assessed. PSG data obtained from the differential mastoids (A1–A2) were assessed by Z-ALG, which determines sleep versus wake every 30 seconds using low-frequency, intermediate-frequency, and high-frequency and time domain EEG features. PSG data were independently scored by two to four certified PSG technologists, using standard Rechtschaffen and Kales guidelines, and these score files were combined on an epoch-by-epoch basis, using a majority voting rule, to generate a single score file per subject to compare against the Z-ALG output. Both epoch-by-epoch and standard sleep indices (eg, total sleep time, sleep efficiency, latency to persistent sleep, and wake after sleep onset) were compared between the Z-ALG output and the technologist consensus score files. Results: Overall, the sensitivity and specificity for detecting sleep using the Z-ALG as compared to the technologist consensus are 95.5% and 92.5%, respectively, across all subjects, and the positive predictive value and the negative predictive value for detecting sleep are 98.0% and 84.2%, respectively. Overall κ agreement is 0.85 (approaching the level of agreement observed among sleep technologists). These results persist when the sleep disorder subgroups are analyzed separately. Conclusion: This study demonstrates that the Z-ALG automated sleep–wake detection algorithm, using the single A1–A2 EEG channel, has a level of accuracy that is similar to PSG technologists in the scoring of sleep and wake, thereby making it suitable for a variety of in-home monitoring applications, such as in conjunction with the Zmachine system. Keywords: EEG, sleep–wake detection, algorithm, Zmachine, automatic sleep scoring, single channelKaplan RFWang YLoparo KAKelly MRBootzin RRDove Medical PressarticlePsychiatryRC435-571Neurophysiology and neuropsychologyQP351-495ENNature and Science of Sleep, Vol 2014, Iss default, Pp 113-122 (2014)
institution DOAJ
collection DOAJ
language EN
topic Psychiatry
RC435-571
Neurophysiology and neuropsychology
QP351-495
spellingShingle Psychiatry
RC435-571
Neurophysiology and neuropsychology
QP351-495
Kaplan RF
Wang Y
Loparo KA
Kelly MR
Bootzin RR
Performance evaluation of an automated single-channel sleep–wake detection algorithm
description Richard F Kaplan,1 Ying Wang,1 Kenneth A Loparo,1,2 Monica R Kelly,3 Richard R Bootzin3 1General Sleep Corporation, Euclid, OH, USA; 2Department of Electrical Engineering and Computer Science, Case Western Reserve University, Cleveland, OH, USA; 3Department of Psychology, University of Arizona, Tucson, AZ, USA Background: A need exists, from both a clinical and a research standpoint, for objective sleep measurement systems that are both easy to use and can accurately assess sleep and wake. This study evaluates the output of an automated sleep–wake detection algorithm (Z-ALG) used in the Zmachine (a portable, single-channel, electroencephalographic [EEG] acquisition and analysis system) against laboratory polysomnography (PSG) using a consensus of expert visual scorers. Methods: Overnight laboratory PSG studies from 99 subjects (52 females/47 males, 18–60 years, median age 32.7 years), including both normal sleepers and those with a variety of sleep disorders, were assessed. PSG data obtained from the differential mastoids (A1–A2) were assessed by Z-ALG, which determines sleep versus wake every 30 seconds using low-frequency, intermediate-frequency, and high-frequency and time domain EEG features. PSG data were independently scored by two to four certified PSG technologists, using standard Rechtschaffen and Kales guidelines, and these score files were combined on an epoch-by-epoch basis, using a majority voting rule, to generate a single score file per subject to compare against the Z-ALG output. Both epoch-by-epoch and standard sleep indices (eg, total sleep time, sleep efficiency, latency to persistent sleep, and wake after sleep onset) were compared between the Z-ALG output and the technologist consensus score files. Results: Overall, the sensitivity and specificity for detecting sleep using the Z-ALG as compared to the technologist consensus are 95.5% and 92.5%, respectively, across all subjects, and the positive predictive value and the negative predictive value for detecting sleep are 98.0% and 84.2%, respectively. Overall κ agreement is 0.85 (approaching the level of agreement observed among sleep technologists). These results persist when the sleep disorder subgroups are analyzed separately. Conclusion: This study demonstrates that the Z-ALG automated sleep–wake detection algorithm, using the single A1–A2 EEG channel, has a level of accuracy that is similar to PSG technologists in the scoring of sleep and wake, thereby making it suitable for a variety of in-home monitoring applications, such as in conjunction with the Zmachine system. Keywords: EEG, sleep–wake detection, algorithm, Zmachine, automatic sleep scoring, single channel
format article
author Kaplan RF
Wang Y
Loparo KA
Kelly MR
Bootzin RR
author_facet Kaplan RF
Wang Y
Loparo KA
Kelly MR
Bootzin RR
author_sort Kaplan RF
title Performance evaluation of an automated single-channel sleep–wake detection algorithm
title_short Performance evaluation of an automated single-channel sleep–wake detection algorithm
title_full Performance evaluation of an automated single-channel sleep–wake detection algorithm
title_fullStr Performance evaluation of an automated single-channel sleep–wake detection algorithm
title_full_unstemmed Performance evaluation of an automated single-channel sleep–wake detection algorithm
title_sort performance evaluation of an automated single-channel sleep–wake detection algorithm
publisher Dove Medical Press
publishDate 2014
url https://doaj.org/article/827600b4bd394256b9bfc3598cb53219
work_keys_str_mv AT kaplanrf performanceevaluationofanautomatedsinglechannelsleepndashwakedetectionalgorithm
AT wangy performanceevaluationofanautomatedsinglechannelsleepndashwakedetectionalgorithm
AT loparoka performanceevaluationofanautomatedsinglechannelsleepndashwakedetectionalgorithm
AT kellymr performanceevaluationofanautomatedsinglechannelsleepndashwakedetectionalgorithm
AT bootzinrr performanceevaluationofanautomatedsinglechannelsleepndashwakedetectionalgorithm
_version_ 1718403025081466880