Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators

Joseph S Ross,1–4 Jonathan Bates,4 Craig S Parzynski,4 Joseph G Akar,4,5 Jeptha P Curtis,4,5 Nihar R Desai,4,5 James V Freeman,4,5 Ginger M Gamble,4 Richard Kuntz,6 Shu-Xia Li,4 Danica Marinac-Dabic,7 Frederick A Masoudi,8 Sharon-Lise T Normand,9,10 Isuru Ranasinghe,11 Richard E Shaw,12 Ha...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Ross JS, Bates J, Parzynski CS, Akar JG, Curtis JP, Desai NR, Freeman JV, Gamble GM, Kuntz R, Li SX, Marinac-Dabic D, Masoudi FA, Normand SLT, Ranasinghe I, Shaw RE, Krumholz HM
Formato: article
Lenguaje:EN
Publicado: Dove Medical Press 2017
Materias:
Acceso en línea:https://doaj.org/article/80a0e372e0914f688f94ecb1c3eed1bf
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:80a0e372e0914f688f94ecb1c3eed1bf
record_format dspace
institution DOAJ
collection DOAJ
language EN
topic implanted cardioverter-defibrillator
methodology
surveillance.
Medical technology
R855-855.5
spellingShingle implanted cardioverter-defibrillator
methodology
surveillance.
Medical technology
R855-855.5
Ross JS
Bates J
Parzynski CS
Akar JG
Curtis JP
Desai NR
Freeman JV
Gamble GM
Kuntz R
Li SX
Marinac-Dabic D
Masoudi FA
Normand SLT
Ranasinghe I
Shaw RE
Krumholz HM
Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators
description Joseph S Ross,1–4 Jonathan Bates,4 Craig S Parzynski,4 Joseph G Akar,4,5 Jeptha P Curtis,4,5 Nihar R Desai,4,5 James V Freeman,4,5 Ginger M Gamble,4 Richard Kuntz,6 Shu-Xia Li,4 Danica Marinac-Dabic,7 Frederick A Masoudi,8 Sharon-Lise T Normand,9,10 Isuru Ranasinghe,11 Richard E Shaw,12 Harlan M Krumholz2–5 1Section of General Medicine, Department of Medicine, 2Robert Wood Johnson Foundation Clinical Scholars Program, Yale School of Medicine, 3Department of Health Policy and Management, Yale School of Public Health, 4Center for Outcomes Research and Evaluation, Yale–New Haven Hospital, 5Section of Cardiovascular Medicine, Department of Medicine, Yale School of Medicine, New Haven, CT, 6Medtronic Inc, Minneapolis, MN, 7Division of Epidemiology, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD, 8Division of Cardiology, Department of Medicine, University of Colorado, Aurora, CO, 9Department of Health Care Policy, Harvard Medical School, 10Department of Biostatistics, Harvard TH Chan School of Public Health, Boston, MA, USA; 11Discipline of Medicine, University of Adelaide, Adelaide, SA, Australia; 12Department of Clinical Informatics, California Pacific Medical Center, San Francisco, CA, USA Background: Machine learning methods may complement traditional analytic methods for medical device surveillance.Methods and results: Using data from the National Cardiovascular Data Registry for implantable cardioverter–defibrillators (ICDs) linked to Medicare administrative claims for longitudinal follow-up, we applied three statistical approaches to safety-signal detection for commonly used dual-chamber ICDs that used two propensity score (PS) models: one specified by subject-matter experts (PS-SME), and the other one by machine learning-based selection (PS-ML). The first approach used PS-SME and cumulative incidence (time-to-event), the second approach used PS-SME and cumulative risk (Data Extraction and Longitudinal Trend Analysis [DELTA]), and the third approach used PS-ML and cumulative risk (embedded feature selection). Safety-signal surveillance was conducted for eleven dual-chamber ICD models implanted at least 2,000 times over 3 years. Between 2006 and 2010, there were 71,948 Medicare fee-for-service beneficiaries who received dual-chamber ICDs. Cumulative device-specific unadjusted 3-year event rates varied for three surveyed safety signals: death from any cause, 12.8%–20.9%; nonfatal ICD-related adverse events, 19.3%–26.3%; and death from any cause or nonfatal ICD-related adverse event, 27.1%–37.6%. Agreement among safety signals detected/not detected between the time-to-event and DELTA approaches was 90.9% (360 of 396, k=0.068), between the time-to-event and embedded feature-selection approaches was 91.7% (363 of 396, k=–0.028), and between the DELTA and embedded feature selection approaches was 88.1% (349 of 396, k=–0.042).Conclusion: Three statistical approaches, including one machine learning method, identified important safety signals, but without exact agreement. Ensemble methods may be needed to detect all safety signals for further evaluation during medical device surveillance. Keywords: implanted cardioverter–defibrillator, methodology, surveillance
format article
author Ross JS
Bates J
Parzynski CS
Akar JG
Curtis JP
Desai NR
Freeman JV
Gamble GM
Kuntz R
Li SX
Marinac-Dabic D
Masoudi FA
Normand SLT
Ranasinghe I
Shaw RE
Krumholz HM
author_facet Ross JS
Bates J
Parzynski CS
Akar JG
Curtis JP
Desai NR
Freeman JV
Gamble GM
Kuntz R
Li SX
Marinac-Dabic D
Masoudi FA
Normand SLT
Ranasinghe I
Shaw RE
Krumholz HM
author_sort Ross JS
title Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators
title_short Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators
title_full Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators
title_fullStr Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators
title_full_unstemmed Can machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators
title_sort can machine learning complement traditional medical device surveillance? a case-study of dual-chamber implantable cardioverter–defibrillators
publisher Dove Medical Press
publishDate 2017
url https://doaj.org/article/80a0e372e0914f688f94ecb1c3eed1bf
work_keys_str_mv AT rossjs canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT batesj canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT parzynskics canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT akarjg canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT curtisjp canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT desainr canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT freemanjv canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT gamblegm canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT kuntzr canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT lisx canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT marinacdabicd canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT masoudifa canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT normandslt canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT ranasinghei canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT shawre canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
AT krumholzhm canmachinelearningcomplementtraditionalmedicaldevicesurveillanceacasestudyofdualchamberimplantablecardioverterndashdefibrillators
_version_ 1718401560556339200
spelling oai:doaj.org-article:80a0e372e0914f688f94ecb1c3eed1bf2021-12-02T03:57:24ZCan machine learning complement traditional medical device surveillance? A case-study of dual-chamber implantable cardioverter–defibrillators1179-1470https://doaj.org/article/80a0e372e0914f688f94ecb1c3eed1bf2017-08-01T00:00:00Zhttps://www.dovepress.com/can-machine-learning-complement-traditional-medical-device-surveillanc-peer-reviewed-article-MDERhttps://doaj.org/toc/1179-1470Joseph S Ross,1–4 Jonathan Bates,4 Craig S Parzynski,4 Joseph G Akar,4,5 Jeptha P Curtis,4,5 Nihar R Desai,4,5 James V Freeman,4,5 Ginger M Gamble,4 Richard Kuntz,6 Shu-Xia Li,4 Danica Marinac-Dabic,7 Frederick A Masoudi,8 Sharon-Lise T Normand,9,10 Isuru Ranasinghe,11 Richard E Shaw,12 Harlan M Krumholz2–5 1Section of General Medicine, Department of Medicine, 2Robert Wood Johnson Foundation Clinical Scholars Program, Yale School of Medicine, 3Department of Health Policy and Management, Yale School of Public Health, 4Center for Outcomes Research and Evaluation, Yale–New Haven Hospital, 5Section of Cardiovascular Medicine, Department of Medicine, Yale School of Medicine, New Haven, CT, 6Medtronic Inc, Minneapolis, MN, 7Division of Epidemiology, Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD, 8Division of Cardiology, Department of Medicine, University of Colorado, Aurora, CO, 9Department of Health Care Policy, Harvard Medical School, 10Department of Biostatistics, Harvard TH Chan School of Public Health, Boston, MA, USA; 11Discipline of Medicine, University of Adelaide, Adelaide, SA, Australia; 12Department of Clinical Informatics, California Pacific Medical Center, San Francisco, CA, USA Background: Machine learning methods may complement traditional analytic methods for medical device surveillance.Methods and results: Using data from the National Cardiovascular Data Registry for implantable cardioverter–defibrillators (ICDs) linked to Medicare administrative claims for longitudinal follow-up, we applied three statistical approaches to safety-signal detection for commonly used dual-chamber ICDs that used two propensity score (PS) models: one specified by subject-matter experts (PS-SME), and the other one by machine learning-based selection (PS-ML). The first approach used PS-SME and cumulative incidence (time-to-event), the second approach used PS-SME and cumulative risk (Data Extraction and Longitudinal Trend Analysis [DELTA]), and the third approach used PS-ML and cumulative risk (embedded feature selection). Safety-signal surveillance was conducted for eleven dual-chamber ICD models implanted at least 2,000 times over 3 years. Between 2006 and 2010, there were 71,948 Medicare fee-for-service beneficiaries who received dual-chamber ICDs. Cumulative device-specific unadjusted 3-year event rates varied for three surveyed safety signals: death from any cause, 12.8%–20.9%; nonfatal ICD-related adverse events, 19.3%–26.3%; and death from any cause or nonfatal ICD-related adverse event, 27.1%–37.6%. Agreement among safety signals detected/not detected between the time-to-event and DELTA approaches was 90.9% (360 of 396, k=0.068), between the time-to-event and embedded feature-selection approaches was 91.7% (363 of 396, k=–0.028), and between the DELTA and embedded feature selection approaches was 88.1% (349 of 396, k=–0.042).Conclusion: Three statistical approaches, including one machine learning method, identified important safety signals, but without exact agreement. Ensemble methods may be needed to detect all safety signals for further evaluation during medical device surveillance. Keywords: implanted cardioverter–defibrillator, methodology, surveillanceRoss JSBates JParzynski CSAkar JGCurtis JPDesai NRFreeman JVGamble GMKuntz RLi SXMarinac-Dabic DMasoudi FANormand SLTRanasinghe IShaw REKrumholz HMDove Medical Pressarticleimplanted cardioverter-defibrillatormethodologysurveillance.Medical technologyR855-855.5ENMedical Devices: Evidence and Research, Vol Volume 10, Pp 165-188 (2017)