A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study

Abstract Background Buprenorphine is a widely used treatment option for patients with opioid use disorder (OUD). Premature discontinuation from this treatment has many negative health and societal consequences. Objective To develop and evaluate a machine learning based two-stage clinical decision-ma...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Md Mahmudul Hasan, Gary J. Young, Jiesheng Shi, Prathamesh Mohite, Leonard D. Young, Scott G. Weiner, Md. Noor-E-Alam
Formato: article
Lenguaje:EN
Publicado: BMC 2021
Materias:
Acceso en línea:https://doaj.org/article/f861b66740da49bf8a84e2631a4608cf
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:f861b66740da49bf8a84e2631a4608cf
record_format dspace
spelling oai:doaj.org-article:f861b66740da49bf8a84e2631a4608cf2021-11-28T12:26:05ZA machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study10.1186/s12911-021-01692-71472-6947https://doaj.org/article/f861b66740da49bf8a84e2631a4608cf2021-11-01T00:00:00Zhttps://doi.org/10.1186/s12911-021-01692-7https://doaj.org/toc/1472-6947Abstract Background Buprenorphine is a widely used treatment option for patients with opioid use disorder (OUD). Premature discontinuation from this treatment has many negative health and societal consequences. Objective To develop and evaluate a machine learning based two-stage clinical decision-making framework for predicting which patients will discontinue OUD treatment within less than a year. The proposed framework performs such prediction in two stages: (i) at the time of initiating the treatment, and (ii) after two/three months following treatment initiation. Methods For this retrospective observational analysis, we utilized Massachusetts All Payer Claims Data (MA APCD) from the year 2013 to 2015. Study sample included 5190 patients who were commercially insured, initiated buprenorphine treatment between January and December 2014, and did not have any buprenorphine prescription at least one year prior to the date of treatment initiation in 2014. Treatment discontinuation was defined as at least two consecutive months without a prescription for buprenorphine. Six machine learning models (i.e., logistic regression, decision tree, random forest, extreme-gradient boosting, support vector machine, and artificial neural network) were tested using a five-fold cross validation on the input data. The first-stage models used patients’ demographic information. The second-stage models included information on medication adherence during the early phase of treatment based on the proportion of days covered (PDC) measure. Results A substantial percentage of patients (48.7%) who started on buprenorphine discontinued the treatment within one year. The area under receiving operating characteristic curve (C-statistic) for the first stage models varied within a range of 0.55 to 0.59. The inclusion of knowledge regarding patients’ adherence at the early treatment phase in terms of two-months and three-months PDC resulted in a statistically significant increase in the models’ discriminative power (p-value < 0.001) based on the C-statistic. We also constructed interpretable decision classification rules using the decision tree model. Conclusion Machine learning models can predict which patients are most at-risk of premature treatment discontinuation with reasonable discriminative power. The proposed machine learning framework can be used as a tool to help inform a clinical decision support system following further validation. This can potentially help prescribers allocate limited healthcare resources optimally among different groups of patients based on their vulnerability to treatment discontinuation and design personalized support systems for improving patients’ long-term adherence to OUD treatment.Md Mahmudul HasanGary J. YoungJiesheng ShiPrathamesh MohiteLeonard D. YoungScott G. WeinerMd. Noor-E-AlamBMCarticleComputer applications to medicine. Medical informaticsR858-859.7ENBMC Medical Informatics and Decision Making, Vol 21, Iss 1, Pp 1-21 (2021)
institution DOAJ
collection DOAJ
language EN
topic Computer applications to medicine. Medical informatics
R858-859.7
spellingShingle Computer applications to medicine. Medical informatics
R858-859.7
Md Mahmudul Hasan
Gary J. Young
Jiesheng Shi
Prathamesh Mohite
Leonard D. Young
Scott G. Weiner
Md. Noor-E-Alam
A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
description Abstract Background Buprenorphine is a widely used treatment option for patients with opioid use disorder (OUD). Premature discontinuation from this treatment has many negative health and societal consequences. Objective To develop and evaluate a machine learning based two-stage clinical decision-making framework for predicting which patients will discontinue OUD treatment within less than a year. The proposed framework performs such prediction in two stages: (i) at the time of initiating the treatment, and (ii) after two/three months following treatment initiation. Methods For this retrospective observational analysis, we utilized Massachusetts All Payer Claims Data (MA APCD) from the year 2013 to 2015. Study sample included 5190 patients who were commercially insured, initiated buprenorphine treatment between January and December 2014, and did not have any buprenorphine prescription at least one year prior to the date of treatment initiation in 2014. Treatment discontinuation was defined as at least two consecutive months without a prescription for buprenorphine. Six machine learning models (i.e., logistic regression, decision tree, random forest, extreme-gradient boosting, support vector machine, and artificial neural network) were tested using a five-fold cross validation on the input data. The first-stage models used patients’ demographic information. The second-stage models included information on medication adherence during the early phase of treatment based on the proportion of days covered (PDC) measure. Results A substantial percentage of patients (48.7%) who started on buprenorphine discontinued the treatment within one year. The area under receiving operating characteristic curve (C-statistic) for the first stage models varied within a range of 0.55 to 0.59. The inclusion of knowledge regarding patients’ adherence at the early treatment phase in terms of two-months and three-months PDC resulted in a statistically significant increase in the models’ discriminative power (p-value < 0.001) based on the C-statistic. We also constructed interpretable decision classification rules using the decision tree model. Conclusion Machine learning models can predict which patients are most at-risk of premature treatment discontinuation with reasonable discriminative power. The proposed machine learning framework can be used as a tool to help inform a clinical decision support system following further validation. This can potentially help prescribers allocate limited healthcare resources optimally among different groups of patients based on their vulnerability to treatment discontinuation and design personalized support systems for improving patients’ long-term adherence to OUD treatment.
format article
author Md Mahmudul Hasan
Gary J. Young
Jiesheng Shi
Prathamesh Mohite
Leonard D. Young
Scott G. Weiner
Md. Noor-E-Alam
author_facet Md Mahmudul Hasan
Gary J. Young
Jiesheng Shi
Prathamesh Mohite
Leonard D. Young
Scott G. Weiner
Md. Noor-E-Alam
author_sort Md Mahmudul Hasan
title A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
title_short A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
title_full A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
title_fullStr A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
title_full_unstemmed A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
title_sort machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
publisher BMC
publishDate 2021
url https://doaj.org/article/f861b66740da49bf8a84e2631a4608cf
work_keys_str_mv AT mdmahmudulhasan amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT garyjyoung amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT jieshengshi amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT prathameshmohite amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT leonarddyoung amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT scottgweiner amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT mdnoorealam amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT mdmahmudulhasan machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT garyjyoung machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT jieshengshi machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT prathameshmohite machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT leonarddyoung machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT scottgweiner machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
AT mdnoorealam machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy
_version_ 1718407991437295616