A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study
Abstract Background Buprenorphine is a widely used treatment option for patients with opioid use disorder (OUD). Premature discontinuation from this treatment has many negative health and societal consequences. Objective To develop and evaluate a machine learning based two-stage clinical decision-ma...
Guardado en:
Autores principales: | , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
BMC
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/f861b66740da49bf8a84e2631a4608cf |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:f861b66740da49bf8a84e2631a4608cf |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:f861b66740da49bf8a84e2631a4608cf2021-11-28T12:26:05ZA machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study10.1186/s12911-021-01692-71472-6947https://doaj.org/article/f861b66740da49bf8a84e2631a4608cf2021-11-01T00:00:00Zhttps://doi.org/10.1186/s12911-021-01692-7https://doaj.org/toc/1472-6947Abstract Background Buprenorphine is a widely used treatment option for patients with opioid use disorder (OUD). Premature discontinuation from this treatment has many negative health and societal consequences. Objective To develop and evaluate a machine learning based two-stage clinical decision-making framework for predicting which patients will discontinue OUD treatment within less than a year. The proposed framework performs such prediction in two stages: (i) at the time of initiating the treatment, and (ii) after two/three months following treatment initiation. Methods For this retrospective observational analysis, we utilized Massachusetts All Payer Claims Data (MA APCD) from the year 2013 to 2015. Study sample included 5190 patients who were commercially insured, initiated buprenorphine treatment between January and December 2014, and did not have any buprenorphine prescription at least one year prior to the date of treatment initiation in 2014. Treatment discontinuation was defined as at least two consecutive months without a prescription for buprenorphine. Six machine learning models (i.e., logistic regression, decision tree, random forest, extreme-gradient boosting, support vector machine, and artificial neural network) were tested using a five-fold cross validation on the input data. The first-stage models used patients’ demographic information. The second-stage models included information on medication adherence during the early phase of treatment based on the proportion of days covered (PDC) measure. Results A substantial percentage of patients (48.7%) who started on buprenorphine discontinued the treatment within one year. The area under receiving operating characteristic curve (C-statistic) for the first stage models varied within a range of 0.55 to 0.59. The inclusion of knowledge regarding patients’ adherence at the early treatment phase in terms of two-months and three-months PDC resulted in a statistically significant increase in the models’ discriminative power (p-value < 0.001) based on the C-statistic. We also constructed interpretable decision classification rules using the decision tree model. Conclusion Machine learning models can predict which patients are most at-risk of premature treatment discontinuation with reasonable discriminative power. The proposed machine learning framework can be used as a tool to help inform a clinical decision support system following further validation. This can potentially help prescribers allocate limited healthcare resources optimally among different groups of patients based on their vulnerability to treatment discontinuation and design personalized support systems for improving patients’ long-term adherence to OUD treatment.Md Mahmudul HasanGary J. YoungJiesheng ShiPrathamesh MohiteLeonard D. YoungScott G. WeinerMd. Noor-E-AlamBMCarticleComputer applications to medicine. Medical informaticsR858-859.7ENBMC Medical Informatics and Decision Making, Vol 21, Iss 1, Pp 1-21 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Computer applications to medicine. Medical informatics R858-859.7 |
spellingShingle |
Computer applications to medicine. Medical informatics R858-859.7 Md Mahmudul Hasan Gary J. Young Jiesheng Shi Prathamesh Mohite Leonard D. Young Scott G. Weiner Md. Noor-E-Alam A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
description |
Abstract Background Buprenorphine is a widely used treatment option for patients with opioid use disorder (OUD). Premature discontinuation from this treatment has many negative health and societal consequences. Objective To develop and evaluate a machine learning based two-stage clinical decision-making framework for predicting which patients will discontinue OUD treatment within less than a year. The proposed framework performs such prediction in two stages: (i) at the time of initiating the treatment, and (ii) after two/three months following treatment initiation. Methods For this retrospective observational analysis, we utilized Massachusetts All Payer Claims Data (MA APCD) from the year 2013 to 2015. Study sample included 5190 patients who were commercially insured, initiated buprenorphine treatment between January and December 2014, and did not have any buprenorphine prescription at least one year prior to the date of treatment initiation in 2014. Treatment discontinuation was defined as at least two consecutive months without a prescription for buprenorphine. Six machine learning models (i.e., logistic regression, decision tree, random forest, extreme-gradient boosting, support vector machine, and artificial neural network) were tested using a five-fold cross validation on the input data. The first-stage models used patients’ demographic information. The second-stage models included information on medication adherence during the early phase of treatment based on the proportion of days covered (PDC) measure. Results A substantial percentage of patients (48.7%) who started on buprenorphine discontinued the treatment within one year. The area under receiving operating characteristic curve (C-statistic) for the first stage models varied within a range of 0.55 to 0.59. The inclusion of knowledge regarding patients’ adherence at the early treatment phase in terms of two-months and three-months PDC resulted in a statistically significant increase in the models’ discriminative power (p-value < 0.001) based on the C-statistic. We also constructed interpretable decision classification rules using the decision tree model. Conclusion Machine learning models can predict which patients are most at-risk of premature treatment discontinuation with reasonable discriminative power. The proposed machine learning framework can be used as a tool to help inform a clinical decision support system following further validation. This can potentially help prescribers allocate limited healthcare resources optimally among different groups of patients based on their vulnerability to treatment discontinuation and design personalized support systems for improving patients’ long-term adherence to OUD treatment. |
format |
article |
author |
Md Mahmudul Hasan Gary J. Young Jiesheng Shi Prathamesh Mohite Leonard D. Young Scott G. Weiner Md. Noor-E-Alam |
author_facet |
Md Mahmudul Hasan Gary J. Young Jiesheng Shi Prathamesh Mohite Leonard D. Young Scott G. Weiner Md. Noor-E-Alam |
author_sort |
Md Mahmudul Hasan |
title |
A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
title_short |
A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
title_full |
A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
title_fullStr |
A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
title_full_unstemmed |
A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
title_sort |
machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: retrospective observational study |
publisher |
BMC |
publishDate |
2021 |
url |
https://doaj.org/article/f861b66740da49bf8a84e2631a4608cf |
work_keys_str_mv |
AT mdmahmudulhasan amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT garyjyoung amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT jieshengshi amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT prathameshmohite amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT leonarddyoung amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT scottgweiner amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT mdnoorealam amachinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT mdmahmudulhasan machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT garyjyoung machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT jieshengshi machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT prathameshmohite machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT leonarddyoung machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT scottgweiner machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy AT mdnoorealam machinelearningbasedtwostageclinicaldecisionsupportsystemforpredictingpatientsdiscontinuationfromopioidusedisordertreatmentretrospectiveobservationalstudy |
_version_ |
1718407991437295616 |