Design and testing of a mobile health application rating tool

Abstract Mobile health applications (“apps”) have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps’ potentially important dimensions has not been available to patients and clinicians. The objective of this study was to dev...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: David M. Levine, Zoe Co, Lisa P. Newmark, Alissa R. Groisser, A. Jay Holmgren, Jennifer S. Haas, David W. Bates
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2020
Materias:
Acceso en línea:https://doaj.org/article/aeff67c5a7b1445393b9446273d5a33a
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:aeff67c5a7b1445393b9446273d5a33a
record_format dspace
spelling oai:doaj.org-article:aeff67c5a7b1445393b9446273d5a33a2021-12-02T15:52:55ZDesign and testing of a mobile health application rating tool10.1038/s41746-020-0268-92398-6352https://doaj.org/article/aeff67c5a7b1445393b9446273d5a33a2020-05-01T00:00:00Zhttps://doi.org/10.1038/s41746-020-0268-9https://doaj.org/toc/2398-6352Abstract Mobile health applications (“apps”) have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps’ potentially important dimensions has not been available to patients and clinicians. The objective of this study was to develop and preliminarily assess a usable, valid, and open-source rating tool to objectively measure the risks and benefits of health apps. We accomplished this by using a Delphi process, where we constructed an app rating tool called THESIS that could promote informed app selection. We used a systematic process to select chronic disease apps with ≥4 stars and <4-stars and then rated them with THESIS to examine the tool’s interrater reliability and internal consistency. We rated 211 apps, finding they performed fair overall (3.02 out of 5 [95% CI, 2.96–3.09]), but especially poorly for privacy/security (2.21 out of 5 [95% CI, 2.11–2.32]), interoperability (1.75 [95% CI, 1.59–1.91]), and availability in multiple languages (1.43 out of 5 [95% CI, 1.30–1.56]). Ratings using THESIS had fair interrater reliability (κ = 0.3–0.6) and excellent scale reliability (ɑ = 0.85). Correlation with traditional star ratings was low (r = 0.24), suggesting THESIS captures issues beyond general user acceptance. Preliminary testing of THESIS suggests apps that serve patients with chronic disease could perform much better, particularly in privacy/security and interoperability. THESIS warrants further testing and may guide software and policymakers to further improve app performance, so apps can more consistently improve patient outcomes.David M. LevineZoe CoLisa P. NewmarkAlissa R. GroisserA. Jay HolmgrenJennifer S. HaasDavid W. BatesNature PortfolioarticleComputer applications to medicine. Medical informaticsR858-859.7ENnpj Digital Medicine, Vol 3, Iss 1, Pp 1-7 (2020)
institution DOAJ
collection DOAJ
language EN
topic Computer applications to medicine. Medical informatics
R858-859.7
spellingShingle Computer applications to medicine. Medical informatics
R858-859.7
David M. Levine
Zoe Co
Lisa P. Newmark
Alissa R. Groisser
A. Jay Holmgren
Jennifer S. Haas
David W. Bates
Design and testing of a mobile health application rating tool
description Abstract Mobile health applications (“apps”) have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps’ potentially important dimensions has not been available to patients and clinicians. The objective of this study was to develop and preliminarily assess a usable, valid, and open-source rating tool to objectively measure the risks and benefits of health apps. We accomplished this by using a Delphi process, where we constructed an app rating tool called THESIS that could promote informed app selection. We used a systematic process to select chronic disease apps with ≥4 stars and <4-stars and then rated them with THESIS to examine the tool’s interrater reliability and internal consistency. We rated 211 apps, finding they performed fair overall (3.02 out of 5 [95% CI, 2.96–3.09]), but especially poorly for privacy/security (2.21 out of 5 [95% CI, 2.11–2.32]), interoperability (1.75 [95% CI, 1.59–1.91]), and availability in multiple languages (1.43 out of 5 [95% CI, 1.30–1.56]). Ratings using THESIS had fair interrater reliability (κ = 0.3–0.6) and excellent scale reliability (ɑ = 0.85). Correlation with traditional star ratings was low (r = 0.24), suggesting THESIS captures issues beyond general user acceptance. Preliminary testing of THESIS suggests apps that serve patients with chronic disease could perform much better, particularly in privacy/security and interoperability. THESIS warrants further testing and may guide software and policymakers to further improve app performance, so apps can more consistently improve patient outcomes.
format article
author David M. Levine
Zoe Co
Lisa P. Newmark
Alissa R. Groisser
A. Jay Holmgren
Jennifer S. Haas
David W. Bates
author_facet David M. Levine
Zoe Co
Lisa P. Newmark
Alissa R. Groisser
A. Jay Holmgren
Jennifer S. Haas
David W. Bates
author_sort David M. Levine
title Design and testing of a mobile health application rating tool
title_short Design and testing of a mobile health application rating tool
title_full Design and testing of a mobile health application rating tool
title_fullStr Design and testing of a mobile health application rating tool
title_full_unstemmed Design and testing of a mobile health application rating tool
title_sort design and testing of a mobile health application rating tool
publisher Nature Portfolio
publishDate 2020
url https://doaj.org/article/aeff67c5a7b1445393b9446273d5a33a
work_keys_str_mv AT davidmlevine designandtestingofamobilehealthapplicationratingtool
AT zoeco designandtestingofamobilehealthapplicationratingtool
AT lisapnewmark designandtestingofamobilehealthapplicationratingtool
AT alissargroisser designandtestingofamobilehealthapplicationratingtool
AT ajayholmgren designandtestingofamobilehealthapplicationratingtool
AT jennifershaas designandtestingofamobilehealthapplicationratingtool
AT davidwbates designandtestingofamobilehealthapplicationratingtool
_version_ 1718385591512465408