Design and testing of a mobile health application rating tool
Abstract Mobile health applications (“apps”) have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps’ potentially important dimensions has not been available to patients and clinicians. The objective of this study was to dev...
Guardado en:
Autores principales: | , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Nature Portfolio
2020
|
Materias: | |
Acceso en línea: | https://doaj.org/article/aeff67c5a7b1445393b9446273d5a33a |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:aeff67c5a7b1445393b9446273d5a33a |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:aeff67c5a7b1445393b9446273d5a33a2021-12-02T15:52:55ZDesign and testing of a mobile health application rating tool10.1038/s41746-020-0268-92398-6352https://doaj.org/article/aeff67c5a7b1445393b9446273d5a33a2020-05-01T00:00:00Zhttps://doi.org/10.1038/s41746-020-0268-9https://doaj.org/toc/2398-6352Abstract Mobile health applications (“apps”) have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps’ potentially important dimensions has not been available to patients and clinicians. The objective of this study was to develop and preliminarily assess a usable, valid, and open-source rating tool to objectively measure the risks and benefits of health apps. We accomplished this by using a Delphi process, where we constructed an app rating tool called THESIS that could promote informed app selection. We used a systematic process to select chronic disease apps with ≥4 stars and <4-stars and then rated them with THESIS to examine the tool’s interrater reliability and internal consistency. We rated 211 apps, finding they performed fair overall (3.02 out of 5 [95% CI, 2.96–3.09]), but especially poorly for privacy/security (2.21 out of 5 [95% CI, 2.11–2.32]), interoperability (1.75 [95% CI, 1.59–1.91]), and availability in multiple languages (1.43 out of 5 [95% CI, 1.30–1.56]). Ratings using THESIS had fair interrater reliability (κ = 0.3–0.6) and excellent scale reliability (ɑ = 0.85). Correlation with traditional star ratings was low (r = 0.24), suggesting THESIS captures issues beyond general user acceptance. Preliminary testing of THESIS suggests apps that serve patients with chronic disease could perform much better, particularly in privacy/security and interoperability. THESIS warrants further testing and may guide software and policymakers to further improve app performance, so apps can more consistently improve patient outcomes.David M. LevineZoe CoLisa P. NewmarkAlissa R. GroisserA. Jay HolmgrenJennifer S. HaasDavid W. BatesNature PortfolioarticleComputer applications to medicine. Medical informaticsR858-859.7ENnpj Digital Medicine, Vol 3, Iss 1, Pp 1-7 (2020) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Computer applications to medicine. Medical informatics R858-859.7 |
spellingShingle |
Computer applications to medicine. Medical informatics R858-859.7 David M. Levine Zoe Co Lisa P. Newmark Alissa R. Groisser A. Jay Holmgren Jennifer S. Haas David W. Bates Design and testing of a mobile health application rating tool |
description |
Abstract Mobile health applications (“apps”) have rapidly proliferated, yet their ability to improve outcomes for patients remains unclear. A validated tool that addresses apps’ potentially important dimensions has not been available to patients and clinicians. The objective of this study was to develop and preliminarily assess a usable, valid, and open-source rating tool to objectively measure the risks and benefits of health apps. We accomplished this by using a Delphi process, where we constructed an app rating tool called THESIS that could promote informed app selection. We used a systematic process to select chronic disease apps with ≥4 stars and <4-stars and then rated them with THESIS to examine the tool’s interrater reliability and internal consistency. We rated 211 apps, finding they performed fair overall (3.02 out of 5 [95% CI, 2.96–3.09]), but especially poorly for privacy/security (2.21 out of 5 [95% CI, 2.11–2.32]), interoperability (1.75 [95% CI, 1.59–1.91]), and availability in multiple languages (1.43 out of 5 [95% CI, 1.30–1.56]). Ratings using THESIS had fair interrater reliability (κ = 0.3–0.6) and excellent scale reliability (ɑ = 0.85). Correlation with traditional star ratings was low (r = 0.24), suggesting THESIS captures issues beyond general user acceptance. Preliminary testing of THESIS suggests apps that serve patients with chronic disease could perform much better, particularly in privacy/security and interoperability. THESIS warrants further testing and may guide software and policymakers to further improve app performance, so apps can more consistently improve patient outcomes. |
format |
article |
author |
David M. Levine Zoe Co Lisa P. Newmark Alissa R. Groisser A. Jay Holmgren Jennifer S. Haas David W. Bates |
author_facet |
David M. Levine Zoe Co Lisa P. Newmark Alissa R. Groisser A. Jay Holmgren Jennifer S. Haas David W. Bates |
author_sort |
David M. Levine |
title |
Design and testing of a mobile health application rating tool |
title_short |
Design and testing of a mobile health application rating tool |
title_full |
Design and testing of a mobile health application rating tool |
title_fullStr |
Design and testing of a mobile health application rating tool |
title_full_unstemmed |
Design and testing of a mobile health application rating tool |
title_sort |
design and testing of a mobile health application rating tool |
publisher |
Nature Portfolio |
publishDate |
2020 |
url |
https://doaj.org/article/aeff67c5a7b1445393b9446273d5a33a |
work_keys_str_mv |
AT davidmlevine designandtestingofamobilehealthapplicationratingtool AT zoeco designandtestingofamobilehealthapplicationratingtool AT lisapnewmark designandtestingofamobilehealthapplicationratingtool AT alissargroisser designandtestingofamobilehealthapplicationratingtool AT ajayholmgren designandtestingofamobilehealthapplicationratingtool AT jennifershaas designandtestingofamobilehealthapplicationratingtool AT davidwbates designandtestingofamobilehealthapplicationratingtool |
_version_ |
1718385591512465408 |