Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi).
<h4>Objectives</h4>To describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids).<h4>Design</h4>Scale development study, involving construct, item and scale development, val...
Guardado en:
Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Public Library of Science (PLoS)
2009
|
Materias: | |
Acceso en línea: | https://doaj.org/article/184d1301fc1e4d3384cf09f51addb05f |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:184d1301fc1e4d3384cf09f51addb05f |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:184d1301fc1e4d3384cf09f51addb05f2021-11-25T06:16:58ZAssessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi).1932-620310.1371/journal.pone.0004705https://doaj.org/article/184d1301fc1e4d3384cf09f51addb05f2009-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/19259269/pdf/?tool=EBIhttps://doaj.org/toc/1932-6203<h4>Objectives</h4>To describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids).<h4>Design</h4>Scale development study, involving construct, item and scale development, validation and reliability testing.<h4>Setting</h4>There has been increasing use of decision support technologies--adjuncts to the discussions clinicians have with patients about difficult decisions. A global interest in developing these interventions exists among both for-profit and not-for-profit organisations. It is therefore essential to have internationally accepted standards to assess the quality of their development, process, content, potential bias and method of field testing and evaluation.<h4>Methods</h4>Scale development study, involving construct, item and scale development, validation and reliability testing.<h4>Participants</h4>Twenty-five researcher-members of the International Patient Decision Aid Standards Collaboration worked together to develop the instrument (IPDASi). In the fourth Stage (reliability study), eight raters assessed thirty randomly selected decision support technologies.<h4>Results</h4>IPDASi measures quality in 10 dimensions, using 47 items, and provides an overall quality score (scaled from 0 to 100) for each intervention. Overall IPDASi scores ranged from 33 to 82 across the decision support technologies sampled (n = 30), enabling discrimination. The inter-rater intraclass correlation for the overall quality score was 0.80. Correlations of dimension scores with the overall score were all positive (0.31 to 0.68). Cronbach's alpha values for the 8 raters ranged from 0.72 to 0.93. Cronbach's alphas based on the dimension means ranged from 0.50 to 0.81, indicating that the dimensions, although well correlated, measure different aspects of decision support technology quality. A short version (19 items) was also developed that had very similar mean scores to IPDASi and high correlation between short score and overall score 0.87 (CI 0.79 to 0.92).<h4>Conclusions</h4>This work demonstrates that IPDASi has the ability to assess the quality of decision support technologies. The existing IPDASi provides an assessment of the quality of a DST's components and will be used as a tool to provide formative advice to DSTs developers and summative assessments for those who want to compare their tools against an existing benchmark.Glyn ElwynAnnette M O'ConnorCarol BennettRobert G NewcombeMary PolitiMarie-Anne DurandElizabeth DrakeNatalie Joseph-WilliamsSara KhanguraAnton SaarimakiStephanie SivellMareike StielSteven J BernsteinNananda ColAngela CoulterKaren EdenMartin HärterMargaret Holmes RovnerNora MoumjidDawn StaceyRichard ThomsonTim WhelanTrudy van der WeijdenAdrian EdwardsPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 4, Iss 3, p e4705 (2009) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Glyn Elwyn Annette M O'Connor Carol Bennett Robert G Newcombe Mary Politi Marie-Anne Durand Elizabeth Drake Natalie Joseph-Williams Sara Khangura Anton Saarimaki Stephanie Sivell Mareike Stiel Steven J Bernstein Nananda Col Angela Coulter Karen Eden Martin Härter Margaret Holmes Rovner Nora Moumjid Dawn Stacey Richard Thomson Tim Whelan Trudy van der Weijden Adrian Edwards Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). |
description |
<h4>Objectives</h4>To describe the development, validation and inter-rater reliability of an instrument to measure the quality of patient decision support technologies (decision aids).<h4>Design</h4>Scale development study, involving construct, item and scale development, validation and reliability testing.<h4>Setting</h4>There has been increasing use of decision support technologies--adjuncts to the discussions clinicians have with patients about difficult decisions. A global interest in developing these interventions exists among both for-profit and not-for-profit organisations. It is therefore essential to have internationally accepted standards to assess the quality of their development, process, content, potential bias and method of field testing and evaluation.<h4>Methods</h4>Scale development study, involving construct, item and scale development, validation and reliability testing.<h4>Participants</h4>Twenty-five researcher-members of the International Patient Decision Aid Standards Collaboration worked together to develop the instrument (IPDASi). In the fourth Stage (reliability study), eight raters assessed thirty randomly selected decision support technologies.<h4>Results</h4>IPDASi measures quality in 10 dimensions, using 47 items, and provides an overall quality score (scaled from 0 to 100) for each intervention. Overall IPDASi scores ranged from 33 to 82 across the decision support technologies sampled (n = 30), enabling discrimination. The inter-rater intraclass correlation for the overall quality score was 0.80. Correlations of dimension scores with the overall score were all positive (0.31 to 0.68). Cronbach's alpha values for the 8 raters ranged from 0.72 to 0.93. Cronbach's alphas based on the dimension means ranged from 0.50 to 0.81, indicating that the dimensions, although well correlated, measure different aspects of decision support technology quality. A short version (19 items) was also developed that had very similar mean scores to IPDASi and high correlation between short score and overall score 0.87 (CI 0.79 to 0.92).<h4>Conclusions</h4>This work demonstrates that IPDASi has the ability to assess the quality of decision support technologies. The existing IPDASi provides an assessment of the quality of a DST's components and will be used as a tool to provide formative advice to DSTs developers and summative assessments for those who want to compare their tools against an existing benchmark. |
format |
article |
author |
Glyn Elwyn Annette M O'Connor Carol Bennett Robert G Newcombe Mary Politi Marie-Anne Durand Elizabeth Drake Natalie Joseph-Williams Sara Khangura Anton Saarimaki Stephanie Sivell Mareike Stiel Steven J Bernstein Nananda Col Angela Coulter Karen Eden Martin Härter Margaret Holmes Rovner Nora Moumjid Dawn Stacey Richard Thomson Tim Whelan Trudy van der Weijden Adrian Edwards |
author_facet |
Glyn Elwyn Annette M O'Connor Carol Bennett Robert G Newcombe Mary Politi Marie-Anne Durand Elizabeth Drake Natalie Joseph-Williams Sara Khangura Anton Saarimaki Stephanie Sivell Mareike Stiel Steven J Bernstein Nananda Col Angela Coulter Karen Eden Martin Härter Margaret Holmes Rovner Nora Moumjid Dawn Stacey Richard Thomson Tim Whelan Trudy van der Weijden Adrian Edwards |
author_sort |
Glyn Elwyn |
title |
Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). |
title_short |
Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). |
title_full |
Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). |
title_fullStr |
Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). |
title_full_unstemmed |
Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi). |
title_sort |
assessing the quality of decision support technologies using the international patient decision aid standards instrument (ipdasi). |
publisher |
Public Library of Science (PLoS) |
publishDate |
2009 |
url |
https://doaj.org/article/184d1301fc1e4d3384cf09f51addb05f |
work_keys_str_mv |
AT glynelwyn assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT annettemoconnor assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT carolbennett assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT robertgnewcombe assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT marypoliti assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT marieannedurand assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT elizabethdrake assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT nataliejosephwilliams assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT sarakhangura assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT antonsaarimaki assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT stephaniesivell assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT mareikestiel assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT stevenjbernstein assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT nanandacol assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT angelacoulter assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT kareneden assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT martinharter assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT margaretholmesrovner assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT noramoumjid assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT dawnstacey assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT richardthomson assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT timwhelan assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT trudyvanderweijden assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi AT adrianedwards assessingthequalityofdecisionsupporttechnologiesusingtheinternationalpatientdecisionaidstandardsinstrumentipdasi |
_version_ |
1718413968280649728 |