Developing a dashboard to meet Competence Committee needs: a design-based research project

Background: Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based resear...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Brent Thoma, Venkat Bandi, Robert Carey, Debajyoti Mondal, Robert Woods, Lynsey Martin, Teresa Chan
Formato: article
Lenguaje:EN
Publicado: Canadian Medical Education Journal 2020
Materias:
Acceso en línea:https://doaj.org/article/df7960ae034f42b5a25126717c320241
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:df7960ae034f42b5a25126717c320241
record_format dspace
spelling oai:doaj.org-article:df7960ae034f42b5a25126717c3202412021-12-01T22:41:27ZDeveloping a dashboard to meet Competence Committee needs: a design-based research project10.36834/cmej.689031923-1202https://doaj.org/article/df7960ae034f42b5a25126717c3202412020-03-01T00:00:00Zhttps://journalhosting.ucalgary.ca/index.php/cmej/article/view/68903https://doaj.org/toc/1923-1202 Background: Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments. Methods: We utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard. Results: The qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements. Conclusions: This work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems. Brent ThomaVenkat BandiRobert CareyDebajyoti MondalRobert WoodsLynsey MartinTeresa ChanCanadian Medical Education JournalarticleEducation (General)L7-991Medicine (General)R5-920ENCanadian Medical Education Journal, Vol 11, Iss 1 (2020)
institution DOAJ
collection DOAJ
language EN
topic Education (General)
L7-991
Medicine (General)
R5-920
spellingShingle Education (General)
L7-991
Medicine (General)
R5-920
Brent Thoma
Venkat Bandi
Robert Carey
Debajyoti Mondal
Robert Woods
Lynsey Martin
Teresa Chan
Developing a dashboard to meet Competence Committee needs: a design-based research project
description Background: Competency-based programs are being adopted in medical education around the world. Competence Committees must visualize learner assessment data effectively to support their decision-making. Dashboards play an integral role in decision support systems in other fields. Design-based research allows the simultaneous development and study of educational environments. Methods: We utilized a design-based research process within the emergency medicine residency program at the University of Saskatchewan to identify the data, analytics, and visualizations needed by its Competence Committee, and developed a dashboard incorporating these elements. Narrative data were collected from two focus groups, five interviews, and the observation of two Competence Committee meetings. Data were qualitatively analyzed to develop a thematic framework outlining the needs of the Competence Committee and to inform the development of the dashboard. Results: The qualitative analysis identified four Competence Committee needs (Explore Workplace-Based Assessment Data, Explore Other Assessment Data, Understand the Data in Context, and Ensure the Security of the Data). These needs were described with narratives and represented through visualizations of the dashboard elements. Conclusions: This work addresses the practical challenges of supporting data-driven decision making by Competence Committees and will inform the development of dashboards for programs, institutions, and learner management systems.
format article
author Brent Thoma
Venkat Bandi
Robert Carey
Debajyoti Mondal
Robert Woods
Lynsey Martin
Teresa Chan
author_facet Brent Thoma
Venkat Bandi
Robert Carey
Debajyoti Mondal
Robert Woods
Lynsey Martin
Teresa Chan
author_sort Brent Thoma
title Developing a dashboard to meet Competence Committee needs: a design-based research project
title_short Developing a dashboard to meet Competence Committee needs: a design-based research project
title_full Developing a dashboard to meet Competence Committee needs: a design-based research project
title_fullStr Developing a dashboard to meet Competence Committee needs: a design-based research project
title_full_unstemmed Developing a dashboard to meet Competence Committee needs: a design-based research project
title_sort developing a dashboard to meet competence committee needs: a design-based research project
publisher Canadian Medical Education Journal
publishDate 2020
url https://doaj.org/article/df7960ae034f42b5a25126717c320241
work_keys_str_mv AT brentthoma developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
AT venkatbandi developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
AT robertcarey developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
AT debajyotimondal developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
AT robertwoods developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
AT lynseymartin developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
AT teresachan developingadashboardtomeetcompetencecommitteeneedsadesignbasedresearchproject
_version_ 1718404074209017856