Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project

Background: Canadian specialty programs are implementing Competence By Design, a competency-based medical education (CBME) program which requires frequent assessments of entrustable professional activities. To be used for learning, the large amount of assessment data needs to be interpreted by resi...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Robert Carey, Grayson Wilson, Venkat Bandi, Debajyoti Mondal, Lynsey Martin, Rob Woods, Teresa Chan, Brent Thoma
Formato: article
Lenguaje:EN
Publicado: Canadian Medical Education Journal 2020
Materias:
Acceso en línea:https://doaj.org/article/18c309cd298b4bc48e3ae9b4397ab781
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:18c309cd298b4bc48e3ae9b4397ab781
record_format dspace
spelling oai:doaj.org-article:18c309cd298b4bc48e3ae9b4397ab7812021-12-01T22:38:34ZDeveloping a dashboard to meet the needs of residents in a competency-based training program: A design-based research project10.36834/cmej.696821923-1202https://doaj.org/article/18c309cd298b4bc48e3ae9b4397ab7812020-09-01T00:00:00Zhttps://journalhosting.ucalgary.ca/index.php/cmej/article/view/69682https://doaj.org/toc/1923-1202 Background: Canadian specialty programs are implementing Competence By Design, a competency-based medical education (CBME) program which requires frequent assessments of entrustable professional activities. To be used for learning, the large amount of assessment data needs to be interpreted by residents, but little work has been done to determine how visualizing and interacting with this data can be supported. Within the University of Saskatchewan emergency medicine residency program, we sought to determine how our residents’ CBME assessment data should be presented to support their learning and to develop a dashboard that meets our residents’ needs. Methods: We utilized a design-based research process to identify and address resident needs surrounding the presentation of their assessment data. Data was collected within the emergency medicine residency program at the University of Saskatchewan via four resident focus groups held over 10 months. Focus group discussions were analyzed using a grounded theory approach to identify resident needs. This guided the development of a dashboard which contained elements (data, analytics, and visualizations) that support their interpretation of the data. The identified needs are described using quotes from the focus groups as well as visualizations of the dashboard elements. Results: Resident needs were classified under three themes: (1) Provide guidance through the assessment program, (2) Present workplace-based assessment data, and (3) Present other assessment data. Seventeen dashboard elements were designed to address these needs. Conclusions: Our design-based research process identified resident needs and developed dashboard elements to meet them. This work will inform the creation and evolution of CBME assessment dashboards designed to support resident learning. Robert CareyGrayson WilsonVenkat BandiDebajyoti MondalLynsey MartinRob WoodsTeresa ChanBrent ThomaCanadian Medical Education JournalarticleEducation (General)L7-991Medicine (General)R5-920ENCanadian Medical Education Journal, Vol 11, Iss 6 (2020)
institution DOAJ
collection DOAJ
language EN
topic Education (General)
L7-991
Medicine (General)
R5-920
spellingShingle Education (General)
L7-991
Medicine (General)
R5-920
Robert Carey
Grayson Wilson
Venkat Bandi
Debajyoti Mondal
Lynsey Martin
Rob Woods
Teresa Chan
Brent Thoma
Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project
description Background: Canadian specialty programs are implementing Competence By Design, a competency-based medical education (CBME) program which requires frequent assessments of entrustable professional activities. To be used for learning, the large amount of assessment data needs to be interpreted by residents, but little work has been done to determine how visualizing and interacting with this data can be supported. Within the University of Saskatchewan emergency medicine residency program, we sought to determine how our residents’ CBME assessment data should be presented to support their learning and to develop a dashboard that meets our residents’ needs. Methods: We utilized a design-based research process to identify and address resident needs surrounding the presentation of their assessment data. Data was collected within the emergency medicine residency program at the University of Saskatchewan via four resident focus groups held over 10 months. Focus group discussions were analyzed using a grounded theory approach to identify resident needs. This guided the development of a dashboard which contained elements (data, analytics, and visualizations) that support their interpretation of the data. The identified needs are described using quotes from the focus groups as well as visualizations of the dashboard elements. Results: Resident needs were classified under three themes: (1) Provide guidance through the assessment program, (2) Present workplace-based assessment data, and (3) Present other assessment data. Seventeen dashboard elements were designed to address these needs. Conclusions: Our design-based research process identified resident needs and developed dashboard elements to meet them. This work will inform the creation and evolution of CBME assessment dashboards designed to support resident learning.
format article
author Robert Carey
Grayson Wilson
Venkat Bandi
Debajyoti Mondal
Lynsey Martin
Rob Woods
Teresa Chan
Brent Thoma
author_facet Robert Carey
Grayson Wilson
Venkat Bandi
Debajyoti Mondal
Lynsey Martin
Rob Woods
Teresa Chan
Brent Thoma
author_sort Robert Carey
title Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project
title_short Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project
title_full Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project
title_fullStr Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project
title_full_unstemmed Developing a dashboard to meet the needs of residents in a competency-based training program: A design-based research project
title_sort developing a dashboard to meet the needs of residents in a competency-based training program: a design-based research project
publisher Canadian Medical Education Journal
publishDate 2020
url https://doaj.org/article/18c309cd298b4bc48e3ae9b4397ab781
work_keys_str_mv AT robertcarey developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT graysonwilson developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT venkatbandi developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT debajyotimondal developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT lynseymartin developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT robwoods developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT teresachan developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
AT brentthoma developingadashboardtomeettheneedsofresidentsinacompetencybasedtrainingprogramadesignbasedresearchproject
_version_ 1718404087413735424