Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework

This paper describes the use of Kane’s validity framework to redevelop a workplace-based assessment program for practicing physicians administered by the College of Physicians and Surgeons of Ontario. The developmental process is presented according to the four inferences in Kane’s model. Scoring wa...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Kathryn Hodwitz, William Tays, Rhoda Reardon
Formato:	article
Lenguaje:	EN
Publicado:	Canadian Medical Education Journal 2018
Materias:	Workplace-based assessment validity physicians continuing professional development Education (General) L7-991 Medicine (General) R5-920
Acceso en línea:	https://doaj.org/article/b6aefb1d810d485d97b141eb4e058332
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:b6aefb1d810d485d97b141eb4e058332
record_format	dspace
spelling	oai:doaj.org-article:b6aefb1d810d485d97b141eb4e0583322021-12-01T22:44:21ZRedeveloping a workplace-based assessment program for physicians using Kane’s validity framework10.36834/cmej.422861923-1202https://doaj.org/article/b6aefb1d810d485d97b141eb4e0583322018-07-01T00:00:00Zhttps://journalhosting.ucalgary.ca/index.php/cmej/article/view/42286https://doaj.org/toc/1923-1202This paper describes the use of Kane’s validity framework to redevelop a workplace-based assessment program for practicing physicians administered by the College of Physicians and Surgeons of Ontario. The developmental process is presented according to the four inferences in Kane’s model. Scoring was addressed through the creation of specialty-specific assessment criteria and global, narrative-focused reports. Generalization was addressed through standardized sampling protocols and assessor training and consensus-building. Extrapolation was addressed through the use of real-world performance data and an external review of the scoring tools by practicing physicians. Implications were theoretically supported through adherence to formative assessment principles and will be assessed through an evaluation accompanying the implementation of the redeveloped program. Kane’s framework was valuable for guiding the redevelopment process and for systematically collecting validity evidence throughout to support the use of the assessment for its intended purpose. As the use of workplace-based assessment programs for physicians continues to increase, practical examples are needed of how to develop and evaluate these programs using established frameworks. The dissemination of comprehensive validity arguments is vital for sharing knowledge about the development and evaluation of WBA programs and for understanding the effects of these assessments on physician practice improvement. Kathryn HodwitzWilliam TaysRhoda ReardonCanadian Medical Education JournalarticleWorkplace-based assessmentvalidityphysicianscontinuing professional developmentEducation (General)L7-991Medicine (General)R5-920ENCanadian Medical Education Journal, Vol 9, Iss 3 (2018)
institution	DOAJ
collection	DOAJ
language	EN
topic	Workplace-based assessment validity physicians continuing professional development Education (General) L7-991 Medicine (General) R5-920
spellingShingle	Workplace-based assessment validity physicians continuing professional development Education (General) L7-991 Medicine (General) R5-920 Kathryn Hodwitz William Tays Rhoda Reardon Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
description	This paper describes the use of Kane’s validity framework to redevelop a workplace-based assessment program for practicing physicians administered by the College of Physicians and Surgeons of Ontario. The developmental process is presented according to the four inferences in Kane’s model. Scoring was addressed through the creation of specialty-specific assessment criteria and global, narrative-focused reports. Generalization was addressed through standardized sampling protocols and assessor training and consensus-building. Extrapolation was addressed through the use of real-world performance data and an external review of the scoring tools by practicing physicians. Implications were theoretically supported through adherence to formative assessment principles and will be assessed through an evaluation accompanying the implementation of the redeveloped program. Kane’s framework was valuable for guiding the redevelopment process and for systematically collecting validity evidence throughout to support the use of the assessment for its intended purpose. As the use of workplace-based assessment programs for physicians continues to increase, practical examples are needed of how to develop and evaluate these programs using established frameworks. The dissemination of comprehensive validity arguments is vital for sharing knowledge about the development and evaluation of WBA programs and for understanding the effects of these assessments on physician practice improvement.
format	article
author	Kathryn Hodwitz William Tays Rhoda Reardon
author_facet	Kathryn Hodwitz William Tays Rhoda Reardon
author_sort	Kathryn Hodwitz
title	Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
title_short	Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
title_full	Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
title_fullStr	Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
title_full_unstemmed	Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework
title_sort	redeveloping a workplace-based assessment program for physicians using kane’s validity framework
publisher	Canadian Medical Education Journal
publishDate	2018
url	https://doaj.org/article/b6aefb1d810d485d97b141eb4e058332
work_keys_str_mv	AT kathrynhodwitz redevelopingaworkplacebasedassessmentprogramforphysiciansusingkanesvalidityframework AT williamtays redevelopingaworkplacebasedassessmentprogramforphysiciansusingkanesvalidityframework AT rhodareardon redevelopingaworkplacebasedassessmentprogramforphysiciansusingkanesvalidityframework
_version_	1718404065181827072

Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework

Ejemplares similares