Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training

AIM The study aims to determine resident applicant metrics most predictive of academic and clinical performance as measured by the Council of Resident Education in Obstetrics and Gynecology (CREOG) examination scores and Accreditation Council for Graduate Medical Education (ACGME) clinical performan...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Sejal Tamakuwala, Joshua Dean, Katherine J. Kramer, Adib Shafi, Sarah Ottum, Joshua George, Satinder Kaur, Conrad R. Chao, Maurice-Andre Recanati
Formato:	article
Lenguaje:	EN
Publicado:	SAGE Publishing 2021
Materias:	Special aspects of education LC8-6691 Medicine (General) R5-920
Acceso en línea:	https://doaj.org/article/4d7366da031842cbab62fe4f8c086027
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:4d7366da031842cbab62fe4f8c086027
record_format	dspace
spelling	oai:doaj.org-article:4d7366da031842cbab62fe4f8c0860272021-11-15T22:33:29ZPotential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training2382-120510.1177/23821205211037444https://doaj.org/article/4d7366da031842cbab62fe4f8c0860272021-11-01T00:00:00Zhttps://doi.org/10.1177/23821205211037444https://doaj.org/toc/2382-1205AIM The study aims to determine resident applicant metrics most predictive of academic and clinical performance as measured by the Council of Resident Education in Obstetrics and Gynecology (CREOG) examination scores and Accreditation Council for Graduate Medical Education (ACGME) clinical performance (Milestones) in the aftermath of United States Medical Licensing Examination Scores (USMLE) Step 1 becoming a pass/fail examination. METHODS In this retrospective study, electronic and paper documents for Wayne State University Obstetrics and Gynecology residents matriculated over a 5-year period ending July 2018 were collected. USMLE scores, clerkship grade, and wording on the letters of recommendation as well as Medical Student Performance Evaluation (MSPE) were extracted from the Electronic Residency Application Service (ERAS) and scored numerically. Semiannual Milestone evaluations and yearly CREOG scores were used as a marker of resident performance. Statistical analysis on residents (n = 75) was performed using R and SPSS and significance was set at P < .05. RESULTS Mean USMLE score correlated with CREOG performance and, of all 3 Steps, Step 1 had the tightest association. MSPE and class percentile also correlated with CREOGs. Clerkship grade and recommendation letters had no correlation with resident performance. Of all metrics provided by ERAS, none taken alone, were as useful as Step 1 scores at predicting performance in residency. Regression modeling demonstrated that the combination of Step 2 scores with MSPE wording restored the predictive ability lost by Step 1. CONCLUSIONS The change of USMLE Step 1 to pass/fail may alter resident selection strategies. Other objective markers are needed in order to evaluate an applicant’s future performance in residency.Sejal TamakuwalaJoshua DeanKatherine J. Kramer Adib ShafiSarah OttumJoshua GeorgeSatinder KaurConrad R. ChaoMaurice-Andre RecanatiSAGE PublishingarticleSpecial aspects of educationLC8-6691Medicine (General)R5-920ENJournal of Medical Education and Curricular Development, Vol 8 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	Special aspects of education LC8-6691 Medicine (General) R5-920
spellingShingle	Special aspects of education LC8-6691 Medicine (General) R5-920 Sejal Tamakuwala Joshua Dean Katherine J. Kramer Adib Shafi Sarah Ottum Joshua George Satinder Kaur Conrad R. Chao Maurice-Andre Recanati Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training
description	AIM The study aims to determine resident applicant metrics most predictive of academic and clinical performance as measured by the Council of Resident Education in Obstetrics and Gynecology (CREOG) examination scores and Accreditation Council for Graduate Medical Education (ACGME) clinical performance (Milestones) in the aftermath of United States Medical Licensing Examination Scores (USMLE) Step 1 becoming a pass/fail examination. METHODS In this retrospective study, electronic and paper documents for Wayne State University Obstetrics and Gynecology residents matriculated over a 5-year period ending July 2018 were collected. USMLE scores, clerkship grade, and wording on the letters of recommendation as well as Medical Student Performance Evaluation (MSPE) were extracted from the Electronic Residency Application Service (ERAS) and scored numerically. Semiannual Milestone evaluations and yearly CREOG scores were used as a marker of resident performance. Statistical analysis on residents (n = 75) was performed using R and SPSS and significance was set at P < .05. RESULTS Mean USMLE score correlated with CREOG performance and, of all 3 Steps, Step 1 had the tightest association. MSPE and class percentile also correlated with CREOGs. Clerkship grade and recommendation letters had no correlation with resident performance. Of all metrics provided by ERAS, none taken alone, were as useful as Step 1 scores at predicting performance in residency. Regression modeling demonstrated that the combination of Step 2 scores with MSPE wording restored the predictive ability lost by Step 1. CONCLUSIONS The change of USMLE Step 1 to pass/fail may alter resident selection strategies. Other objective markers are needed in order to evaluate an applicant’s future performance in residency.
format	article
author	Sejal Tamakuwala Joshua Dean Katherine J. Kramer Adib Shafi Sarah Ottum Joshua George Satinder Kaur Conrad R. Chao Maurice-Andre Recanati
author_facet	Sejal Tamakuwala Joshua Dean Katherine J. Kramer Adib Shafi Sarah Ottum Joshua George Satinder Kaur Conrad R. Chao Maurice-Andre Recanati
author_sort	Sejal Tamakuwala
title	Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training
title_short	Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training
title_full	Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training
title_fullStr	Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training
title_full_unstemmed	Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training
title_sort	potential impact of pass/fail scores on usmle step 1: predictors of excellence in obstetrics and gynecology residency training
publisher	SAGE Publishing
publishDate	2021
url	https://doaj.org/article/4d7366da031842cbab62fe4f8c086027
work_keys_str_mv	AT sejaltamakuwala potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT joshuadean potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT katherinejkramer potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT adibshafi potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT sarahottum potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT joshuageorge potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT satinderkaur potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT conradrchao potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining AT mauriceandrerecanati potentialimpactofpassfailscoresonusmlestep1predictorsofexcellenceinobstetricsandgynecologyresidencytraining
_version_	1718426783807700992

Potential Impact of Pass/Fail Scores on USMLE Step 1: Predictors of Excellence in Obstetrics and Gynecology Residency Training

Ejemplares similares