Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency

Purpose Only from reviewing applications, it is difficult to identify which applicants will be successful ophthalmology residents. The change of the USMLE Step 1 scoring to “Pass/Fail” removes another quantitative metric. We aimed to identify application attributes correlated with successful residen...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Brett M. Gudgel, Andrew T. Melson, Justin Dvorak, Kai Ding, R. Michael Siatkowski
Formato:	article
Lenguaje:	EN
Publicado:	Thieme Medical Publishers, Inc. 2021
Materias:	residency application resident performance artificial intelligence Ophthalmology RE1-994
Acceso en línea:	https://doaj.org/article/b19c8d96136b42bbbd5283fb66c3f875
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:b19c8d96136b42bbbd5283fb66c3f875
record_format	dspace
spelling	oai:doaj.org-article:b19c8d96136b42bbbd5283fb66c3f8752021-11-10T23:30:42ZCorrelation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency2475-475710.1055/s-0041-1733932https://doaj.org/article/b19c8d96136b42bbbd5283fb66c3f8752021-07-01T00:00:00Zhttp://www.thieme-connect.de/DOI/DOI?10.1055/s-0041-1733932https://doaj.org/toc/2475-4757Purpose Only from reviewing applications, it is difficult to identify which applicants will be successful ophthalmology residents. The change of the USMLE Step 1 scoring to “Pass/Fail” removes another quantitative metric. We aimed to identify application attributes correlated with successful residency performance. This study also used artificial intelligence (AI) to evaluate letters of recommendation (LOR), the Dean's letter (MSPE), and personal statement (PS). Design Retrospective analysis of application characteristics versus residency performance was conducted. Participants Residents who graduated from the Dean McGee Eye Institute/University of Oklahoma Ophthalmology residency from 2004 to 2019 were included in this study. Methods Thirty-four attributes were recorded from each application. Residents were subjectively ranked into tertiles and top and bottom deciles based on residency performance by faculty present during their training. The Ophthalmic Knowledge Assessment Program (OKAP) examination scores were used as an objective performance metric. Analysis was performed to identify associations between application attributes and tertile/decile ranking. Additional analysis used AI and natural language processing to evaluate applicant LORs, MSPE, and PS. Main Outcome Measures Characteristics from residency applications that correlate with resident performance were the primary outcome of this study. Results Fifty-five residents and 21 faculty members were included. A grade of “A” or “Honors” in the obstetrics/gynecology (OB/GYN) clerkship and the presence of a home ophthalmology department were associated with ranking in the top tertile but not the top decile. Mean core clerkship grades, medical school ranking in the top 25 U.S. News and World Report (USNWR) primary care rankings, and postgraduate year (PGY)-2 and PGY-3 OKAP scores were predictive of being ranked in both the top tertile and the top decile. USMLE scores, alpha-omega-alpha (AOA) status, and number of publications did not correlate with subjective resident performance. AI analysis of LORs, MSPE, and PS did not identify any text features that correlated with resident performance. Conclusions Many metrics traditionally felt to be predictive of residency success (USMLE scores, AOA status, and research) did not predict resident success in our study. We did confirm the importance of core clerkship grades and medical school ranking. Objective measures of success such as PGY-2 and PGY-3 OKAP scores were associated with high subjective ranking.Brett M. GudgelAndrew T. MelsonJustin DvorakKai DingR. Michael SiatkowskiThieme Medical Publishers, Inc.articleresidency applicationresident performanceartificial intelligenceOphthalmologyRE1-994ENJournal of Academic Ophthalmology, Vol 13, Iss 02, Pp e151-e157 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	residency application resident performance artificial intelligence Ophthalmology RE1-994
spellingShingle	residency application resident performance artificial intelligence Ophthalmology RE1-994 Brett M. Gudgel Andrew T. Melson Justin Dvorak Kai Ding R. Michael Siatkowski Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency
description	Purpose Only from reviewing applications, it is difficult to identify which applicants will be successful ophthalmology residents. The change of the USMLE Step 1 scoring to “Pass/Fail” removes another quantitative metric. We aimed to identify application attributes correlated with successful residency performance. This study also used artificial intelligence (AI) to evaluate letters of recommendation (LOR), the Dean's letter (MSPE), and personal statement (PS). Design Retrospective analysis of application characteristics versus residency performance was conducted. Participants Residents who graduated from the Dean McGee Eye Institute/University of Oklahoma Ophthalmology residency from 2004 to 2019 were included in this study. Methods Thirty-four attributes were recorded from each application. Residents were subjectively ranked into tertiles and top and bottom deciles based on residency performance by faculty present during their training. The Ophthalmic Knowledge Assessment Program (OKAP) examination scores were used as an objective performance metric. Analysis was performed to identify associations between application attributes and tertile/decile ranking. Additional analysis used AI and natural language processing to evaluate applicant LORs, MSPE, and PS. Main Outcome Measures Characteristics from residency applications that correlate with resident performance were the primary outcome of this study. Results Fifty-five residents and 21 faculty members were included. A grade of “A” or “Honors” in the obstetrics/gynecology (OB/GYN) clerkship and the presence of a home ophthalmology department were associated with ranking in the top tertile but not the top decile. Mean core clerkship grades, medical school ranking in the top 25 U.S. News and World Report (USNWR) primary care rankings, and postgraduate year (PGY)-2 and PGY-3 OKAP scores were predictive of being ranked in both the top tertile and the top decile. USMLE scores, alpha-omega-alpha (AOA) status, and number of publications did not correlate with subjective resident performance. AI analysis of LORs, MSPE, and PS did not identify any text features that correlated with resident performance. Conclusions Many metrics traditionally felt to be predictive of residency success (USMLE scores, AOA status, and research) did not predict resident success in our study. We did confirm the importance of core clerkship grades and medical school ranking. Objective measures of success such as PGY-2 and PGY-3 OKAP scores were associated with high subjective ranking.
format	article
author	Brett M. Gudgel Andrew T. Melson Justin Dvorak Kai Ding R. Michael Siatkowski
author_facet	Brett M. Gudgel Andrew T. Melson Justin Dvorak Kai Ding R. Michael Siatkowski
author_sort	Brett M. Gudgel
title	Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency
title_short	Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency
title_full	Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency
title_fullStr	Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency
title_full_unstemmed	Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency
title_sort	correlation of ophthalmology residency application characteristics with subsequent performance in residency
publisher	Thieme Medical Publishers, Inc.
publishDate	2021
url	https://doaj.org/article/b19c8d96136b42bbbd5283fb66c3f875
work_keys_str_mv	AT brettmgudgel correlationofophthalmologyresidencyapplicationcharacteristicswithsubsequentperformanceinresidency AT andrewtmelson correlationofophthalmologyresidencyapplicationcharacteristicswithsubsequentperformanceinresidency AT justindvorak correlationofophthalmologyresidencyapplicationcharacteristicswithsubsequentperformanceinresidency AT kaiding correlationofophthalmologyresidencyapplicationcharacteristicswithsubsequentperformanceinresidency AT rmichaelsiatkowski correlationofophthalmologyresidencyapplicationcharacteristicswithsubsequentperformanceinresidency
_version_	1718439709116465152

Correlation of Ophthalmology Residency Application Characteristics with Subsequent Performance in Residency

Ejemplares similares