Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity
Abstract To describe a database of longitudinally graded telemedicine retinal images to be used as a comparator for future studies assessing grader recall bias and ability to detect typical progression (e.g. International Classification of Retinopathy of Prematurity (ICROP) stages) as well as increm...
Guardado en:
Autores principales: | , , , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Nature Portfolio
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/be6715e33983492dae1872506a4e189d |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:be6715e33983492dae1872506a4e189d |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:be6715e33983492dae1872506a4e189d2021-12-02T15:53:02ZKey factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity10.1038/s41598-021-84723-72045-2322https://doaj.org/article/be6715e33983492dae1872506a4e189d2021-03-01T00:00:00Zhttps://doi.org/10.1038/s41598-021-84723-7https://doaj.org/toc/2045-2322Abstract To describe a database of longitudinally graded telemedicine retinal images to be used as a comparator for future studies assessing grader recall bias and ability to detect typical progression (e.g. International Classification of Retinopathy of Prematurity (ICROP) stages) as well as incremental changes in retinopathy of prematurity (ROP). Cohort comprised of retinal images from 84 eyes of 42 patients who were sequentially screened for ROP over 6 consecutive weeks in a telemedicine program and then followed to vascular maturation or treatment, and then disease stabilization. De-identified retinal images across the 6 weekly exams (2520 total images) were graded by an ROP expert based on whether ROP had improved, worsened, or stayed the same compared to the prior week’s images, corresponding to an overall clinical “gestalt” score. Subsequently, we examined which parameters might have influenced the examiner’s ability to detect longitudinal change; images were graded by the same ROP expert by image view (central, inferior, nasal, superior, temporal) and by retinal components (vascular tortuosity, vascular dilation, stage, hemorrhage, vessel growth), again determining if each particular retinal component or ROP in each image view had improved, worsened, or stayed the same compared to the prior week’s images. Agreement between gestalt scores and view, component, and component by view scores was assessed using percent agreement, absolute agreement, and Cohen’s weighted kappa statistic to determine if any of the hypothesized image features correlated with the ability to predict ROP disease trajectory in patients. The central view showed substantial agreement with gestalt scores (κ = 0.63), with moderate agreement in the remaining views. Of retinal components, vascular tortuosity showed the most overall agreement with gestalt (κ = 0.42–0.61), with only slight to fair agreement for all other components. This is a well-defined ROP database graded by one expert in a real-world setting in a masked fashion that correlated with the actual (remote in time) exams and known outcomes. This provides a foundation for subsequent study of telemedicine’s ability to longitudinally assess ROP disease trajectory, as well as for potential artificial intelligence approaches to retinal image grading, in order to expand patient access to timely, accurate ROP screening.Tatiana R. RosenblattMarco H. JiDaniel VailCassie A. LudwigAhmad Al-MoujahedMalini Veerappan PasrichaNatalia F. CallawayJochen KummDarius M. MoshfeghiNature PortfolioarticleMedicineRScienceQENScientific Reports, Vol 11, Iss 1, Pp 1-8 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Tatiana R. Rosenblatt Marco H. Ji Daniel Vail Cassie A. Ludwig Ahmad Al-Moujahed Malini Veerappan Pasricha Natalia F. Callaway Jochen Kumm Darius M. Moshfeghi Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
description |
Abstract To describe a database of longitudinally graded telemedicine retinal images to be used as a comparator for future studies assessing grader recall bias and ability to detect typical progression (e.g. International Classification of Retinopathy of Prematurity (ICROP) stages) as well as incremental changes in retinopathy of prematurity (ROP). Cohort comprised of retinal images from 84 eyes of 42 patients who were sequentially screened for ROP over 6 consecutive weeks in a telemedicine program and then followed to vascular maturation or treatment, and then disease stabilization. De-identified retinal images across the 6 weekly exams (2520 total images) were graded by an ROP expert based on whether ROP had improved, worsened, or stayed the same compared to the prior week’s images, corresponding to an overall clinical “gestalt” score. Subsequently, we examined which parameters might have influenced the examiner’s ability to detect longitudinal change; images were graded by the same ROP expert by image view (central, inferior, nasal, superior, temporal) and by retinal components (vascular tortuosity, vascular dilation, stage, hemorrhage, vessel growth), again determining if each particular retinal component or ROP in each image view had improved, worsened, or stayed the same compared to the prior week’s images. Agreement between gestalt scores and view, component, and component by view scores was assessed using percent agreement, absolute agreement, and Cohen’s weighted kappa statistic to determine if any of the hypothesized image features correlated with the ability to predict ROP disease trajectory in patients. The central view showed substantial agreement with gestalt scores (κ = 0.63), with moderate agreement in the remaining views. Of retinal components, vascular tortuosity showed the most overall agreement with gestalt (κ = 0.42–0.61), with only slight to fair agreement for all other components. This is a well-defined ROP database graded by one expert in a real-world setting in a masked fashion that correlated with the actual (remote in time) exams and known outcomes. This provides a foundation for subsequent study of telemedicine’s ability to longitudinally assess ROP disease trajectory, as well as for potential artificial intelligence approaches to retinal image grading, in order to expand patient access to timely, accurate ROP screening. |
format |
article |
author |
Tatiana R. Rosenblatt Marco H. Ji Daniel Vail Cassie A. Ludwig Ahmad Al-Moujahed Malini Veerappan Pasricha Natalia F. Callaway Jochen Kumm Darius M. Moshfeghi |
author_facet |
Tatiana R. Rosenblatt Marco H. Ji Daniel Vail Cassie A. Ludwig Ahmad Al-Moujahed Malini Veerappan Pasricha Natalia F. Callaway Jochen Kumm Darius M. Moshfeghi |
author_sort |
Tatiana R. Rosenblatt |
title |
Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
title_short |
Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
title_full |
Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
title_fullStr |
Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
title_full_unstemmed |
Key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
title_sort |
key factors in a rigorous longitudinal image-based assessment of retinopathy of prematurity |
publisher |
Nature Portfolio |
publishDate |
2021 |
url |
https://doaj.org/article/be6715e33983492dae1872506a4e189d |
work_keys_str_mv |
AT tatianarrosenblatt keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT marcohji keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT danielvail keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT cassiealudwig keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT ahmadalmoujahed keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT maliniveerappanpasricha keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT nataliafcallaway keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT jochenkumm keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity AT dariusmmoshfeghi keyfactorsinarigorouslongitudinalimagebasedassessmentofretinopathyofprematurity |
_version_ |
1718385533637361664 |