Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.

Differentiating the invasiveness of ground-glass nodules (GGN) is clinically important, and several institutions have attempted to develop their own solutions by using computed tomography images. The purpose of this study is to evaluate Computer-Aided Analysis of Risk Yield (CANARY), a validated vir...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Juyoung Lee, Brian Bartholmai, Tobias Peikert, Jaehee Chun, Hojin Kim, Jin Sung Kim, Seong Yong Park
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2021
Materias:
R
Q
Acceso en línea:https://doaj.org/article/d014b98624ad4094bad3b1bf1762b4ed
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:d014b98624ad4094bad3b1bf1762b4ed
record_format dspace
spelling oai:doaj.org-article:d014b98624ad4094bad3b1bf1762b4ed2021-12-02T20:10:42ZEvaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.1932-620310.1371/journal.pone.0253204https://doaj.org/article/d014b98624ad4094bad3b1bf1762b4ed2021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0253204https://doaj.org/toc/1932-6203Differentiating the invasiveness of ground-glass nodules (GGN) is clinically important, and several institutions have attempted to develop their own solutions by using computed tomography images. The purpose of this study is to evaluate Computer-Aided Analysis of Risk Yield (CANARY), a validated virtual biopsy and risk-stratification machine-learning tool for lung adenocarcinomas, in a Korean patient population. To this end, a total of 380 GGNs from 360 patients who underwent pulmonary resection in a single institution were reviewed. Based on the Score Indicative of Lung Cancer Aggression (SILA), a quantitative indicator of CANARY analysis results, all of the GGNs were classified as "indolent" (atypical adenomatous hyperplasia, adenocarcinomas in situ, or minimally invasive adenocarcinoma) or "invasive" (invasive adenocarcinoma) and compared with the pathology reports. By considering the possibility of uneven class distribution, statistical analysis was performed on the 1) entire cohort and 2) randomly extracted six sets of class-balanced samples. For each trial, the optimal cutoff SILA was obtained from the receiver operating characteristic curve. The classification results were evaluated using several binary classification metrics. Of a total of 380 GGNs, the mean SILA for 65 (17.1%) indolent and 315 (82.9%) invasive lesions were 0.195±0.124 and 0.391±0.208 (p < 0.0001). The area under the curve (AUC) of each trial was 0.814 and 0.809, with an optimal threshold SILA of 0.229 for both. The macro F1-score and geometric mean were found to be 0.675 and 0.745 for the entire cohort, while both scored 0.741 in the class-equalized dataset. From these results, CANARY could be confirmed acceptable in classifying GGN for Korean patients after the cutoff SILA was calibrated. We found that adjusting the cutoff SILA is needed to use CANARY in other countries or races, and geometric mean could be more objective than F1-score or AUC in the binary classification of imbalanced data.Juyoung LeeBrian BartholmaiTobias PeikertJaehee ChunHojin KimJin Sung KimSeong Yong ParkPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 6, p e0253204 (2021)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Juyoung Lee
Brian Bartholmai
Tobias Peikert
Jaehee Chun
Hojin Kim
Jin Sung Kim
Seong Yong Park
Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.
description Differentiating the invasiveness of ground-glass nodules (GGN) is clinically important, and several institutions have attempted to develop their own solutions by using computed tomography images. The purpose of this study is to evaluate Computer-Aided Analysis of Risk Yield (CANARY), a validated virtual biopsy and risk-stratification machine-learning tool for lung adenocarcinomas, in a Korean patient population. To this end, a total of 380 GGNs from 360 patients who underwent pulmonary resection in a single institution were reviewed. Based on the Score Indicative of Lung Cancer Aggression (SILA), a quantitative indicator of CANARY analysis results, all of the GGNs were classified as "indolent" (atypical adenomatous hyperplasia, adenocarcinomas in situ, or minimally invasive adenocarcinoma) or "invasive" (invasive adenocarcinoma) and compared with the pathology reports. By considering the possibility of uneven class distribution, statistical analysis was performed on the 1) entire cohort and 2) randomly extracted six sets of class-balanced samples. For each trial, the optimal cutoff SILA was obtained from the receiver operating characteristic curve. The classification results were evaluated using several binary classification metrics. Of a total of 380 GGNs, the mean SILA for 65 (17.1%) indolent and 315 (82.9%) invasive lesions were 0.195±0.124 and 0.391±0.208 (p < 0.0001). The area under the curve (AUC) of each trial was 0.814 and 0.809, with an optimal threshold SILA of 0.229 for both. The macro F1-score and geometric mean were found to be 0.675 and 0.745 for the entire cohort, while both scored 0.741 in the class-equalized dataset. From these results, CANARY could be confirmed acceptable in classifying GGN for Korean patients after the cutoff SILA was calibrated. We found that adjusting the cutoff SILA is needed to use CANARY in other countries or races, and geometric mean could be more objective than F1-score or AUC in the binary classification of imbalanced data.
format article
author Juyoung Lee
Brian Bartholmai
Tobias Peikert
Jaehee Chun
Hojin Kim
Jin Sung Kim
Seong Yong Park
author_facet Juyoung Lee
Brian Bartholmai
Tobias Peikert
Jaehee Chun
Hojin Kim
Jin Sung Kim
Seong Yong Park
author_sort Juyoung Lee
title Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.
title_short Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.
title_full Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.
title_fullStr Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.
title_full_unstemmed Evaluation of Computer-Aided Nodule Assessment and Risk Yield (CANARY) in Korean patients for prediction of invasiveness of ground-glass opacity nodule.
title_sort evaluation of computer-aided nodule assessment and risk yield (canary) in korean patients for prediction of invasiveness of ground-glass opacity nodule.
publisher Public Library of Science (PLoS)
publishDate 2021
url https://doaj.org/article/d014b98624ad4094bad3b1bf1762b4ed
work_keys_str_mv AT juyounglee evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
AT brianbartholmai evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
AT tobiaspeikert evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
AT jaeheechun evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
AT hojinkim evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
AT jinsungkim evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
AT seongyongpark evaluationofcomputeraidednoduleassessmentandriskyieldcanaryinkoreanpatientsforpredictionofinvasivenessofgroundglassopacitynodule
_version_ 1718374973272227840