Automated coronary calcium scoring using deep learning with multicenter external validation

Abstract Coronary artery disease (CAD), the most common manifestation of cardiovascular disease, remains the most common cause of mortality in the United States. Risk assessment is key for primary prevention of coronary events and coronary artery calcium (CAC) scoring using computed tomography (CT)...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: David Eng, Christopher Chute, Nishith Khandwala, Pranav Rajpurkar, Jin Long, Sam Shleifer, Mohamed H. Khalaf, Alexander T. Sandhu, Fatima Rodriguez, David J. Maron, Saeed Seyyedi, Daniele Marin, Ilana Golub, Matthew Budoff, Felipe Kitamura, Marcelo Straus Takahashi, Ross W. Filice, Rajesh Shah, John Mongan, Kimberly Kallianos, Curtis P. Langlotz, Matthew P. Lungren, Andrew Y. Ng, Bhavik N. Patel
Formato: article
Lenguaje:EN
Publicado: Nature Portfolio 2021
Materias:
Acceso en línea:https://doaj.org/article/c45dfc0724e243f6aed1edf848f05660
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:c45dfc0724e243f6aed1edf848f05660
record_format dspace
spelling oai:doaj.org-article:c45dfc0724e243f6aed1edf848f056602021-12-02T17:51:14ZAutomated coronary calcium scoring using deep learning with multicenter external validation10.1038/s41746-021-00460-12398-6352https://doaj.org/article/c45dfc0724e243f6aed1edf848f056602021-06-01T00:00:00Zhttps://doi.org/10.1038/s41746-021-00460-1https://doaj.org/toc/2398-6352Abstract Coronary artery disease (CAD), the most common manifestation of cardiovascular disease, remains the most common cause of mortality in the United States. Risk assessment is key for primary prevention of coronary events and coronary artery calcium (CAC) scoring using computed tomography (CT) is one such non-invasive tool. Despite the proven clinical value of CAC, the current clinical practice implementation for CAC has limitations such as the lack of insurance coverage for the test, need for capital-intensive CT machines, specialized imaging protocols, and accredited 3D imaging labs for analysis (including personnel and software). Perhaps the greatest gap is the millions of patients who undergo routine chest CT exams and demonstrate coronary artery calcification, but their presence is not often reported or quantitation is not feasible. We present two deep learning models that automate CAC scoring demonstrating advantages in automated scoring for both dedicated gated coronary CT exams and routine non-gated chest CTs performed for other reasons to allow opportunistic screening. First, we trained a gated coronary CT model for CAC scoring that showed near perfect agreement (mean difference in scores = −2.86; Cohen’s Kappa = 0.89, P < 0.0001) with current conventional manual scoring on a retrospective dataset of 79 patients and was found to perform the task faster (average time for automated CAC scoring using a graphics processing unit (GPU) was 3.5 ± 2.1 s vs. 261 s for manual scoring) in a prospective trial of 55 patients with little difference in scores compared to three technologists (mean difference in scores = 3.24, 5.12, and 5.48, respectively). Then using CAC scores from paired gated coronary CT as a reference standard, we trained a deep learning model on our internal data and a cohort from the Multi-Ethnic Study of Atherosclerosis (MESA) study (total training n = 341, Stanford test n = 42, MESA test n = 46) to perform CAC scoring on routine non-gated chest CT exams with validation on external datasets (total n = 303) obtained from four geographically disparate health systems. On identifying patients with any CAC (i.e., CAC ≥ 1), sensitivity and PPV was high across all datasets (ranges: 80–100% and 87–100%, respectively). For CAC ≥ 100 on routine non-gated chest CTs, which is the latest recommended threshold to initiate statin therapy, our model showed sensitivities of 71–94% and positive predictive values in the range of 88–100% across all the sites. Adoption of this model could allow more patients to be screened with CAC scoring, potentially allowing opportunistic early preventive interventions.David EngChristopher ChuteNishith KhandwalaPranav RajpurkarJin LongSam ShleiferMohamed H. KhalafAlexander T. SandhuFatima RodriguezDavid J. MaronSaeed SeyyediDaniele MarinIlana GolubMatthew BudoffFelipe KitamuraMarcelo Straus TakahashiRoss W. FiliceRajesh ShahJohn MonganKimberly KallianosCurtis P. LanglotzMatthew P. LungrenAndrew Y. NgBhavik N. PatelNature PortfolioarticleComputer applications to medicine. Medical informaticsR858-859.7ENnpj Digital Medicine, Vol 4, Iss 1, Pp 1-13 (2021)
institution DOAJ
collection DOAJ
language EN
topic Computer applications to medicine. Medical informatics
R858-859.7
spellingShingle Computer applications to medicine. Medical informatics
R858-859.7
David Eng
Christopher Chute
Nishith Khandwala
Pranav Rajpurkar
Jin Long
Sam Shleifer
Mohamed H. Khalaf
Alexander T. Sandhu
Fatima Rodriguez
David J. Maron
Saeed Seyyedi
Daniele Marin
Ilana Golub
Matthew Budoff
Felipe Kitamura
Marcelo Straus Takahashi
Ross W. Filice
Rajesh Shah
John Mongan
Kimberly Kallianos
Curtis P. Langlotz
Matthew P. Lungren
Andrew Y. Ng
Bhavik N. Patel
Automated coronary calcium scoring using deep learning with multicenter external validation
description Abstract Coronary artery disease (CAD), the most common manifestation of cardiovascular disease, remains the most common cause of mortality in the United States. Risk assessment is key for primary prevention of coronary events and coronary artery calcium (CAC) scoring using computed tomography (CT) is one such non-invasive tool. Despite the proven clinical value of CAC, the current clinical practice implementation for CAC has limitations such as the lack of insurance coverage for the test, need for capital-intensive CT machines, specialized imaging protocols, and accredited 3D imaging labs for analysis (including personnel and software). Perhaps the greatest gap is the millions of patients who undergo routine chest CT exams and demonstrate coronary artery calcification, but their presence is not often reported or quantitation is not feasible. We present two deep learning models that automate CAC scoring demonstrating advantages in automated scoring for both dedicated gated coronary CT exams and routine non-gated chest CTs performed for other reasons to allow opportunistic screening. First, we trained a gated coronary CT model for CAC scoring that showed near perfect agreement (mean difference in scores = −2.86; Cohen’s Kappa = 0.89, P < 0.0001) with current conventional manual scoring on a retrospective dataset of 79 patients and was found to perform the task faster (average time for automated CAC scoring using a graphics processing unit (GPU) was 3.5 ± 2.1 s vs. 261 s for manual scoring) in a prospective trial of 55 patients with little difference in scores compared to three technologists (mean difference in scores = 3.24, 5.12, and 5.48, respectively). Then using CAC scores from paired gated coronary CT as a reference standard, we trained a deep learning model on our internal data and a cohort from the Multi-Ethnic Study of Atherosclerosis (MESA) study (total training n = 341, Stanford test n = 42, MESA test n = 46) to perform CAC scoring on routine non-gated chest CT exams with validation on external datasets (total n = 303) obtained from four geographically disparate health systems. On identifying patients with any CAC (i.e., CAC ≥ 1), sensitivity and PPV was high across all datasets (ranges: 80–100% and 87–100%, respectively). For CAC ≥ 100 on routine non-gated chest CTs, which is the latest recommended threshold to initiate statin therapy, our model showed sensitivities of 71–94% and positive predictive values in the range of 88–100% across all the sites. Adoption of this model could allow more patients to be screened with CAC scoring, potentially allowing opportunistic early preventive interventions.
format article
author David Eng
Christopher Chute
Nishith Khandwala
Pranav Rajpurkar
Jin Long
Sam Shleifer
Mohamed H. Khalaf
Alexander T. Sandhu
Fatima Rodriguez
David J. Maron
Saeed Seyyedi
Daniele Marin
Ilana Golub
Matthew Budoff
Felipe Kitamura
Marcelo Straus Takahashi
Ross W. Filice
Rajesh Shah
John Mongan
Kimberly Kallianos
Curtis P. Langlotz
Matthew P. Lungren
Andrew Y. Ng
Bhavik N. Patel
author_facet David Eng
Christopher Chute
Nishith Khandwala
Pranav Rajpurkar
Jin Long
Sam Shleifer
Mohamed H. Khalaf
Alexander T. Sandhu
Fatima Rodriguez
David J. Maron
Saeed Seyyedi
Daniele Marin
Ilana Golub
Matthew Budoff
Felipe Kitamura
Marcelo Straus Takahashi
Ross W. Filice
Rajesh Shah
John Mongan
Kimberly Kallianos
Curtis P. Langlotz
Matthew P. Lungren
Andrew Y. Ng
Bhavik N. Patel
author_sort David Eng
title Automated coronary calcium scoring using deep learning with multicenter external validation
title_short Automated coronary calcium scoring using deep learning with multicenter external validation
title_full Automated coronary calcium scoring using deep learning with multicenter external validation
title_fullStr Automated coronary calcium scoring using deep learning with multicenter external validation
title_full_unstemmed Automated coronary calcium scoring using deep learning with multicenter external validation
title_sort automated coronary calcium scoring using deep learning with multicenter external validation
publisher Nature Portfolio
publishDate 2021
url https://doaj.org/article/c45dfc0724e243f6aed1edf848f05660
work_keys_str_mv AT davideng automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT christopherchute automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT nishithkhandwala automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT pranavrajpurkar automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT jinlong automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT samshleifer automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT mohamedhkhalaf automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT alexandertsandhu automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT fatimarodriguez automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT davidjmaron automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT saeedseyyedi automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT danielemarin automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT ilanagolub automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT matthewbudoff automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT felipekitamura automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT marcelostraustakahashi automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT rosswfilice automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT rajeshshah automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT johnmongan automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT kimberlykallianos automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT curtisplanglotz automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT matthewplungren automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT andrewyng automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
AT bhaviknpatel automatedcoronarycalciumscoringusingdeeplearningwithmulticenterexternalvalidation
_version_ 1718379311641133056