Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI
Background: It is often difficult to diagnose pituitary microadenoma (PM) by MRI alone, due to its relatively small size, variable anatomical structure, complex clinical symptoms, and signs among individuals. We develop and validate a deep learning -based system to diagnose PM from MRI.Methods: A to...
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | article |
| Lenguaje: | EN |
| Publicado: |
Frontiers Media S.A.
2021
|
| Materias: | |
| Acceso en línea: | https://doaj.org/article/bdc6c1213aaa4df19636f748afc44cbd |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| id |
oai:doaj.org-article:bdc6c1213aaa4df19636f748afc44cbd |
|---|---|
| record_format |
dspace |
| spelling |
oai:doaj.org-article:bdc6c1213aaa4df19636f748afc44cbd2021-12-01T12:14:59ZDevelopment and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI2296-858X10.3389/fmed.2021.758690https://doaj.org/article/bdc6c1213aaa4df19636f748afc44cbd2021-11-01T00:00:00Zhttps://www.frontiersin.org/articles/10.3389/fmed.2021.758690/fullhttps://doaj.org/toc/2296-858XBackground: It is often difficult to diagnose pituitary microadenoma (PM) by MRI alone, due to its relatively small size, variable anatomical structure, complex clinical symptoms, and signs among individuals. We develop and validate a deep learning -based system to diagnose PM from MRI.Methods: A total of 11,935 infertility participants were initially recruited for this project. After applying the exclusion criteria, 1,520 participants (556 PM patients and 964 controls subjects) were included for further stratified into 3 non-overlapping cohorts. The data used for the training set were derived from a retrospective study, and in the validation dataset, prospective temporal and geographical validation set were adopted. A total of 780 participants were used for training, 195 participants for testing, and 545 participants were used to validate the diagnosis performance. The PM-computer-aided diagnosis (PM-CAD) system consists of two parts: pituitary region detection and PM diagnosis. The diagnosis performance of the PM-CAD system was measured using the receiver operating characteristics (ROC) curve and area under the ROC curve (AUC), calibration curve, accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1-score.Results: Pituitary microadenoma-computer-aided diagnosis system showed 94.36% diagnostic accuracy and 98.13% AUC score in the testing dataset. We confirm the robustness and generalization of our PM-CAD system, the diagnostic accuracy in the internal dataset was 96.50% and in the external dataset was 92.26 and 92.36%, the AUC was 95.5, 94.7, and 93.7%, respectively. In human-computer competition, the diagnosis performance of our PM-CAD system was comparable to radiologists with >10 years of professional expertise (diagnosis accuracy of 94.0% vs. 95.0%, AUC of 95.6% vs. 95.0%). For the misdiagnosis cases from radiologists, our system showed a 100% accurate diagnosis. A browser-based software was designed to assist the PM diagnosis.Conclusions: This is the first report showing that the PM-CAD system is a viable tool for detecting PM. Our results suggest that the PM-CAD system is applicable to radiology departments, especially in primary health care institutions.Qingling LiQingling LiYanhua ZhuMinglin ChenRuomi GuoQingyong HuYaxin LuZhenghui DengSongqing DengTiecheng ZhangHuiquan WenRong GaoYuanpeng NieHaicheng LiJianning ChenGuojun ShiJun ShenWai Wilson CheungZifeng LiuYulan GuoYanming ChenFrontiers Media S.A.articlepituitary microadenomamagnetic resonance imagingdeep learningalgorithmcomputer-aided diagnosisMedicine (General)R5-920ENFrontiers in Medicine, Vol 8 (2021) |
| institution |
DOAJ |
| collection |
DOAJ |
| language |
EN |
| topic |
pituitary microadenoma magnetic resonance imaging deep learning algorithm computer-aided diagnosis Medicine (General) R5-920 |
| spellingShingle |
pituitary microadenoma magnetic resonance imaging deep learning algorithm computer-aided diagnosis Medicine (General) R5-920 Qingling Li Qingling Li Yanhua Zhu Minglin Chen Ruomi Guo Qingyong Hu Yaxin Lu Zhenghui Deng Songqing Deng Tiecheng Zhang Huiquan Wen Rong Gao Yuanpeng Nie Haicheng Li Jianning Chen Guojun Shi Jun Shen Wai Wilson Cheung Zifeng Liu Yulan Guo Yanming Chen Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI |
| description |
Background: It is often difficult to diagnose pituitary microadenoma (PM) by MRI alone, due to its relatively small size, variable anatomical structure, complex clinical symptoms, and signs among individuals. We develop and validate a deep learning -based system to diagnose PM from MRI.Methods: A total of 11,935 infertility participants were initially recruited for this project. After applying the exclusion criteria, 1,520 participants (556 PM patients and 964 controls subjects) were included for further stratified into 3 non-overlapping cohorts. The data used for the training set were derived from a retrospective study, and in the validation dataset, prospective temporal and geographical validation set were adopted. A total of 780 participants were used for training, 195 participants for testing, and 545 participants were used to validate the diagnosis performance. The PM-computer-aided diagnosis (PM-CAD) system consists of two parts: pituitary region detection and PM diagnosis. The diagnosis performance of the PM-CAD system was measured using the receiver operating characteristics (ROC) curve and area under the ROC curve (AUC), calibration curve, accuracy, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1-score.Results: Pituitary microadenoma-computer-aided diagnosis system showed 94.36% diagnostic accuracy and 98.13% AUC score in the testing dataset. We confirm the robustness and generalization of our PM-CAD system, the diagnostic accuracy in the internal dataset was 96.50% and in the external dataset was 92.26 and 92.36%, the AUC was 95.5, 94.7, and 93.7%, respectively. In human-computer competition, the diagnosis performance of our PM-CAD system was comparable to radiologists with >10 years of professional expertise (diagnosis accuracy of 94.0% vs. 95.0%, AUC of 95.6% vs. 95.0%). For the misdiagnosis cases from radiologists, our system showed a 100% accurate diagnosis. A browser-based software was designed to assist the PM diagnosis.Conclusions: This is the first report showing that the PM-CAD system is a viable tool for detecting PM. Our results suggest that the PM-CAD system is applicable to radiology departments, especially in primary health care institutions. |
| format |
article |
| author |
Qingling Li Qingling Li Yanhua Zhu Minglin Chen Ruomi Guo Qingyong Hu Yaxin Lu Zhenghui Deng Songqing Deng Tiecheng Zhang Huiquan Wen Rong Gao Yuanpeng Nie Haicheng Li Jianning Chen Guojun Shi Jun Shen Wai Wilson Cheung Zifeng Liu Yulan Guo Yanming Chen |
| author_facet |
Qingling Li Qingling Li Yanhua Zhu Minglin Chen Ruomi Guo Qingyong Hu Yaxin Lu Zhenghui Deng Songqing Deng Tiecheng Zhang Huiquan Wen Rong Gao Yuanpeng Nie Haicheng Li Jianning Chen Guojun Shi Jun Shen Wai Wilson Cheung Zifeng Liu Yulan Guo Yanming Chen |
| author_sort |
Qingling Li |
| title |
Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI |
| title_short |
Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI |
| title_full |
Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI |
| title_fullStr |
Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI |
| title_full_unstemmed |
Development and Validation of a Deep Learning Algorithm to Automatic Detection of Pituitary Microadenoma From MRI |
| title_sort |
development and validation of a deep learning algorithm to automatic detection of pituitary microadenoma from mri |
| publisher |
Frontiers Media S.A. |
| publishDate |
2021 |
| url |
https://doaj.org/article/bdc6c1213aaa4df19636f748afc44cbd |
| work_keys_str_mv |
AT qinglingli developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT qinglingli developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT yanhuazhu developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT minglinchen developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT ruomiguo developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT qingyonghu developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT yaxinlu developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT zhenghuideng developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT songqingdeng developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT tiechengzhang developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT huiquanwen developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT ronggao developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT yuanpengnie developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT haichengli developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT jianningchen developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT guojunshi developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT junshen developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT waiwilsoncheung developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT zifengliu developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT yulanguo developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri AT yanmingchen developmentandvalidationofadeeplearningalgorithmtoautomaticdetectionofpituitarymicroadenomafrommri |
| _version_ |
1718405197826359296 |