Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics
Artificial intelligence (AI) has been deeply applied in the medical field and has shown broad application prospects. Pre-consultation system is an important supplement to the traditional face-to-face consultation. The combination of the AI and the pre-consultation system can help to raise the effici...
Guardado en:
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/f94313959c2240faaa3a633229e4a3ba |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:f94313959c2240faaa3a633229e4a3ba |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:f94313959c2240faaa3a633229e4a3ba2021-11-08T08:02:45ZPre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics2296-858X10.3389/fmed.2021.695185https://doaj.org/article/f94313959c2240faaa3a633229e4a3ba2021-11-01T00:00:00Zhttps://www.frontiersin.org/articles/10.3389/fmed.2021.695185/fullhttps://doaj.org/toc/2296-858XArtificial intelligence (AI) has been deeply applied in the medical field and has shown broad application prospects. Pre-consultation system is an important supplement to the traditional face-to-face consultation. The combination of the AI and the pre-consultation system can help to raise the efficiency of the clinical work. However, it is still challenging for the AI to analyze and process the complicated electronic health record (EHR) data. Our pre-consultation system uses an automated natural language processing (NLP) system to communicate with the patients through the mobile terminals, applying the deep learning (DL) techniques to extract the symptomatic information, and finally outputs the structured electronic medical records. From November 2019 to May 2020, a total of 2,648 pediatric patients used our model to provide their medical history and get the primary diagnosis before visiting the physicians in the outpatient department of the Shanghai Children's Medical Center. Our task is to evaluate the ability of the AI and doctors to obtain the primary diagnosis and to analyze the effect of the consistency between the medical history described by our model and the physicians on the diagnostic performance. The results showed that if we do not consider whether the medical history recorded by the AI and doctors was consistent or not, our model performed worse compared to the physicians and had a lower average F1 score (0.825 vs. 0.912). However, when the chief complaint or the history of present illness described by the AI and doctors was consistent, our model had a higher average F1 score and was closer to the doctors. Finally, when the AI had the same diagnostic conditions with doctors, our model achieved a higher average F1 score (0.931) compared to the physicians (0.92). This study demonstrated that our model could obtain a more structured medical history and had a good diagnostic logic, which would help to improve the diagnostic accuracy of the outpatient doctors and reduce the misdiagnosis and missed diagnosis. But, our model still needs a good deal of training to obtain more accurate symptomatic information.Han QianHan QianBin DongBin DongJia-jun YuanJia-jun YuanFan YinZhao WangHai-ning WangHan-song WangHan-song WangDan TianDan TianDan TianWei-hua LiWei-hua LiWei-hua LiBin ZhangBin ZhangLie-bin ZhaoBo-tao NingBo-tao NingFrontiers Media S.A.articleartificial intelligencepre-consultationoutpatientmedical recordspediatricelectronic health recordMedicine (General)R5-920ENFrontiers in Medicine, Vol 8 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
artificial intelligence pre-consultation outpatient medical records pediatric electronic health record Medicine (General) R5-920 |
spellingShingle |
artificial intelligence pre-consultation outpatient medical records pediatric electronic health record Medicine (General) R5-920 Han Qian Han Qian Bin Dong Bin Dong Jia-jun Yuan Jia-jun Yuan Fan Yin Zhao Wang Hai-ning Wang Han-song Wang Han-song Wang Dan Tian Dan Tian Dan Tian Wei-hua Li Wei-hua Li Wei-hua Li Bin Zhang Bin Zhang Lie-bin Zhao Bo-tao Ning Bo-tao Ning Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics |
description |
Artificial intelligence (AI) has been deeply applied in the medical field and has shown broad application prospects. Pre-consultation system is an important supplement to the traditional face-to-face consultation. The combination of the AI and the pre-consultation system can help to raise the efficiency of the clinical work. However, it is still challenging for the AI to analyze and process the complicated electronic health record (EHR) data. Our pre-consultation system uses an automated natural language processing (NLP) system to communicate with the patients through the mobile terminals, applying the deep learning (DL) techniques to extract the symptomatic information, and finally outputs the structured electronic medical records. From November 2019 to May 2020, a total of 2,648 pediatric patients used our model to provide their medical history and get the primary diagnosis before visiting the physicians in the outpatient department of the Shanghai Children's Medical Center. Our task is to evaluate the ability of the AI and doctors to obtain the primary diagnosis and to analyze the effect of the consistency between the medical history described by our model and the physicians on the diagnostic performance. The results showed that if we do not consider whether the medical history recorded by the AI and doctors was consistent or not, our model performed worse compared to the physicians and had a lower average F1 score (0.825 vs. 0.912). However, when the chief complaint or the history of present illness described by the AI and doctors was consistent, our model had a higher average F1 score and was closer to the doctors. Finally, when the AI had the same diagnostic conditions with doctors, our model achieved a higher average F1 score (0.931) compared to the physicians (0.92). This study demonstrated that our model could obtain a more structured medical history and had a good diagnostic logic, which would help to improve the diagnostic accuracy of the outpatient doctors and reduce the misdiagnosis and missed diagnosis. But, our model still needs a good deal of training to obtain more accurate symptomatic information. |
format |
article |
author |
Han Qian Han Qian Bin Dong Bin Dong Jia-jun Yuan Jia-jun Yuan Fan Yin Zhao Wang Hai-ning Wang Han-song Wang Han-song Wang Dan Tian Dan Tian Dan Tian Wei-hua Li Wei-hua Li Wei-hua Li Bin Zhang Bin Zhang Lie-bin Zhao Bo-tao Ning Bo-tao Ning |
author_facet |
Han Qian Han Qian Bin Dong Bin Dong Jia-jun Yuan Jia-jun Yuan Fan Yin Zhao Wang Hai-ning Wang Han-song Wang Han-song Wang Dan Tian Dan Tian Dan Tian Wei-hua Li Wei-hua Li Wei-hua Li Bin Zhang Bin Zhang Lie-bin Zhao Bo-tao Ning Bo-tao Ning |
author_sort |
Han Qian |
title |
Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics |
title_short |
Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics |
title_full |
Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics |
title_fullStr |
Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics |
title_full_unstemmed |
Pre-Consultation System Based on the Artificial Intelligence Has a Better Diagnostic Performance Than the Physicians in the Outpatient Department of Pediatrics |
title_sort |
pre-consultation system based on the artificial intelligence has a better diagnostic performance than the physicians in the outpatient department of pediatrics |
publisher |
Frontiers Media S.A. |
publishDate |
2021 |
url |
https://doaj.org/article/f94313959c2240faaa3a633229e4a3ba |
work_keys_str_mv |
AT hanqian preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT hanqian preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT bindong preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT bindong preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT jiajunyuan preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT jiajunyuan preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT fanyin preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT zhaowang preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT hainingwang preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT hansongwang preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT hansongwang preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT dantian preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT dantian preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT dantian preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT weihuali preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT weihuali preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT weihuali preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT binzhang preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT binzhang preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT liebinzhao preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT botaoning preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics AT botaoning preconsultationsystembasedontheartificialintelligencehasabetterdiagnosticperformancethanthephysiciansintheoutpatientdepartmentofpediatrics |
_version_ |
1718442869143896064 |