Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence

Deep learning, for its powerful learning capability and high usability, has been a prevalent algorithm of machine learning and a core technique for artificial intelligence(AI) in medicine and healthcare. Due to the importance of medical imaging in many tasks such as health screening, disease diagnos...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autor principal: LI Xirong
Formato: article
Lenguaje:ZH
Publicado: Editorial Office of Medical Journal of Peking Union Medical College Hospital 2021
Materias:
R
Acceso en línea:https://doaj.org/article/2854f5daa7c242c39c24278415d183f7
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:2854f5daa7c242c39c24278415d183f7
record_format dspace
spelling oai:doaj.org-article:2854f5daa7c242c39c24278415d183f72021-12-01T01:43:39ZMulti-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence1674-908110.12290/xhyxzz.2021-0500https://doaj.org/article/2854f5daa7c242c39c24278415d183f72021-10-01T00:00:00Zhttps://xhyxzz.pumch.cn/en/article/doi/10.12290/xhyxzz.2021-0500https://doaj.org/toc/1674-9081Deep learning, for its powerful learning capability and high usability, has been a prevalent algorithm of machine learning and a core technique for artificial intelligence(AI) in medicine and healthcare. Due to the importance of medical imaging in many tasks such as health screening, disease diagnosis, precise treatment, and prognosis prediction, deep learning of structural analysis and semantic understanding for medical images is becoming an important interdisciplinary research direction. In clinical scenarios, in order to achieve a more accurate diagnosis, doctors need to simultaneously refer to multiple modalities of medical imaging for a comprehensive analysis and judgment. This article introduced the basic concepts and working principles of multimodal deep learning in such scenarios, reviewed recent research progress on applying multi-modal deep learning in both generic medical fields and ophthalmology, and discussed technical challenges and also envision potential applications of multi-modal deep learning in AI-assisted ophthalmology.LI XirongEditorial Office of Medical Journal of Peking Union Medical College Hospitalarticlemulti-modal deep learningophthalmologyartificial intelligenceassisted diagnosisMedicineRZHXiehe Yixue Zazhi, Vol 12, Iss 5, Pp 602-607 (2021)
institution DOAJ
collection DOAJ
language ZH
topic multi-modal deep learning
ophthalmology
artificial intelligence
assisted diagnosis
Medicine
R
spellingShingle multi-modal deep learning
ophthalmology
artificial intelligence
assisted diagnosis
Medicine
R
LI Xirong
Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence
description Deep learning, for its powerful learning capability and high usability, has been a prevalent algorithm of machine learning and a core technique for artificial intelligence(AI) in medicine and healthcare. Due to the importance of medical imaging in many tasks such as health screening, disease diagnosis, precise treatment, and prognosis prediction, deep learning of structural analysis and semantic understanding for medical images is becoming an important interdisciplinary research direction. In clinical scenarios, in order to achieve a more accurate diagnosis, doctors need to simultaneously refer to multiple modalities of medical imaging for a comprehensive analysis and judgment. This article introduced the basic concepts and working principles of multimodal deep learning in such scenarios, reviewed recent research progress on applying multi-modal deep learning in both generic medical fields and ophthalmology, and discussed technical challenges and also envision potential applications of multi-modal deep learning in AI-assisted ophthalmology.
format article
author LI Xirong
author_facet LI Xirong
author_sort LI Xirong
title Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence
title_short Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence
title_full Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence
title_fullStr Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence
title_full_unstemmed Multi-modal Deep Learning and Its Applications in Ophthalmic Artificial Intelligence
title_sort multi-modal deep learning and its applications in ophthalmic artificial intelligence
publisher Editorial Office of Medical Journal of Peking Union Medical College Hospital
publishDate 2021
url https://doaj.org/article/2854f5daa7c242c39c24278415d183f7
work_keys_str_mv AT lixirong multimodaldeeplearninganditsapplicationsinophthalmicartificialintelligence
_version_ 1718405949489676288