Automatic detection of pupil reactions in cataract surgery videos.
In the light of an increased use of premium intraocular lenses (IOL), such as EDOF IOLs, multifocal IOLs or toric IOLs even minor intraoperative complications such as decentrations or an IOL tilt, will hamper the visual performance of these IOLs. Thus, the post-operative analysis of cataract surgeri...
Guardado en:
Autores principales: | , , , , , |
---|---|
Formato: | article |
Lenguaje: | EN |
Publicado: |
Public Library of Science (PLoS)
2021
|
Materias: | |
Acceso en línea: | https://doaj.org/article/306a2fba309145edb84b54f015396c2c |
Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
id |
oai:doaj.org-article:306a2fba309145edb84b54f015396c2c |
---|---|
record_format |
dspace |
spelling |
oai:doaj.org-article:306a2fba309145edb84b54f015396c2c2021-12-02T20:16:41ZAutomatic detection of pupil reactions in cataract surgery videos.1932-620310.1371/journal.pone.0258390https://doaj.org/article/306a2fba309145edb84b54f015396c2c2021-01-01T00:00:00Zhttps://doi.org/10.1371/journal.pone.0258390https://doaj.org/toc/1932-6203In the light of an increased use of premium intraocular lenses (IOL), such as EDOF IOLs, multifocal IOLs or toric IOLs even minor intraoperative complications such as decentrations or an IOL tilt, will hamper the visual performance of these IOLs. Thus, the post-operative analysis of cataract surgeries to detect even minor intraoperative deviations that might explain a lack of a post-operative success becomes more and more important. Up-to-now surgical videos are evaluated by just looking at a very limited number of intraoperative data sets, or as done in studies evaluating the pupil changes that occur during surgeries, in a small number intraoperative picture only. A continuous measurement of pupil changes over the whole surgery, that would achieve clinically more relevant data, has not yet been described. Therefore, the automatic retrieval of such events may be a great support for a post-operative analysis. This would be especially true if large data files could be evaluated automatically. In this work, we automatically detect pupil reactions in cataract surgery videos. We employ a Mask R-CNN architecture as a segmentation algorithm to segment the pupil and iris with pixel-based accuracy and then track their sizes across the entire video. We can detect pupil reactions with a harmonic mean (H) of Recall, Precision, and Ground Truth Coverage Rate (GTCR) of 60.9% and average prediction length (PL) of 18.93 seconds. However, we consider the best configuration for practical use the one with the H value of 59.4% and PL of 10.2 seconds, which is much shorter. We further investigate the generalization ability of this method on a slightly different dataset without retraining the model. In this evaluation, we achieve the H value of 49.3% with the PL of 18.15 seconds.Natalia SokolovaKlaus SchoeffmannMario TaschwerStephanie SarnyDoris Putzgruber-AdamitschYosuf El-ShabrawiPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 16, Iss 10, p e0258390 (2021) |
institution |
DOAJ |
collection |
DOAJ |
language |
EN |
topic |
Medicine R Science Q |
spellingShingle |
Medicine R Science Q Natalia Sokolova Klaus Schoeffmann Mario Taschwer Stephanie Sarny Doris Putzgruber-Adamitsch Yosuf El-Shabrawi Automatic detection of pupil reactions in cataract surgery videos. |
description |
In the light of an increased use of premium intraocular lenses (IOL), such as EDOF IOLs, multifocal IOLs or toric IOLs even minor intraoperative complications such as decentrations or an IOL tilt, will hamper the visual performance of these IOLs. Thus, the post-operative analysis of cataract surgeries to detect even minor intraoperative deviations that might explain a lack of a post-operative success becomes more and more important. Up-to-now surgical videos are evaluated by just looking at a very limited number of intraoperative data sets, or as done in studies evaluating the pupil changes that occur during surgeries, in a small number intraoperative picture only. A continuous measurement of pupil changes over the whole surgery, that would achieve clinically more relevant data, has not yet been described. Therefore, the automatic retrieval of such events may be a great support for a post-operative analysis. This would be especially true if large data files could be evaluated automatically. In this work, we automatically detect pupil reactions in cataract surgery videos. We employ a Mask R-CNN architecture as a segmentation algorithm to segment the pupil and iris with pixel-based accuracy and then track their sizes across the entire video. We can detect pupil reactions with a harmonic mean (H) of Recall, Precision, and Ground Truth Coverage Rate (GTCR) of 60.9% and average prediction length (PL) of 18.93 seconds. However, we consider the best configuration for practical use the one with the H value of 59.4% and PL of 10.2 seconds, which is much shorter. We further investigate the generalization ability of this method on a slightly different dataset without retraining the model. In this evaluation, we achieve the H value of 49.3% with the PL of 18.15 seconds. |
format |
article |
author |
Natalia Sokolova Klaus Schoeffmann Mario Taschwer Stephanie Sarny Doris Putzgruber-Adamitsch Yosuf El-Shabrawi |
author_facet |
Natalia Sokolova Klaus Schoeffmann Mario Taschwer Stephanie Sarny Doris Putzgruber-Adamitsch Yosuf El-Shabrawi |
author_sort |
Natalia Sokolova |
title |
Automatic detection of pupil reactions in cataract surgery videos. |
title_short |
Automatic detection of pupil reactions in cataract surgery videos. |
title_full |
Automatic detection of pupil reactions in cataract surgery videos. |
title_fullStr |
Automatic detection of pupil reactions in cataract surgery videos. |
title_full_unstemmed |
Automatic detection of pupil reactions in cataract surgery videos. |
title_sort |
automatic detection of pupil reactions in cataract surgery videos. |
publisher |
Public Library of Science (PLoS) |
publishDate |
2021 |
url |
https://doaj.org/article/306a2fba309145edb84b54f015396c2c |
work_keys_str_mv |
AT nataliasokolova automaticdetectionofpupilreactionsincataractsurgeryvideos AT klausschoeffmann automaticdetectionofpupilreactionsincataractsurgeryvideos AT mariotaschwer automaticdetectionofpupilreactionsincataractsurgeryvideos AT stephaniesarny automaticdetectionofpupilreactionsincataractsurgeryvideos AT dorisputzgruberadamitsch automaticdetectionofpupilreactionsincataractsurgeryvideos AT yosufelshabrawi automaticdetectionofpupilreactionsincataractsurgeryvideos |
_version_ |
1718374460786999296 |