An Augmented Reality Periscope for Submarines with Extended Visual Classification

Submarines are considered extremely strategic for any naval army due to their stealth capability. Periscopes are crucial sensors for these vessels, and emerging to the surface or periscope depth is required to identify visual contacts through this device. This maneuver has many procedures and usuall...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: André Breitinger, Esteban Clua, Leandro A. F. Fernandes
Formato: article
Lenguaje:EN
Publicado: MDPI AG 2021
Materias:
Acceso en línea:https://doaj.org/article/08fbff32d17b48859d4de81aedc963db
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:08fbff32d17b48859d4de81aedc963db
record_format dspace
spelling oai:doaj.org-article:08fbff32d17b48859d4de81aedc963db2021-11-25T18:58:01ZAn Augmented Reality Periscope for Submarines with Extended Visual Classification10.3390/s212276241424-8220https://doaj.org/article/08fbff32d17b48859d4de81aedc963db2021-11-01T00:00:00Zhttps://www.mdpi.com/1424-8220/21/22/7624https://doaj.org/toc/1424-8220Submarines are considered extremely strategic for any naval army due to their stealth capability. Periscopes are crucial sensors for these vessels, and emerging to the surface or periscope depth is required to identify visual contacts through this device. This maneuver has many procedures and usually has to be fast and agile to avoid exposure. This paper presents and implements a novel architecture for real submarine periscopes developed for future Brazilian naval fleet operations. Our system consists of a probe that is connected to the craft and carries a 360 camera. We project and take the images inside the vessel using traditional VR/XR devices. We also propose and implement an efficient computer vision-based MR technique to estimate and display detected vessels effectively and precisely. The vessel detection model is trained using synthetic images. So, we built and made available a dataset composed of 99,000 images. Finally, we also estimate distances of the classified elements, showing all the information in an AR-based interface. Although the probe is wired-connected, it allows for the vessel to stand in deep positions, reducing its exposure and introducing a new way for submarine maneuvers and operations. We validate our proposal through a user experience experiment using 19 experts in periscope operations.André BreitingerEsteban CluaLeandro A. F. FernandesMDPI AGarticlecomputer visiondeep learningmixed realityobject detectionperiscopesynthetic dataChemical technologyTP1-1185ENSensors, Vol 21, Iss 7624, p 7624 (2021)
institution DOAJ
collection DOAJ
language EN
topic computer vision
deep learning
mixed reality
object detection
periscope
synthetic data
Chemical technology
TP1-1185
spellingShingle computer vision
deep learning
mixed reality
object detection
periscope
synthetic data
Chemical technology
TP1-1185
André Breitinger
Esteban Clua
Leandro A. F. Fernandes
An Augmented Reality Periscope for Submarines with Extended Visual Classification
description Submarines are considered extremely strategic for any naval army due to their stealth capability. Periscopes are crucial sensors for these vessels, and emerging to the surface or periscope depth is required to identify visual contacts through this device. This maneuver has many procedures and usually has to be fast and agile to avoid exposure. This paper presents and implements a novel architecture for real submarine periscopes developed for future Brazilian naval fleet operations. Our system consists of a probe that is connected to the craft and carries a 360 camera. We project and take the images inside the vessel using traditional VR/XR devices. We also propose and implement an efficient computer vision-based MR technique to estimate and display detected vessels effectively and precisely. The vessel detection model is trained using synthetic images. So, we built and made available a dataset composed of 99,000 images. Finally, we also estimate distances of the classified elements, showing all the information in an AR-based interface. Although the probe is wired-connected, it allows for the vessel to stand in deep positions, reducing its exposure and introducing a new way for submarine maneuvers and operations. We validate our proposal through a user experience experiment using 19 experts in periscope operations.
format article
author André Breitinger
Esteban Clua
Leandro A. F. Fernandes
author_facet André Breitinger
Esteban Clua
Leandro A. F. Fernandes
author_sort André Breitinger
title An Augmented Reality Periscope for Submarines with Extended Visual Classification
title_short An Augmented Reality Periscope for Submarines with Extended Visual Classification
title_full An Augmented Reality Periscope for Submarines with Extended Visual Classification
title_fullStr An Augmented Reality Periscope for Submarines with Extended Visual Classification
title_full_unstemmed An Augmented Reality Periscope for Submarines with Extended Visual Classification
title_sort augmented reality periscope for submarines with extended visual classification
publisher MDPI AG
publishDate 2021
url https://doaj.org/article/08fbff32d17b48859d4de81aedc963db
work_keys_str_mv AT andrebreitinger anaugmentedrealityperiscopeforsubmarineswithextendedvisualclassification
AT estebanclua anaugmentedrealityperiscopeforsubmarineswithextendedvisualclassification
AT leandroaffernandes anaugmentedrealityperiscopeforsubmarineswithextendedvisualclassification
AT andrebreitinger augmentedrealityperiscopeforsubmarineswithextendedvisualclassification
AT estebanclua augmentedrealityperiscopeforsubmarineswithextendedvisualclassification
AT leandroaffernandes augmentedrealityperiscopeforsubmarineswithextendedvisualclassification
_version_ 1718410444919537664