Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites

Constant detection and monitoring of archaeological sites and objects have always been an important national goal for many countries. The early identification of changes is crucial to preventive conservation. Archaeologists have always considered using service drones to automate collecting data on a...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Adel Khelifi, Gabriele Ciccone, Mark Altaweel, Tasnim Basmaji, Mohammed Ghazal
Formato: article
Lenguaje:EN
Publicado: MDPI AG 2021
Materias:
T
Acceso en línea:https://doaj.org/article/196c2417608e42e8b46b7b3f4953c91a
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:196c2417608e42e8b46b7b3f4953c91a
record_format dspace
spelling oai:doaj.org-article:196c2417608e42e8b46b7b3f4953c91a2021-11-11T15:24:09ZAutonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites10.3390/app1121104242076-3417https://doaj.org/article/196c2417608e42e8b46b7b3f4953c91a2021-11-01T00:00:00Zhttps://www.mdpi.com/2076-3417/11/21/10424https://doaj.org/toc/2076-3417Constant detection and monitoring of archaeological sites and objects have always been an important national goal for many countries. The early identification of changes is crucial to preventive conservation. Archaeologists have always considered using service drones to automate collecting data on and below the ground surface of archaeological sites, with cost and technical barriers being the main hurdles against the wide-scale deployment. Advances in thermal imaging, depth imaging, drones, and artificial intelligence have driven the cost down and improved the quality and volume of data collected and processed. This paper proposes an end-to-end framework for archaeological sites detection and monitoring using autonomous service drones. We mount RGB, depth, and thermal cameras on an autonomous drone for low-altitude data acquisition. To align and aggregate collected images, we propose two-stage multimodal depth-to-RGB and thermal-to-RGB mosaicking algorithms. We then apply detection algorithms to the stitched images to identify change regions and design a user interface to monitor these regions over time. Our results show we can create overlays of aligned thermal and depth data on RGB mosaics of archaeological sites. We tested our change detection algorithm and found it has a root mean square error of 0.04. To validate the proposed framework, we tested our thermal image stitching pipeline against state-of-the-art commercial software. We cost-effectively replicated its functionality while adding a new depth-based modality and created a user interface for temporally monitoring changes in multimodal views of archaeological sites.Adel KhelifiGabriele CicconeMark AltaweelTasnim BasmajiMohammed GhazalMDPI AGarticleaerial monitoringunmanned aerial vehiclesmosaickingcultural heritage detectionphotogrammetryopen-source softwareTechnologyTEngineering (General). Civil engineering (General)TA1-2040Biology (General)QH301-705.5PhysicsQC1-999ChemistryQD1-999ENApplied Sciences, Vol 11, Iss 10424, p 10424 (2021)
institution DOAJ
collection DOAJ
language EN
topic aerial monitoring
unmanned aerial vehicles
mosaicking
cultural heritage detection
photogrammetry
open-source software
Technology
T
Engineering (General). Civil engineering (General)
TA1-2040
Biology (General)
QH301-705.5
Physics
QC1-999
Chemistry
QD1-999
spellingShingle aerial monitoring
unmanned aerial vehicles
mosaicking
cultural heritage detection
photogrammetry
open-source software
Technology
T
Engineering (General). Civil engineering (General)
TA1-2040
Biology (General)
QH301-705.5
Physics
QC1-999
Chemistry
QD1-999
Adel Khelifi
Gabriele Ciccone
Mark Altaweel
Tasnim Basmaji
Mohammed Ghazal
Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites
description Constant detection and monitoring of archaeological sites and objects have always been an important national goal for many countries. The early identification of changes is crucial to preventive conservation. Archaeologists have always considered using service drones to automate collecting data on and below the ground surface of archaeological sites, with cost and technical barriers being the main hurdles against the wide-scale deployment. Advances in thermal imaging, depth imaging, drones, and artificial intelligence have driven the cost down and improved the quality and volume of data collected and processed. This paper proposes an end-to-end framework for archaeological sites detection and monitoring using autonomous service drones. We mount RGB, depth, and thermal cameras on an autonomous drone for low-altitude data acquisition. To align and aggregate collected images, we propose two-stage multimodal depth-to-RGB and thermal-to-RGB mosaicking algorithms. We then apply detection algorithms to the stitched images to identify change regions and design a user interface to monitor these regions over time. Our results show we can create overlays of aligned thermal and depth data on RGB mosaics of archaeological sites. We tested our change detection algorithm and found it has a root mean square error of 0.04. To validate the proposed framework, we tested our thermal image stitching pipeline against state-of-the-art commercial software. We cost-effectively replicated its functionality while adding a new depth-based modality and created a user interface for temporally monitoring changes in multimodal views of archaeological sites.
format article
author Adel Khelifi
Gabriele Ciccone
Mark Altaweel
Tasnim Basmaji
Mohammed Ghazal
author_facet Adel Khelifi
Gabriele Ciccone
Mark Altaweel
Tasnim Basmaji
Mohammed Ghazal
author_sort Adel Khelifi
title Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites
title_short Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites
title_full Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites
title_fullStr Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites
title_full_unstemmed Autonomous Service Drones for Multimodal Detection and Monitoring of Archaeological Sites
title_sort autonomous service drones for multimodal detection and monitoring of archaeological sites
publisher MDPI AG
publishDate 2021
url https://doaj.org/article/196c2417608e42e8b46b7b3f4953c91a
work_keys_str_mv AT adelkhelifi autonomousservicedronesformultimodaldetectionandmonitoringofarchaeologicalsites
AT gabrieleciccone autonomousservicedronesformultimodaldetectionandmonitoringofarchaeologicalsites
AT markaltaweel autonomousservicedronesformultimodaldetectionandmonitoringofarchaeologicalsites
AT tasnimbasmaji autonomousservicedronesformultimodaldetectionandmonitoringofarchaeologicalsites
AT mohammedghazal autonomousservicedronesformultimodaldetectionandmonitoringofarchaeologicalsites
_version_ 1718435353264652288