A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image

A novel framework for 3D reconstruction of buildings based on a single off-nadir satellite image is proposed in this paper. Compared with the traditional methods of reconstruction using multiple images in remote sensing, recovering 3D information that utilizes the single image can reduce the demands...

Descripción completa

Guardado en:

Detalles Bibliográficos
Autores principales:	Chunhui Zhao, Chi Zhang, Yiming Yan, Nan Su
Formato:	article
Lenguaje:	EN
Publicado:	MDPI AG 2021
Materias:	3D model reconstruction building satellite image encoder-decoder network Science Q
Acceso en línea:	https://doaj.org/article/5ae203bc8ed8434baef98e8d198e9dc2
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

id	oai:doaj.org-article:5ae203bc8ed8434baef98e8d198e9dc2
record_format	dspace
spelling	oai:doaj.org-article:5ae203bc8ed8434baef98e8d198e9dc22021-11-11T18:56:37ZA 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image10.3390/rs132144342072-4292https://doaj.org/article/5ae203bc8ed8434baef98e8d198e9dc22021-11-01T00:00:00Zhttps://www.mdpi.com/2072-4292/13/21/4434https://doaj.org/toc/2072-4292A novel framework for 3D reconstruction of buildings based on a single off-nadir satellite image is proposed in this paper. Compared with the traditional methods of reconstruction using multiple images in remote sensing, recovering 3D information that utilizes the single image can reduce the demands of reconstruction tasks from the perspective of input data. It solves the problem that multiple images suitable for traditional reconstruction methods cannot be acquired in some regions, where remote sensing resources are scarce. However, it is difficult to reconstruct a 3D model containing a complete shape and accurate scale from a single image. The geometric constraints are not sufficient as the view-angle, size of buildings, and spatial resolution of images are different among remote sensing images. To solve this problem, the reconstruction framework proposed consists of two convolutional neural networks: Scale-Occupancy-Network (Scale-ONet) and model scale optimization network (Optim-Net). Through reconstruction using the single off-nadir satellite image, Scale-Onet can generate water-tight mesh models with the exact shape and rough scale of buildings. Meanwhile, the Optim-Net can reduce the error of scale for these mesh models. Finally, the complete reconstructed scene is recovered by Model-Image matching. Profiting from well-designed networks, our framework has good robustness for different input images, with different view-angle, size of buildings, and spatial resolution. Experimental results show that an ideal reconstruction accuracy can be obtained both on the model shape and scale of buildings.Chunhui ZhaoChi ZhangYiming YanNan SuMDPI AGarticle3D model reconstructionbuildingsatellite imageencoder-decoder networkScienceQENRemote Sensing, Vol 13, Iss 4434, p 4434 (2021)
institution	DOAJ
collection	DOAJ
language	EN
topic	3D model reconstruction building satellite image encoder-decoder network Science Q
spellingShingle	3D model reconstruction building satellite image encoder-decoder network Science Q Chunhui Zhao Chi Zhang Yiming Yan Nan Su A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image
description	A novel framework for 3D reconstruction of buildings based on a single off-nadir satellite image is proposed in this paper. Compared with the traditional methods of reconstruction using multiple images in remote sensing, recovering 3D information that utilizes the single image can reduce the demands of reconstruction tasks from the perspective of input data. It solves the problem that multiple images suitable for traditional reconstruction methods cannot be acquired in some regions, where remote sensing resources are scarce. However, it is difficult to reconstruct a 3D model containing a complete shape and accurate scale from a single image. The geometric constraints are not sufficient as the view-angle, size of buildings, and spatial resolution of images are different among remote sensing images. To solve this problem, the reconstruction framework proposed consists of two convolutional neural networks: Scale-Occupancy-Network (Scale-ONet) and model scale optimization network (Optim-Net). Through reconstruction using the single off-nadir satellite image, Scale-Onet can generate water-tight mesh models with the exact shape and rough scale of buildings. Meanwhile, the Optim-Net can reduce the error of scale for these mesh models. Finally, the complete reconstructed scene is recovered by Model-Image matching. Profiting from well-designed networks, our framework has good robustness for different input images, with different view-angle, size of buildings, and spatial resolution. Experimental results show that an ideal reconstruction accuracy can be obtained both on the model shape and scale of buildings.
format	article
author	Chunhui Zhao Chi Zhang Yiming Yan Nan Su
author_facet	Chunhui Zhao Chi Zhang Yiming Yan Nan Su
author_sort	Chunhui Zhao
title	A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image
title_short	A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image
title_full	A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image
title_fullStr	A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image
title_full_unstemmed	A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image
title_sort	3d reconstruction framework of buildings using single off-nadir satellite image
publisher	MDPI AG
publishDate	2021
url	https://doaj.org/article/5ae203bc8ed8434baef98e8d198e9dc2
work_keys_str_mv	AT chunhuizhao a3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT chizhang a3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT yimingyan a3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT nansu a3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT chunhuizhao 3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT chizhang 3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT yimingyan 3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage AT nansu 3dreconstructionframeworkofbuildingsusingsingleoffnadirsatelliteimage
_version_	1718431646749818880

A 3D Reconstruction Framework of Buildings Using Single Off-Nadir Satellite Image

Ejemplares similares