scholarly journals An Object-Based Bidirectional Method for Integrated Building Extraction and Change Detection between Multimodal Point Clouds

2020 ◽  
Vol 12 (10) ◽  
pp. 1680
Author(s):  
Chenguang Dai ◽  
Zhenchao Zhang ◽  
Dong Lin

Building extraction and change detection are two important tasks in the remote sensing domain. Change detection between airborne laser scanning data and photogrammetric data is vulnerable to dense matching errors, mis-alignment errors and data gaps. This paper proposes an unsupervised object-based method for integrated building extraction and change detection. Firstly, terrain, roofs and vegetation are extracted from the precise laser point cloud, based on “bottom-up” segmentation and clustering. Secondly, change detection is performed in an object-based bidirectional manner: Heightened buildings and demolished buildings are detected by taking the laser scanning data as reference, while newly-built buildings are detected by taking the dense matching data as reference. Experiments on two urban data sets demonstrate its effectiveness and robustness. The object-based change detection achieves a recall rate of 92.31% and a precision rate of 88.89% for the Rotterdam dataset; it achieves a recall rate of 85.71% and a precision rate of 100% for the Enschede dataset. It can not only extract unchanged building footprints, but also assign heightened or demolished labels to the changed buildings.

2019 ◽  
Vol 11 (20) ◽  
pp. 2417 ◽  
Author(s):  
Zhenchao Zhang ◽  
George Vosselman ◽  
Markus Gerke ◽  
Claudio Persello ◽  
Devis Tuia ◽  
...  

Detecting topographic changes in an urban environment and keeping city-level point clouds up-to-date are important tasks for urban planning and monitoring. In practice, remote sensing data are often available only in different modalities for two epochs. Change detection between airborne laser scanning data and photogrammetric data is challenging due to the multi-modality of the input data and dense matching errors. This paper proposes a method to detect building changes between multimodal acquisitions. The multimodal inputs are converted and fed into a light-weighted pseudo-Siamese convolutional neural network (PSI-CNN) for change detection. Different network configurations and fusion strategies are compared. Our experiments on a large urban data set demonstrate the effectiveness of the proposed method. Our change map achieves a recall rate of 86.17%, a precision rate of 68.16%, and an F1-score of 76.13%. The comparison between Siamese architecture and feed-forward architecture brings many interesting findings and suggestions to the design of networks for multimodal data processing.


Author(s):  
Z. Zhang ◽  
G. Vosselman ◽  
M. Gerke ◽  
C. Persello ◽  
D. Tuia ◽  
...  

<p><strong>Abstract.</strong> Airborne photogrammetry and airborne laser scanning are two commonly used technologies used for topographical data acquisition at the city level. Change detection between airborne laser scanning data and photogrammetric data is challenging since the two point clouds show different characteristics. After comparing the two types of point clouds, this paper proposes a feed-forward Convolutional Neural Network (CNN) to detect building changes between them. The motivation from an application point of view is that the multimodal point clouds might be available for different epochs. Our method contains three steps: First, the point clouds and orthoimages are converted to raster images. Second, square patches are cropped from raster images and then fed into CNN for change detection. Finally, the original change map is post-processed with a simple connected component analysis. Experimental results show that the patch-based recall rate reaches 0.8146 and the precision rate reaches 0.7632. Object-based evaluation shows that 74 out of 86 building changes are correctly detected.</p>


2021 ◽  
Vol 10 (6) ◽  
pp. 367
Author(s):  
Simoni Alexiou ◽  
Georgios Deligiannakis ◽  
Aggelos Pallikarakis ◽  
Ioannis Papanikolaou ◽  
Emmanouil Psomiadis ◽  
...  

Analysis of two small semi-mountainous catchments in central Evia island, Greece, highlights the advantages of Unmanned Aerial Vehicle (UAV) and Terrestrial Laser Scanning (TLS) based change detection methods. We use point clouds derived by both methods in two sites (S1 & S2), to analyse the effects of a recent wildfire on soil erosion. Results indicate that topsoil’s movements in the order of a few centimetres, occurring within a few months, can be estimated. Erosion at S2 is precisely delineated by both methods, yielding a mean value of 1.5 cm within four months. At S1, UAV-derived point clouds’ comparison quantifies annual soil erosion more accurately, showing a maximum annual erosion rate of 48 cm. UAV-derived point clouds appear to be more accurate for channel erosion display and measurement, while the slope wash is more precisely estimated using TLS. Analysis of Point Cloud time series is a reliable and fast process for soil erosion assessment, especially in rapidly changing environments with difficult access for direct measurement methods. This study will contribute to proper georesource management by defining the best-suited methodology for soil erosion assessment after a wildfire in Mediterranean environments.


Author(s):  
Leena Matikainen ◽  
Juha Hyyppä ◽  
Paula Litkey

During the last 20 years, airborne laser scanning (ALS), often combined with multispectral information from aerial images, has shown its high feasibility for automated mapping processes. Recently, the first multispectral airborne laser scanners have been launched, and multispectral information is for the first time directly available for 3D ALS point clouds. This article discusses the potential of this new single-sensor technology in map updating, especially in automated object detection and change detection. For our study, Optech Titan multispectral ALS data over a suburban area in Finland were acquired. Results from a random forests analysis suggest that the multispectral intensity information is useful for land cover classification, also when considering ground surface objects and classes, such as roads. An out-of-bag estimate for classification error was about 3% for separating classes asphalt, gravel, rocky areas and low vegetation from each other. For buildings and trees, it was under 1%. According to feature importance analyses, multispectral features based on several channels were more useful that those based on one channel. Automatic change detection utilizing the new multispectral ALS data, an old digital surface model (DSM) and old building vectors was also demonstrated. Overall, our first analyses suggest that the new data are very promising for further increasing the automation level in mapping. The multispectral ALS technology is independent of external illumination conditions, and intensity images produced from the data do not include shadows. These are significant advantages when the development of automated classification and change detection procedures is considered.


Author(s):  
J. Gehrung ◽  
M. Hebel ◽  
M. Arens ◽  
U. Stilla

Abstract. Change detection is an important tool for processing multiple epochs of mobile LiDAR data in an efficient manner, since it allows to cope with an otherwise time-consuming operation by focusing on regions of interest. State-of-the-art approaches usually either do not handle the case of incomplete observations or are computationally expensive. We present a novel method based on a combination of point clouds and voxels that is able to handle said case, thereby being computationally less expensive than comparable approaches. Furthermore, our method is able to identify special classes of changes such as partially moved, fully moved and deformed objects in addition to the appeared and disappeared objects recognized by conventional approaches. The performance of our method is evaluated using the publicly available TUM City Campus datasets, showing an overall accuracy of 88 %.


Author(s):  
N. Tyagur ◽  
M. Hollaus

During the last ten years, mobile laser scanning (MLS) systems have become a very popular and efficient technology for capturing reality in 3D. A 3D laser scanner mounted on the top of a moving vehicle (e.g. car) allows the high precision capturing of the environment in a fast way. Mostly this technology is used in cities for capturing roads and buildings facades to create 3D city models. In our work, we used an MLS system in Moravian Karst, which is a protected nature reserve in the Eastern Part of the Czech Republic, with a steep rocky terrain covered by forests. For the 3D data collection, the Riegl VMX 450, mounted on a car, was used with integrated IMU/GNSS equipment, which provides low noise, rich and very dense 3D point clouds. <br><br> The aim of this work is to create a digital terrain model (DTM) from several MLS data sets acquired in the neighbourhood of a road. The total length of two covered areas is 3.9 and 6.1 km respectively, with an average width of 100 m. For the DTM generation, a fully automatic, robust, hierarchic approach was applied. The derivation of the DTM is based on combinations of hierarchical interpolation and robust filtering for different resolution levels. For the generation of the final DTMs, different interpolation algorithms are applied to the classified terrain points. The used parameters were determined by explorative analysis. All MLS data sets were processed with one parameter set. As a result, a high precise DTM was derived with high spatial resolution of 0.25 x 0.25 m. The quality of the DTMs was checked by geodetic measurements and visual comparison with raw point clouds. The high quality of the derived DTM can be used for analysing terrain changes and morphological structures. Finally, the derived DTM was compared with the DTM of the Czech Republic (DMR 4G) with a resolution of 5 x 5 m, which was created from airborne laser scanning data. The vertical accuracy of the derived DTMs is around 0.10 m.


Author(s):  
X. Roynard ◽  
J.-E. Deschaud ◽  
F. Goulette

Change detection is an important issue in city monitoring to analyse street furniture, road works, car parking, etc. For example, parking surveys are needed but are currently a laborious task involving sending operators in the streets to identify the changes in car locations. In this paper, we propose a method that performs a fast and robust segmentation and classification of urban point clouds, that can be used for change detection. We apply this method to detect the cars, as a particular object class, in order to perform parking surveys automatically. A recently proposed method already addresses the need for fast segmentation and classification of urban point clouds, using elevation images. The interest to work on images is that processing is much faster, proven and robust. However there may be a loss of information in complex 3D cases: for example when objects are one above the other, typically a car under a tree or a pedestrian under a balcony. In this paper we propose a method that retain the three-dimensional information while preserving fast computation times and improving segmentation and classification accuracy. It is based on fast region-growing using an octree, for the segmentation, and specific descriptors with Random-Forest for the classification. Experiments have been performed on large urban point clouds acquired by Mobile Laser Scanning. They show that the method is as fast as the state of the art, and that it gives more robust results in the complex 3D cases.


Author(s):  
A. Bocheńska ◽  
J. Markiewicz ◽  
S. Łapiński

<p><strong>Abstract.</strong> The paper presents archaeological and architectural research in the Royal Castle in Warsaw where a combination of image- and range-based 3D acquisition was applied. The area examined included excavations situated inside the Tower and near its outer western wall. The work was carried out at various periods and in different weather conditions. As part of the measurements, laser scanning was performed (with a Z+F 5006h scanner) and a series of close-range images were taken. It was important to integrate the data acquired to create a comprehensive documentation of archaeological excavations. When data was acquired from TLS together with photogrammetric data (in different measurement periods), the points' displacements were controlled and analysed. The process of orienting and processing the terrestrial images included photographs taken during the inventory of the tower (Canon 5D Mark II) and photographs provided by the Castle's employees (Canon PowerShot G5 X). Agisoft PhotoScan software was used to orient and process the terrestrial images, and LupoScan for the TLS data. In order to integrate the TLS data and the clouds of points from the photographs from the various stages, they were processed into a raster form; our own software (based on the OpenCV library and the Structure-from-Motion method) and LupoScan software were used to interconnect the multi-temporal and multi-sensor data sets. As a result of processing photographs and TLS data, point clouds in an external reference system were obtained. This data was then used to study the thickness of the walls of the Justice Court Tower, to analyse the course of the retaining wall, and to generate the orthoimages necessary for chronological analysis.</p>


Author(s):  
H.-J. Przybilla ◽  
M. Lindstaedt ◽  
T. Kersten

<p><strong>Abstract.</strong> The quality of image-based point clouds generated from images of UAV aerial flights is subject to various influencing factors. In addition to the performance of the sensor used (a digital camera), the image data format (e.g. TIF or JPG) is another important quality parameter. At the UAV test field at the former Zollern colliery (Dortmund, Germany), set up by Bochum University of Applied Sciences, a medium-format camera from Phase One (IXU 1000) was used to capture UAV image data in RAW format. This investigation aims at evaluating the influence of the image data format on point clouds generated by a Dense Image Matching process. Furthermore, the effects of different data filters, which are part of the evaluation programs, were considered. The processing was carried out with two software packages from Agisoft and Pix4D on the basis of both generated TIF or JPG data sets. The point clouds generated are the basis for the investigation presented in this contribution. Point cloud comparisons with reference data from terrestrial laser scanning were performed on selected test areas representing object-typical surfaces (with varying surface structures). In addition to these area-based comparisons, selected linear objects (profiles) were evaluated between the different data sets. Furthermore, height point deviations from the dense point clouds were determined using check points. Differences in the results generated through the two software packages used could be detected. The reasons for these differences are filtering settings used for the generation of dense point clouds. It can also be assumed that there are differences in the algorithms for point cloud generation which are implemented in the two software packages. The slightly compressed JPG image data used for the point cloud generation did not show any significant changes in the quality of the examined point clouds compared to the uncompressed TIF data sets.</p>


Author(s):  
J. Gehrung ◽  
M. Hebel ◽  
M. Arens ◽  
U. Stilla

Mobile laser scanning has not only the potential to create detailed representations of urban environments, but also to determine changes up to a very detailed level. An environment representation for change detection in large scale urban environments based on point clouds has drawbacks in terms of memory scalability. Volumes, however, are a promising building block for memory efficient change detection methods. The challenge of working with 3D occupancy grids is that the usual raycasting-based methods applied for their generation lead to artifacts caused by the traversal of unfavorable discretized space. These artifacts have the potential to distort the state of voxels in close proximity to planar structures. In this work we propose a raycasting approach that utilizes knowledge about planar surfaces to completely prevent this kind of artifacts. To demonstrate the capabilities of our approach, a method for the iterative volumetric approximation of point clouds that allows to speed up the raycasting by 36 percent is proposed.


Sign in / Sign up

Export Citation Format

Share Document