scholarly journals A 2.5D APPROACH TO SKIN WRINKLES SEGMENTATION

2019 ◽  
Vol 38 (1) ◽  
pp. 75 ◽  
Author(s):  
Etienne Decencière ◽  
Amira Belhedi ◽  
Serge Koudoro ◽  
Frédéric Flament ◽  
Ghislain François ◽  
...  
Keyword(s):  
Point Clouds ◽  
Skin Surface ◽  
Fringe Projection ◽  
Physical Parameters ◽  
Projection System ◽  
Beneficial Effects ◽  
3D Point Clouds ◽  
Novel Method ◽  
Skin Wrinkles ◽  
Skin Wrinkling

Wrinkles or creases are common structures on surfaces. Their detection is often challenging, and can be an important step for many different applications. For instance, skin wrinkle segmentation is a crucial step for quantifying changes in skin wrinkling and assessing the beneficial effects of dermatological and cosmetic anti-ageing treatments. A 2.5D approach is proposed in this paper to segment individual wrinkles on facial skin surface described by 3D point clouds. The method, based on mathematical morphology, only needs a few physical parameters as input, namely the maximum wrinkle width, the minimum wrinkle length, and the minimum wrinkle depth. It has been applied to data acquired from eye wrinkles using a fringe projection system. An accurate evaluation was made possible thanks to manual annotations provided by three different experts. Results demonstrate the accuracy of this novel method.

scholarly journals USING MOBILE LASER SCANNING DATA FOR FEATURES EXTRACTION OF HIGH ACCURACY DRIVING MAPS

2016 ◽  
Vol XLI-B3 ◽  
pp. 433-439 ◽  
Author(s):  
Bisheng Yang ◽  
Yuan Liu ◽  
Fuxun Liang ◽  
Zhen Dong
Keyword(s):  
Laser Scanning ◽  
Human Error ◽  
Traffic Accidents ◽  
Three Dimensional ◽  
Point Clouds ◽  
High Accuracy ◽  
3D Point Clouds ◽  
Assistant Systems ◽  
Novel Method ◽  
High Flexibility

High Accuracy Driving Maps (HADMs) are the core component of Intelligent Drive Assistant Systems (IDAS), which can effectively reduce the traffic accidents due to human error and provide more comfortable driving experiences. Vehicle-based mobile laser scanning (MLS) systems provide an efficient solution to rapidly capture three-dimensional (3D) point clouds of road environments with high flexibility and precision. This paper proposes a novel method to extract road features (e.g., road surfaces, road boundaries, road markings, buildings, guardrails, street lamps, traffic signs, roadside-trees, power lines, vehicles and so on) for HADMs in highway environment. Quantitative evaluations show that the proposed algorithm attains an average precision and recall in terms of 90.6% and 91.2% in extracting road features. Results demonstrate the efficiencies and feasibilities of the proposed method for extraction of road features for HADMs.

A novel method for extracting skeleton of fruit tree from 3D point clouds

2020 ◽  
pp. 2050051
Author(s):  
Shenglian lu ◽  
Guo Li ◽  
Jian Wang
Keyword(s):  
Laser Scanning ◽  
Laser Scanner ◽  
Point Clouds ◽  
Fruit Trees ◽  
Fruit Tree ◽  
Tree Canopy ◽  
3D Point Clouds ◽  
Novel Method ◽  
Manual Interaction ◽  
Traditional Approaches

Tree skeleton could be useful to agronomy researchers because the skeleton describes the shape and topological structure of a tree. The phenomenon of organs’ mutual occlusion in fruit tree canopy is usually very serious, this should result in a large amount of data missing in directed laser scanning 3D point clouds from a fruit tree. However, traditional approaches can be ineffective and problematic in extracting the tree skeleton correctly when the tree point clouds contain occlusions and missing points. To overcome this limitation, we present a method for accurate and fast extracting the skeleton of fruit tree from laser scanner measured 3D point clouds. The proposed method selects the start point and endpoint of a branch from the point clouds by user’s manual interaction, then a backward searching is used to find a path from the 3D point cloud with a radius parameter as a restriction. The experimental results in several kinds of fruit trees demonstrate that our method can extract the skeleton of a leafy fruit tree with highly accuracy.

scholarly journals RegARD: Symmetry-Based Coarse Registration of Smartphone’s Colorful Point Clouds with CAD Drawings for Low-Cost Digital Twin Buildings

2021 ◽  
Vol 13 (10) ◽  
pp. 1882
Author(s):  
Yijie Wu ◽  
Jianga Shang ◽  
Fan Xue
Keyword(s):  
Degrees Of Freedom ◽  
Low Cost ◽  
Point Clouds ◽  
Data Sets ◽  
Digital Twin ◽  
3D Point Clouds ◽  
Coarse Registration ◽  
Smartphone Sensors ◽  
Novel Method ◽  
Twin Buildings

Coarse registration of 3D point clouds plays an indispensable role for parametric, semantically rich, and realistic digital twin buildings (DTBs) in the practice of GIScience, manufacturing, robotics, architecture, engineering, and construction. However, the existing methods have prominently been challenged by (i) the high cost of data collection for numerous existing buildings and (ii) the computational complexity from self-similar layout patterns. This paper studies the registration of two low-cost data sets, i.e., colorful 3D point clouds captured by smartphones and 2D CAD drawings, for resolving the first challenge. We propose a novel method named `Registration based on Architectural Reflection Detection’ (RegARD) for transforming the self-symmetries in the second challenge from a barrier of coarse registration to a facilitator. First, RegARD detects the innate architectural reflection symmetries to constrain the rotations and reduce degrees of freedom. Then, a nonlinear optimization formulation together with advanced optimization algorithms can overcome the second challenge. As a result, high-quality coarse registration and subsequent low-cost DTBs can be created with semantic components and realistic appearances. Experiments showed that the proposed method outperformed existing methods considerably in both effectiveness and efficiency, i.e., 49.88% less error and 73.13% less time, on average. The RegARD presented in this paper first contributes to coarse registration theories and exploitation of symmetries and textures in 3D point clouds and 2D CAD drawings. For practitioners in the industries, RegARD offers a new automatic solution to utilize ubiquitous smartphone sensors for massive low-cost DTBs.

scholarly journals USING MOBILE LASER SCANNING DATA FOR FEATURES EXTRACTION OF HIGH ACCURACY DRIVING MAPS

2016 ◽  
Vol XLI-B3 ◽  
pp. 433-439 ◽  
Author(s):  
Bisheng Yang ◽  
Yuan Liu ◽  
Fuxun Liang ◽  
Zhen Dong
Keyword(s):  
Laser Scanning ◽  
Human Error ◽  
Traffic Accidents ◽  
Three Dimensional ◽  
Point Clouds ◽  
High Accuracy ◽  
3D Point Clouds ◽  
Assistant Systems ◽  
Novel Method ◽  
High Flexibility

High Accuracy Driving Maps (HADMs) are the core component of Intelligent Drive Assistant Systems (IDAS), which can effectively reduce the traffic accidents due to human error and provide more comfortable driving experiences. Vehicle-based mobile laser scanning (MLS) systems provide an efficient solution to rapidly capture three-dimensional (3D) point clouds of road environments with high flexibility and precision. This paper proposes a novel method to extract road features (e.g., road surfaces, road boundaries, road markings, buildings, guardrails, street lamps, traffic signs, roadside-trees, power lines, vehicles and so on) for HADMs in highway environment. Quantitative evaluations show that the proposed algorithm attains an average precision and recall in terms of 90.6% and 91.2% in extracting road features. Results demonstrate the efficiencies and feasibilities of the proposed method for extraction of road features for HADMs.

scholarly journals SEMANTIC LABELLING OF ROAD FURNITURE IN MOBILE LASER SCANNING DATA

2017 ◽  
Vol XLII-2/W7 ◽  
pp. 247-254 ◽  
Author(s):  
F. Li ◽  
S. Oude Elberink ◽  
G. Vosselman
Keyword(s):  
Laser Scanning ◽  
Large Scale ◽  
Point Clouds ◽  
Autonomous Driving ◽  
Urban Environments ◽  
3D Point Clouds ◽  
Promising Solution ◽  
Novel Method ◽  
Detailed Interpretation ◽  
Semantic Labelling

Road furniture semantic labelling is vital for large scale mapping and autonomous driving systems. Much research has been investigated on road furniture interpretation in both 2D images and 3D point clouds. Precise interpretation of road furniture in mobile laser scanning data still remains unexplored. In this paper, a novel method is proposed to interpret road furniture based on their logical relations and functionalities. Our work represents the most detailed interpretation of road furniture in mobile laser scanning data. 93.3 % of poles are correctly extracted and all of them are correctly recognised. 94.3 % of street light heads are detected and 76.9 % of them are correctly identified. Despite errors arising from the recognition of other components, our framework provides a promising solution to automatically map road furniture at a detailed level in urban environments.

scholarly journals PREDICTION OF BUILDING FLOORPLANS USING LOGICAL AND STOCHASTIC REASONING BASED ON SPARSE OBSERVATIONS

2016 ◽  
Vol IV-2/W1 ◽  
pp. 265-270 ◽  
Author(s):  
S. Loch-Dehbi ◽  
Y. Dehbi ◽  
G. Gröger ◽  
L. Plümer
Keyword(s):  
A Priori ◽  
Gaussian Mixture Models ◽  
Point Clouds ◽  
Gaussian Mixture ◽  
Constraint Propagation ◽  
Linear Constraints ◽  
Functional Dependencies ◽  
3D Point Clouds ◽  
Location Parameters ◽  
Novel Method

This paper introduces a novel method for the automatic derivation of building floorplans and indoor models. Our approach is based on a logical and stochastic reasoning using sparse observations such as building room areas. No further sensor observations like 3D point clouds are needed. Our method benefits from an extensive prior knowledge of functional dependencies and probability density functions of shape and location parameters of rooms depending on their functional use. The determination of posterior beliefs is performed using Bayesian Networks. Stochastic reasoning is complex since the problem is characterized by a mixture of discrete and continuous parameters that are in turn correlated by non-linear constraints. To cope with this kind of complexity, the proposed reasoner combines statistical methods with constraint propagation. It generates a limited number of hypotheses in a model-based top-down approach. It predicts floorplans based on a-priori localised windows. The use of Gaussian mixture models, constraint solvers and stochastic models helps to cope with the a-priori infinite space of the possible floorplan instantiations.

scholarly journals Exploiting Structured CNNs For Semantic Segmentation Of Unstructured Point Clouds From LiDAR Sensor

2021 ◽  
Vol 13 (18) ◽  
pp. 3621
Author(s):  
Muhammad Ibrahim ◽  
Naveed Akhtar ◽  
Khalil Ullah ◽  
Ajmal Mian
Keyword(s):  
Point Cloud ◽  
Large Scale ◽  
Semantic Segmentation ◽  
Point Clouds ◽  
Histogram Equalization ◽  
Lidar Data ◽  
3D Point Clouds ◽  
Novel Method ◽  
Public Datasets ◽  
Processing Techniques

Accurate semantic segmentation of 3D point clouds is a long-standing problem in remote sensing and computer vision. Due to the unstructured nature of point clouds, designing deep neural architectures for point cloud semantic segmentation is often not straightforward. In this work, we circumvent this problem by devising a technique to exploit structured neural architectures for unstructured data. In particular, we employ the popular convolutional neural network (CNN) architectures to perform semantic segmentation of LiDAR data. We propose a projection-based scheme that performs an angle-wise slicing of large 3D point clouds and transforms those slices into 2D grids. Accounting for intensity and reflectivity of the LiDAR input, the 2D grid allows us to construct a pseudo image for the point cloud slice. We enhance this image with low-level image processing techniques of normalization, histogram equalization, and decorrelation stretch to suit our ultimate object of semantic segmentation. A large number of images thus generated are used to induce an encoder-decoder CNN model that learns to compute a segmented 2D projection of the scene, which we finally back project to the 3D point cloud. In addition to a novel method, this article also makes a second major contribution of introducing the enhanced version of our large-scale public PC-Urban outdoor dataset which is captured in a civic setup with an Ouster LiDAR sensor. The updated dataset (PC-Urban_V2) provides nearly 8 billion points including over 100 million points labeled for 25 classes of interest. We provide a thorough evaluation of our technique on PC-Urban_V2 and three other public datasets.

scholarly journals Symmetry Analysis of Oriental Polygonal Pagodas Using 3D Point Clouds for Cultural Heritage

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1228
Author(s):  
Ting On Chan ◽  
Linyuan Xia ◽  
Yimin Chen ◽  
Wei Lang ◽  
Tingting Chen ◽  
...  
Keyword(s):  
Cultural Heritage ◽  
Unmanned Aerial Vehicle ◽  
Point Cloud ◽  
Geometric Model ◽  
Digital Camera ◽  
Point Clouds ◽  
Symmetry Analysis ◽  
3D Point Clouds ◽  
Transmission Towers ◽  
Aerial Vehicle

Ancient pagodas are usually parts of hot tourist spots in many oriental countries due to their unique historical backgrounds. They are usually polygonal structures comprised by multiple floors, which are separated by eaves. In this paper, we propose a new method to investigate both the rotational and reflectional symmetry of such polygonal pagodas through developing novel geometric models to fit to the 3D point clouds obtained from photogrammetric reconstruction. The geometric model consists of multiple polygonal pyramid/prism models but has a common central axis. The method was verified by four datasets collected by an unmanned aerial vehicle (UAV) and a hand-held digital camera. The results indicate that the models fit accurately to the pagodas’ point clouds. The symmetry was realized by rotating and reflecting the pagodas’ point clouds after a complete leveling of the point cloud was achieved using the estimated central axes. The results show that there are RMSEs of 5.04 cm and 5.20 cm deviated from the perfect (theoretical) rotational and reflectional symmetries, respectively. This concludes that the examined pagodas are highly symmetric, both rotationally and reflectionally. The concept presented in the paper not only work for polygonal pagodas, but it can also be readily transformed and implemented for other applications for other pagoda-like objects such as transmission towers.

scholarly journals Using Least-Squares Residuals to Assess the Stochasticity of Measurements—Example: Terrestrial Laser Scanner and Surface Modeling

2021 ◽  
Vol 5 (1) ◽  
pp. 59
Author(s):  
Gaël Kermarrec ◽  
Niklas Schild ◽  
Jan Hartmann
Keyword(s):  
Least Squares ◽  
Laser Scanner ◽  
Real Data ◽  
Point Clouds ◽  
Statistical Testing ◽  
Normal Vector ◽  
Engineering Structures ◽  
3D Point Clouds ◽  
Least Squares Adjustment ◽  
Correlation Parameters

Terrestrial laser scanners (TLS) capture a large number of 3D points rapidly, with high precision and spatial resolution. These scanners are used for applications as diverse as modeling architectural or engineering structures, but also high-resolution mapping of terrain. The noise of the observations cannot be assumed to be strictly corresponding to white noise: besides being heteroscedastic, correlations between observations are likely to appear due to the high scanning rate. Unfortunately, if the variance can sometimes be modeled based on physical or empirical considerations, the latter are more often neglected. Trustworthy knowledge is, however, mandatory to avoid the overestimation of the precision of the point cloud and, potentially, the non-detection of deformation between scans recorded at different epochs using statistical testing strategies. The TLS point clouds can be approximated with parametric surfaces, such as planes, using the Gauss–Helmert model, or the newly introduced T-splines surfaces. In both cases, the goal is to minimize the squared distance between the observations and the approximated surfaces in order to estimate parameters, such as normal vector or control points. In this contribution, we will show how the residuals of the surface approximation can be used to derive the correlation structure of the noise of the observations. We will estimate the correlation parameters using the Whittle maximum likelihood and use comparable simulations and real data to validate our methodology. Using the least-squares adjustment as a “filter of the geometry” paves the way for the determination of a correlation model for many sensors recording 3D point clouds.

Sign in / Sign up

Export Citation Format

Share Document