scholarly journals Monocular Localization with Vector HD Map (MLVHM): A Low-Cost Method for Commercial IVs

Sensors ◽  
2020 ◽  
Vol 20 (7) ◽  
pp. 1870 ◽  
Author(s):  
Zhongyang Xiao ◽  
Diange Yang ◽  
Tuopu Wen ◽  
Kun Jiang ◽  
Ruidong Yan
Keyword(s):  
High Precision ◽  
Optical Sensors ◽  
Low Cost ◽  
Position Estimation ◽  
Semantic Features ◽  
Map Matching ◽  
High Definition ◽  
Vehicle Localization ◽  
Semantic Level ◽  
Frame Motion

Real-time vehicle localization (i.e., position and orientation estimation in the world coordinate system) with high accuracy is the fundamental function of an intelligent vehicle (IV) system. In the process of commercialization of IVs, many car manufacturers attempt to avoid high-cost sensor systems (e.g., RTK GNSS and LiDAR) in favor of low-cost optical sensors such as cameras. The same cost-saving strategy also gives rise to an increasing number of vehicles equipped with High Definition (HD) maps. Rooted upon these existing technologies, this article presents the concept of Monocular Localization with Vector HD Map (MLVHM), a novel camera-based map-matching method that efficiently aligns semantic-level geometric features in-camera acquired frames against the vector HD map in order to achieve high-precision vehicle absolute localization with minimal cost. The semantic features are delicately chosen for the ease of map vector alignment as well as for the resiliency against occlusion and fluctuation in illumination. The effective data association method in MLVHM serves as the basis for the camera position estimation by minimizing feature re-projection errors, and the frame-to-frame motion fusion is further introduced for reliable localization results. Experiments have shown that MLVHM can achieve high-precision vehicle localization with an RMSE of 24 cm with no cumulative error. In addition, we use low-cost on-board sensors and light-weight HD maps to achieve or even exceed the accuracy of existing map-matching algorithms.

scholarly journals Integration of GPS, Monocular Vision, and High Definition (HD) Map for Accurate Vehicle Localization

Sensors ◽  
2018 ◽  
Vol 18 (10) ◽  
pp. 3270 ◽  
Author(s):  
Hao Cai ◽  
Zhaozheng Hu ◽  
Gang Huang ◽  
Dunyao Zhu ◽  
Xiaocong Su
Keyword(s):  
Kalman Filter ◽  
Low Cost ◽  
Kinematic Model ◽  
Intelligent Vehicles ◽  
Monocular Vision ◽  
Measurement Unit ◽  
High Definition ◽  
Position Information ◽  
Vehicle Localization ◽  
Lateral Distance

Self-localization is a crucial task for intelligent vehicles. Existing localization methods usually require high-cost IMU (Inertial Measurement Unit) or expensive LiDAR sensors (e.g., Velodyne HDL-64E). In this paper, we propose a low-cost yet accurate localization solution by using a custom-level GPS receiver and a low-cost camera with the support of HD map. Unlike existing HD map-based methods, which usually requires unique landmarks within the sensed range, the proposed method utilizes common lane lines for vehicle localization by using Kalman filter to fuse the GPS, monocular vision, and HD map for more accurate vehicle localization. In the Kalman filter framework, the observations consist of two parts. One is the raw GPS coordinate. The other is the lateral distance between the vehicle and the lane, which is computed from the monocular camera. The HD map plays the role of providing reference position information and correlating the local lateral distance from the vision and the GPS coordinates so as to formulate a linear Kalman filter. In the prediction step, we propose using a data-driven motion model rather than a Kinematic model, which is more adaptive and flexible. The proposed method has been tested with both simulation data and real data collected in the field. The results demonstrate that the localization errors from the proposed method are less than half or even one-third of the original GPS positioning errors by using low cost sensors with HD map support. Experimental results also demonstrate that the integration of the proposed method into existing ones can greatly enhance the localization results.

scholarly journals High Definition Map-Based Localization Using ADAS Environment Sensors for Application to Automated Driving Vehicles

2020 ◽  
Vol 10 (14) ◽  
pp. 4924
Author(s):  
Donghoon Shin ◽  
Kang-moon Park ◽  
Manbok Park
Keyword(s):  
High Performance ◽  
Low Cost ◽  
Autonomous Driving ◽  
Feature Representation ◽  
Map Matching ◽  
Localization Algorithm ◽  
Automated Driving ◽  
High Definition ◽  
Vehicle Position ◽  
Near Future

This paper presents high definition (HD) map-based localization using advanced driver assistance system (ADAS) environment sensors for application to automated driving vehicles. A variety of autonomous driving technologies are being developed using expensive and high-performance sensors, but limitations exist due to several practical issues. In respect of the application of autonomous driving cars in the near future, it is necessary to ensure autonomous driving performance by effectively utilizing sensors that are already installed for ADAS purposes. Additionally, the most common localization algorithm, which is usually used lane information only, has a highly unstable disadvantage in the absence of that information. Therefore, it is essential to ensure localization performance with other road features such as guardrails when there are no lane markings. In this study, we would like to propose a localization algorithm that could be implemented in the near future by using low-cost sensors and HD maps. The proposed localization algorithm consists of several sections: environment feature representation with low-cost sensors, digital map analysis and application, position correction based on map-matching, designated validation gates, and extended Kalman filter (EKF)-based localization filtering and fusion. Lane information is detected by monocular vision in front of the vehicle. A guardrail is perceived by radar by distinguishing low-speed object measurements and by accumulating several steps to extract wall features. These lane and guardrail information are able to correct the host vehicle position by using the iterative closest point (ICP) algorithm. The rigid transformation between the digital high definition map (HD map) and environment features is calculated through ICP matching. Each corrected vehicle position by map-matching is selected and merged based on EKF with double updating. The proposed algorithm was verified through simulation based on actual driving log data.

scholarly journals FAST Pre-Filtering-Based Real Time Road Sign Detection for Low-Cost Vehicle Localization

Sensors ◽  
2018 ◽  
Vol 18 (10) ◽  
pp. 3590 ◽  
Author(s):  
Kyoungtaek Choi ◽  
Jae Kyu Suhr ◽  
Ho Gi Jung
Keyword(s):  
Embedded System ◽  
Processing Time ◽  
State Of The Art ◽  
Low Cost ◽  
Position Estimation ◽  
The State ◽  
Vehicle Localization ◽  
Localization System ◽  
Road Sign ◽  
The Cost

In order to overcome the limitations of GNSS/INS and to keep the cost affordable for mass-produced vehicles, a precise localization system fusing the estimated vehicle positions from low-cost GNSS/INS and low-cost perception sensors is being developed. For vehicle position estimation, a perception sensor detects a road facility and uses it as a landmark. For this localization system, this paper proposes a method to detect a road sign as a landmark using a monocular camera whose cost is relatively low compared to other perception sensors. Since the inside pattern and aspect ratio of a road sign are various, the proposed method is based on the part-based approach that detects corners and combines them to detect a road sign. While the recall, precision, and processing time of the state of the art detector based on a convolutional neural network are 99.63%, 98.16%, and 4802 ms respectively, the recall, precision, and processing time of the proposed method are 97.48%, 98.78%, and 66.7 ms, respectively. The detection performance of the proposed method is as good as that of the state of the art detector and its processing time is drastically reduced to be applicable for an embedded system.

scholarly journals Lane-Level Map-Matching Method for Vehicle Localization Using GPS and Camera on a High-Definition Map

Sensors ◽  
2020 ◽  
Vol 20 (8) ◽  
pp. 2166 ◽  
Author(s):  
Jeong Min Kang ◽  
Tae Sung Yoon ◽  
Euntai Kim ◽  
Jin Bae Park
Keyword(s):  
Ground Truth ◽  
Autonomous Driving ◽  
Satellite System ◽  
Map Matching ◽  
High Definition ◽  
Driver Assistance Systems ◽  
Vehicle Localization ◽  
Reference Map ◽  
Global Navigation Satellite ◽  
Link Information

Accurate vehicle localization is important for autonomous driving and advanced driver assistance systems. Existing precise localization systems based on the global navigation satellite system cannot always provide lane-level accuracy even in open-sky environments. Map-based localization using high-definition (HD) maps is an interesting method for achieving greater accuracy. We propose a map-based localization method using a single camera. Our method relies on road link information in the HD map to achieve lane-level accuracy. Initially, we process the image—acquired using the camera of a mobile device—via inverse perspective mapping, which shows the entire road at a glance in the driving image. Subsequently, we use the Hough transform to detect the vehicle lines and acquire driving link information regarding the lane on which the vehicle is moving. The vehicle position is estimated by matching the global positioning system (GPS) and reference HD map. We employ iterative closest point-based map-matching to determine and eliminate the disparity between the GPS trajectories and reference map. Finally, we perform experiments by considering the data of a sophisticated GPS/inertial navigation system as the ground truth and demonstrate that the proposed method provides lane-level position accuracy for vehicle localization.

Sign in / Sign up

Export Citation Format

Share Document