Region of Attraction for a Vehicle Pose Estimator Utilizing Monocular Vision and Lane Marker Maps

2016 ◽  
Author(s):  
Robert D. Leary ◽  
Sean Brennan
Keyword(s):  
Real Time ◽  
Low Cost ◽  
Autonomous Vehicle ◽  
Ground Truth ◽  
Estimation Algorithm ◽  
Lane Detection ◽  
Monocular Vision ◽  
Detection Methods ◽  
Region Of Attraction ◽  
Vehicle Localization

Currently, there is a lack of low-cost, real-time solutions for accurate autonomous vehicle localization. The fusion of a precise a priori map and a forward-facing camera can provide an alternative low-cost method for achieving centimeter-level localization. This paper analyzes the position and orientation bounds, or region of attraction, with which a real-time vehicle pose estimator can localize using monocular vision and a lane marker map. A pose estimation algorithm minimizes the residual pixel-level error between the estimated and detected lane marker features via Gauss-Newton nonlinear least-squares. Simulations of typical road scenes were used as ground truth to ensure the pose estimator will converge to the true vehicle pose. A successful convergence was defined as a pose estimate that fell within 5 cm and 0.25 degrees of the true vehicle pose. The results show that the longitudinal vehicle state is weakly observable with the smallest region of attraction. Estimating the remaining five vehicle states gives repeatable convergence within the prescribed convergence bounds over a relatively large region of attraction, even for the simple lane detection methods used herein. A main contribution of this paper is to demonstrate a repeatable and verifiable method to assess and compare lane-based vehicle localization strategies.

scholarly journals Robust Lane-Detection Method for Low-Speed Environments

Sensors ◽  
2018 ◽  
Vol 18 (12) ◽  
pp. 4274 ◽  
Author(s):  
Qingquan Li ◽  
Jian Zhou ◽  
Bijun Li ◽  
Yuan Guo ◽  
Jinsheng Xiao
Keyword(s):  
Real Time ◽  
Autonomous Vehicles ◽  
Low Cost ◽  
Lane Detection ◽  
Detection Methods ◽  
Low Speed ◽  
Geometric Fitting ◽  
The Road ◽  
Edge Points ◽  
Time Requirements

Vision-based lane-detection methods provide low-cost density information about roads for autonomous vehicles. In this paper, we propose a robust and efficient method to expand the application of these methods to cover low-speed environments. First, the reliable region near the vehicle is initialized and a series of rectangular detection regions are dynamically constructed along the road. Then, an improved symmetrical local threshold edge extraction is introduced to extract the edge points of the lane markings based on accurate marking width limitations. In order to meet real-time requirements, a novel Bresenham line voting space is proposed to improve the process of line segment detection. Combined with straight lines, polylines, and curves, the proposed geometric fitting method has the ability to adapt to various road shapes. Finally, different status vectors and Kalman filter transfer matrices are used to track the key points of the linear and nonlinear parts of the lane. The proposed method was tested on a public database and our autonomous platform. The experimental results show that the method is robust and efficient and can meet the real-time requirements of autonomous vehicles.

scholarly journals Integration of GPS, Monocular Vision, and High Definition (HD) Map for Accurate Vehicle Localization

Sensors ◽  
2018 ◽  
Vol 18 (10) ◽  
pp. 3270 ◽  
Author(s):  
Hao Cai ◽  
Zhaozheng Hu ◽  
Gang Huang ◽  
Dunyao Zhu ◽  
Xiaocong Su
Keyword(s):  
Kalman Filter ◽  
Low Cost ◽  
Kinematic Model ◽  
Intelligent Vehicles ◽  
Monocular Vision ◽  
Measurement Unit ◽  
High Definition ◽  
Position Information ◽  
Vehicle Localization ◽  
Lateral Distance

Self-localization is a crucial task for intelligent vehicles. Existing localization methods usually require high-cost IMU (Inertial Measurement Unit) or expensive LiDAR sensors (e.g., Velodyne HDL-64E). In this paper, we propose a low-cost yet accurate localization solution by using a custom-level GPS receiver and a low-cost camera with the support of HD map. Unlike existing HD map-based methods, which usually requires unique landmarks within the sensed range, the proposed method utilizes common lane lines for vehicle localization by using Kalman filter to fuse the GPS, monocular vision, and HD map for more accurate vehicle localization. In the Kalman filter framework, the observations consist of two parts. One is the raw GPS coordinate. The other is the lateral distance between the vehicle and the lane, which is computed from the monocular camera. The HD map plays the role of providing reference position information and correlating the local lateral distance from the vision and the GPS coordinates so as to formulate a linear Kalman filter. In the prediction step, we propose using a data-driven motion model rather than a Kinematic model, which is more adaptive and flexible. The proposed method has been tested with both simulation data and real data collected in the field. The results demonstrate that the localization errors from the proposed method are less than half or even one-third of the original GPS positioning errors by using low cost sensors with HD map support. Experimental results also demonstrate that the integration of the proposed method into existing ones can greatly enhance the localization results.

scholarly journals Birds Eye View Look-Up Table Estimation with Semantic Segmentation

2021 ◽  
Vol 11 (17) ◽  
pp. 8047
Author(s):  
Dongkyu Lee ◽  
Wee Peng Tay ◽  
Seok-Cheol Kee
Keyword(s):  
Pose Estimation ◽  
Low Cost ◽  
Autonomous Vehicle ◽  
Synthetic Data ◽  
Ground Truth ◽  
Image Plane ◽  
Semantic Segmentation ◽  
Single Camera ◽  
Look Up Table ◽  
Camera Pose

In this work, a study was carried out to estimate a look-up table (LUT) that converts a camera image plane to a birds eye view (BEV) plane using a single camera. The traditional camera pose estimation fields require high costs in researching and manufacturing autonomous vehicles for the future and may require pre-configured infra. This paper proposes an autonomous vehicle driving camera calibration system that is low cost and utilizes low infra. A network that outputs an image in the form of an LUT that converts the image into a BEV by estimating the camera pose under urban road driving conditions using a single camera was studied. We propose a network that predicts human-like poses from a single image. We collected synthetic data using a simulator, made BEV and LUT as ground truth, and utilized the proposed network and ground truth to train pose estimation function. In the progress, it predicts the pose by deciphering the semantic segmentation feature and increases its performance by attaching a layer that handles the overall direction of the network. The network outputs camera angle (roll/pitch/yaw) on the 3D coordinate system so that the user can monitor learning. Since the network's output is a LUT, there is no need for additional calculation, and real-time performance is improved.

scholarly journals Low-Cost Real-Time PPP/INS Integration for Automated Land Vehicles

Sensors ◽  
2019 ◽  
Vol 19 (22) ◽  
pp. 4896 ◽  
Author(s):  
Mohamed Elsheikh ◽  
Walid Abdelfatah ◽  
Aboelmagd Nourledin ◽  
Umar Iqbal ◽  
Michael Korenberg
Keyword(s):  
Real Time ◽  
Low Cost ◽  
Estimation Algorithm ◽  
Satellite System ◽  
Single Frequency ◽  
The Road ◽  
Land Vehicles ◽  
On The Road ◽  
Vehicle Automation ◽  
Global Navigation Satellite

The last decade has witnessed a growing demand for precise positioning in many applications including car navigation. Navigating automated land vehicles requires at least sub-meter level positioning accuracy with the lowest possible cost. The Global Navigation Satellite System (GNSS) Single-Frequency Precise Point Positioning (SF-PPP) is capable of achieving sub-meter level accuracy in benign GNSS conditions using low-cost GNSS receivers. However, SF-PPP alone cannot be employed for land vehicles due to frequent signal degradation and blockage. In this paper, real-time SF-PPP is integrated with a low-cost consumer-grade Inertial Navigation System (INS) to provide a continuous and precise navigation solution. The PPP accuracy and the applied estimation algorithm contributed to reducing the effects of INS errors. The system was evaluated through two road tests which included open-sky, suburban, momentary outages, and complete GNSS outage conditions. The results showed that the developed PPP/INS system maintained horizontal sub-meter Root Mean Square (RMS) accuracy in open-sky and suburban environments. Moreover, the PPP/INS system could provide a continuous real-time positioning solution within the lane the vehicle is moving in. This lane-level accuracy was preserved even when passing under bridges and overpasses on the road. The developed PPP/INS system is expected to benefit low-cost precise land vehicle navigation applications including level 2 of vehicle automation which comprises services such as lane departure warning and lane-keeping assistance.

Real-time lane detection and tracking for autonomous vehicle applications

2019 ◽  
Vol 233 (9) ◽  
pp. 2301-2311 ◽  
Author(s):  
Xinyu Jiao ◽  
Diange Yang ◽  
Kun Jiang ◽  
Chunlei Yu ◽  
Tuopu Wen ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Real Time ◽  
Detection Method ◽  
Autonomous Vehicle ◽  
Lane Detection ◽  
Vanishing Point ◽  
Lane Tracking ◽  
Detection And Tracking ◽  
Vanishing Point Detection ◽  
Point Detection

This article proposes an improved lane detection and tracking method for autonomous vehicle applications. In real applications, when the pose and position of the camera are changed, parameters and thresholds in the algorithms need fine adjustment. In order to improve adaptability to different perspective conditions, a width-adaptive lane detection method is proposed. As a useful reference to reduce noises, vanishing point is widely applied in lane detection studies. However, vanishing point detection based on original image consumes many calculation resources. In order to improve the calculation efficiency for real-time applications, we proposed a simplified vanishing point detection method. In the feature extraction step, a scan-line method is applied to detect lane ridge features, the width threshold of which is set automatically based on lane tracking. With clustering, validating, and model fitting, lane candidates are obtained from the basic ridge features. A lane-voted vanishing point is obtained by the simplified grid-based method, then applied to filter out noises. Finally, a multi-lane tracking Kalman filter is applied, the confirmed lines of which also provide adaptive width threshold for ridge feature extraction. Real-road experimental results based on our intelligent vehicle testbed proved the validity and robustness of the proposed method.

scholarly journals Real-Time Vehicle Positioning and Mapping Using Graph Optimization

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2815
Author(s):  
Anweshan Das ◽  
Jos Elfring ◽  
Gijs Dubbelman
Keyword(s):  
Real Time ◽  
Rural Areas ◽  
Low Cost ◽  
Ground Truth ◽  
Visual Odometry ◽  
Graph Optimization ◽  
Urban And Rural Areas ◽  
Vehicle Positioning ◽  
Rate Sensor ◽  
Pose Graph Optimization

In this work, we propose and evaluate a pose-graph optimization-based real-time multi-sensor fusion framework for vehicle positioning using low-cost automotive-grade sensors. Pose-graphs can model multiple absolute and relative vehicle positioning sensor measurements and can be optimized using nonlinear techniques. We model pose-graphs using measurements from a precise stereo camera-based visual odometry system, a robust odometry system using the in-vehicle velocity and yaw-rate sensor, and an automotive-grade GNSS receiver. Our evaluation is based on a dataset with 180 km of vehicle trajectories recorded in highway, urban, and rural areas, accompanied by postprocessed Real-Time Kinematic GNSS as ground truth. We compare the architecture’s performance with (i) vehicle odometry and GNSS fusion and (ii) stereo visual odometry, vehicle odometry, and GNSS fusion; for offline and real-time optimization strategies. The results exhibit a 20.86% reduction in the localization error’s standard deviation and a significant reduction in outliers when compared with automotive-grade GNSS receivers.

Sign in / Sign up

Export Citation Format

Share Document