scholarly journals A Nonlocal Method with Modified Initial Cost and Multiple Weight for Stereo Matching

2017 ◽  
Vol 2017 ◽  
pp. 1-12 ◽  
Author(s):  
Shenyong Gao ◽  
Haohao Ge ◽  
Hua Zhang ◽  
Ying Zhang
Keyword(s):  
Weight Function ◽  
Stereo Matching ◽  
Minimum Spanning Tree ◽  
Color Difference ◽  
Tree Structure ◽  
Segmentation Method ◽  
Aggregation Method ◽  
Color Distribution ◽  
Cost Aggregation ◽  
Initial Cost

This paper presents a new nonlocal cost aggregation method for stereo matching. The minimum spanning tree (MST) employs color difference as the sole component to build the weight function, which often leads to failure in achieving satisfactory results in some boundary regions with similar color distributions. In this paper, a modified initial cost is used. The erroneous pixels are often caused by two pixels from object and background, which have similar color distribution. And then inner color correlation is employed as a new component of the weight function, which is determined to effectively eliminate them. Besides, the segmentation method of the tree structure is also improved. Thus, a more robust and reasonable tree structure is developed. The proposed method was tested on Middlebury datasets. As can be expected, experimental results show that the proposed method outperforms the classical nonlocal methods.

scholarly journals Local Stereo Matching Using Adaptive Cross-Region-Based Guided Image Filtering with Orthogonal Weights

2021 ◽  
Vol 2021 ◽  
pp. 1-20
Author(s):  
Lingyin Kong ◽  
Jiangping Zhu ◽  
Sancong Ying
Keyword(s):  
Stereo Matching ◽  
Computing Time ◽  
Image Filtering ◽  
Computation Method ◽  
Aggregation Method ◽  
Additional Time ◽  
Matching Algorithm ◽  
Cost Aggregation ◽  
Matching Cost ◽  
Guided Image Filtering

Adaptive cross-region-based guided image filtering (ACR-GIF) is a commonly used cost aggregation method. However, the weights of points in the adaptive cross-region (ACR) are generally not considered, which affects the accuracy of disparity results. In this study, we propose an improved cost aggregation method to address this issue. First, the orthogonal weight is proposed according to the structural feature of the ACR, and then the orthogonal weight of each point in the ACR is computed. Second, the matching cost volume is filtered using ACR-GIF with orthogonal weights (ACR-GIF-OW). In order to reduce the computing time of the proposed method, an efficient weighted aggregation computing method based on orthogonal weights is proposed. Additionally, by combining ACR-GIF-OW with our recently proposed matching cost computation method and disparity refinement method, a local stereo matching algorithm is proposed as well. The results of Middlebury evaluation platform show that, compared with ACR-GIF, the proposed cost aggregation method can significantly improve the disparity accuracy with less additional time overhead, and the performance of the proposed stereo matching algorithm outperforms other state-of-the-art local and nonlocal algorithms.

Dense Disparity Computing Method Based on Mesh Aggregation and Snake Optimization for Stereo Vision

2020 ◽  
Vol 13 (3) ◽  
pp. 95-112
Author(s):  
Liu Shuang ◽  
Yu Shuchun
Keyword(s):  
Stereo Vision ◽  
Stereo Matching ◽  
Cost Calculation ◽  
Segmentation Method ◽  
Suppression Effect ◽  
Cost Aggregation ◽  
Brightness Difference ◽  
Matching Cost ◽  
Computing Method ◽  
Snake Algorithm

In order to generate continuous and dense disparity images, a stereo matching method based on mesh aggregation and Snake optimization is proposed in this article. First, the reference pixels are obtained, so as to improve the suppression effect of the brightness difference in Census transform and improve the accuracy of initial matching cost calculation. Second, the image is divided by SLIC super pixel segmentation method, and the neighborhood pixels are searched according to the mesh search in the region, and the matching cost of these pixels are aggregated together according to the corresponding weight to complete cost aggregation of the pixels to be matched. Third, the Snake algorithm is used in optimizing the boundary of the disparity region. Eight classes of images on the Middlebury platform are selected as the test images, and the four algorithms on the Middlebury platform are selected as reference algorithms to carry out the experimental research. The experimental results show that proportion to bad pixels is low and disparity is continuous and dense on the disparity image calculated by the algorithm proposed in this article. Performance of the proposed method is close to LocalExp algorithm which is the best on the Middlebury platform, and the proposed method can be better applied in the stereo vision.

scholarly journals A Disparity Refinement Algorithm for Satellite Remote Sensing Images Based on Mean-Shift Plane Segmentation

2021 ◽  
Vol 13 (10) ◽  
pp. 1903
Author(s):  
Zhihui Li ◽  
Jiaxin Liu ◽  
Yang Yang ◽  
Jing Zhang
Keyword(s):  
Remote Sensing ◽  
Satellite Remote Sensing ◽  
Stereo Matching ◽  
Mean Shift ◽  
Segmentation Method ◽  
Remote Sensing Images ◽  
Edge Matching ◽  
Refinement Method ◽  
Initial Segmentation ◽  
Refinement Algorithm

Objects in satellite remote sensing image sequences often have large deformations, and the stereo matching of this kind of image is so difficult that the matching rate generally drops. A disparity refinement method is needed to correct and fill the disparity. A method for disparity refinement based on the results of plane segmentation is proposed in this paper. The plane segmentation algorithm includes two steps: Initial segmentation based on mean-shift and alpha-expansion-based energy minimization. According to the results of plane segmentation and fitting, the disparity is refined by filling missed matching regions and removing outliers. The experimental results showed that the proposed plane segmentation method could not only accurately fit the plane in the presence of noise but also approximate the surface by plane combination. After the proposed plane segmentation method was applied to the disparity refinement of remote sensing images, many missed matches were filled, and the elevation errors were reduced. This proved that the proposed algorithm was effective. For difficult evaluations resulting from significant variations in remote sensing images of different satellites, the edge matching rate and the edge matching map are proposed as new stereo matching evaluation and analysis tools. Experiment results showed that they were easy to use, intuitive, and effective.

scholarly journals A Joint 2D-3D Complementary Network for Stereo Matching

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1430
Author(s):  
Xiaogang Jia ◽  
Wei Chen ◽  
Zhengfa Liang ◽  
Xin Luo ◽  
Mingfei Wu ◽  
...  
Keyword(s):  
Stereo Matching ◽  
Computational Cost ◽  
Research Field ◽  
Disparity Map ◽  
Improve Performance ◽  
Cost Aggregation ◽  
Disparity Range ◽  
Public Datasets ◽  
Coarse To Fine ◽  
Speed And Accuracy

Stereo matching is an important research field of computer vision. Due to the dimension of cost aggregation, current neural network-based stereo methods are difficult to trade-off speed and accuracy. To this end, we integrate fast 2D stereo methods with accurate 3D networks to improve performance and reduce running time. We leverage a 2D encoder-decoder network to generate a rough disparity map and construct a disparity range to guide the 3D aggregation network, which can significantly improve the accuracy and reduce the computational cost. We use a stacked hourglass structure to refine the disparity from coarse to fine. We evaluated our method on three public datasets. According to the KITTI official website results, Our network can generate an accurate result in 80 ms on a modern GPU. Compared to other 2D stereo networks (AANet, DeepPruner, FADNet, etc.), our network has a big improvement in accuracy. Meanwhile, it is significantly faster than other 3D stereo networks (5× than PSMNet, 7.5× than CSN and 22.5× than GANet, etc.), demonstrating the effectiveness of our method.

Sign in / Sign up

Export Citation Format

Share Document