A joint 2D-3D complementary network for stereo matching

X Jia, W Chen, Z Liang, X Luo, M Wu, C Li, Y He, Y Tan… - Sensors, 2021 - mdpi.com
X Jia, W Chen, Z Liang, X Luo, M Wu, C Li, Y He, Y Tan, L Huang
Sensors, 2021mdpi.com
Stereo matching is an important research field of computer vision. Due to the dimension of
cost aggregation, current neural network-based stereo methods are difficult to trade-off
speed and accuracy. To this end, we integrate fast 2D stereo methods with accurate 3D
networks to improve performance and reduce running time. We leverage a 2D encoder-
decoder network to generate a rough disparity map and construct a disparity range to guide
the 3D aggregation network, which can significantly improve the accuracy and reduce the …
Stereo matching is an important research field of computer vision. Due to the dimension of cost aggregation, current neural network-based stereo methods are difficult to trade-off speed and accuracy. To this end, we integrate fast 2D stereo methods with accurate 3D networks to improve performance and reduce running time. We leverage a 2D encoder-decoder network to generate a rough disparity map and construct a disparity range to guide the 3D aggregation network, which can significantly improve the accuracy and reduce the computational cost. We use a stacked hourglass structure to refine the disparity from coarse to fine. We evaluated our method on three public datasets. According to the KITTI official website results, Our network can generate an accurate result in 80 ms on a modern GPU. Compared to other 2D stereo networks (AANet, DeepPruner, FADNet, etc.), our network has a big improvement in accuracy. Meanwhile, it is significantly faster than other 3D stereo networks (5× than PSMNet, 7.5× than CSN and 22.5× than GANet, etc.), demonstrating the effectiveness of our method.
MDPI
以上显示的是最相近的搜索结果。 查看全部搜索结果