Multi-masks Generation for Increasing Robustness of Dense Direct Methods - 3IA Côte d’Azur – Interdisciplinary Institute for Artificial Intelligence
Conference Papers Year : 2023

Multi-masks Generation for Increasing Robustness of Dense Direct Methods

Abstract

In this paper, we address the problem of increasing the precision of dense direct stereo visual odometry methods. Dense methods need a dense depth map to generate warped images (virtual views) that will match with reference images if the estimated pose is good. Previous works have shown that generating the depth map by machine learning methods leads to very good odometry results. However, machine learning methods generate hallucinated depths even in areas where it is impossible to estimate the depth due to several reasons, like occlusions, homogeneous areas, etc. Generally, this produces wrong depth estimation that leads to errors in odometry estimation. To avoid this problem, we propose a new approach to generate multiple masks that will be combined to discard wrong pixels and therefore increase the accuracy of visual odometry. Our key contribution is to use the multiple masks not only in the odometry computation but also to improve the learning of the neural network for depth map generation. Experiments on several datasets show that masked dense direct stereo visual odometry provides much more accurate results than previous approaches in the literature.
Fichier principal
Vignette du fichier
ITSC2023-Ziming.pdf (2.33 Mo) Télécharger le fichier
IROS23-Ziming.pdf (2.34 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Origin Files produced by the author(s)

Dates and versions

hal-04227583 , version 1 (03-10-2023)

Licence

Identifiers

  • HAL Id : hal-04227583 , version 1

Cite

Ziming Liu, Ezio Malis, Philippe Martinet. Multi-masks Generation for Increasing Robustness of Dense Direct Methods. ITSC 2023 - 26th IEEE International Conference on Intelligent Transportation Systems, IEEE-ITSS, Sep 2023, Bilbao, Spain. ⟨hal-04227583⟩
165 View
106 Download

Share

More