Unsupervised Monocular Depth Estimation with Edge Enhancement for Dynamic Scenes
Source abstract
Abstract
In the dynamic scene of autonomous vehicles, the depth estimation of monocular cameras often faces the problem of inaccurate edge depth estimation. To solve this problem, we propose an unsupervised monocular depth estimation model based on edge enhancement, which is specifically aimed at the depth perception challenge in dynamic scenes. The model consists of two core networks: a deep prediction network and a motion estimation network, both of which adopt an encoder-decoder architecture. The depth prediction network is based on the U-Net structure of ResNet18, which is responsible for generating the depth map of the scene. The motion estimation network is based on the U-Net structure of Flow-Net, focusing on the motion estimation of dynamic targets. In the decoding stage of the motion estimation network, we innovatively introduce an edge-enhanced decoder, which integrates a convolutional block attention module (CBAM) in the decoding process to enhance the recognition ability of the edge features of moving objects. In addition, we also designed a strip convolution module to improve the model’s capture efficiency of discrete moving targets. To further improve the performance of the model, we propose a novel edge regularization method based on the Laplace operator, which effectively accelerates the convergence process of the model. Experimental results on the KITTI and Cityscapes datasets show that compared with the current advanced dynamic unsupervised monocular model, the proposed model has a significant improvement in depth estimation accuracy and convergence speed. Specifically, the root mean square error (RMSE) is reduced by 4.8% compared with the DepthMotion algorithm, while the training convergence speed is increased by 36%, which shows the superior performance of the model in the depth estimation task in dynamic scenes.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Vision and Imaging · Optical measurement and interference techniques · Image Processing Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (35)
Show source-provided references
1. Perpendicular-cutdepth: perpendicular direction depth cutting data augmentation method
2. TS-BEV: BEV object detection algorithm based on temporal-spatial feature fusion10.1016/j.displa.2024.102814 ↗
3. Enhanced multi-scale object detection algorithm for foggy traffic scenarios
4. Improved double deep Q network algorithm based on average Q-value estimation and reward redistribution for robot path planning
5. MVS-SLAM: enhanced multiview geometry for improved semantic RGBD SLAM in dynamic environment10.1002/rob.22248 ↗
6. Advancing autonomous SLAM systems: integrating YOLO object detection and enhanced loop closure techniques for robust environment map10.1016/j.robot.2024.104871 ↗
7. ARD-SLAM: accurate and robust dynamic SLAM using dynamic object identification and improved multi-view geometrical approaches10.1016/j.displa.2024.102654 ↗
8. RadarCam-Depth: radar-camera fusion for depth estimation with learned metric scale
9. Stereo-lidar depth estimation with deformable propagation and learned disparity-depth conversion
10. Monocular depth estimation using laplacian pyramid-based depth residuals10.1109/TCSVT.2021.3049869 ↗
11. Deep ordinal regression network for monocular depth estimation
12. Denseaspp for semantic segmentation in street scenes
13. Unsupervised monocular depth estimation with left-right consistency
14. Learning monocular depth in dynamic scenes via instance aware projection consistency
15. Depth from videos in the wild: unsupervised monocular depth learning from unknown cameras
16. Depth prediction without the sensors: leveraging structure for unsupervised learning from monocular videos
17. Dynamo-depth: fixing unsupervised depth estimation for dynamical scenes
18. CBAM: convolutional block attention module
19. Unsupervised CNN for single view depth estimation: geometry to the rescue
20. Unsupervised learning of depth and ego-motion from video
21. Digging into self-supervised monocular depth estimation
22. GeoNet: unsupervised learning of dense depth, optical flow and camera pose
23. Every pixel counts++: joint learning of geometry and motion with 3D holistic understanding10.1109/TPAMI.2019.2930258 ↗
24. Unsupervised monocular depth and ego-motion learning with structure and semantics
25. Unsupervised monocular depth learning in dynamic scenes
26. Recent advances on image edge detection: a comprehensive review10.1016/j.neucom.2022.06.083 ↗
27. Busy-quiet video disentangling for video classification
28. Learning depth from monocular videos using direct methods
29. Competitive collaboration: joint unsupervised learning of depth, camera motion, optical flow and motion segmentation
30. Every pixel counts: unsupervised geometry learning with holistic 3d motion understanding
31. Consistent video depth estimation10.1145/3386569.3392377 ↗
32. Self-distilled feature aggregation for self-supervised monocular depth estimation
33. CATNet: convolutional attention and transformer for monocular depth estimation10.1016/j.patcog.2023.109982 ↗
34. PrimeDepth: efficient monocular depth estimation with a stable diffusion preimage
35. MonoProb: self-supervised monocular depth estimation with interpretable uncertainty