journal article·2025-04-12Open access

Monocular Vision-Based Depth Estimation of Forward-Looking Scenes for Mobile Platforms

Li Wei, Meng Ding, Shuai Li

Applied Sciences· Volume 15· Issue 8

Abstract

The depth estimation of forward-looking scenes is one of the fundamental tasks for an Intelligent Mobile Platform to perceive its surrounding environment. In response to this requirement, this paper proposes a self-supervised monocular depth estimation method that can be utilized across various mobile platforms, including unmanned aerial vehicles (UAVs) and autonomous ground vehicles (AGVs). Building on the foundational framework of Monodepth2, we introduce an intermediate module between the encoder and decoder of the depth estimation network to facilitate multiscale fusion of feature maps. Additionally, we integrate the channel attention mechanism ECANet into the depth estimation network to enhance the significance of important channels. Consequently, the proposed method addresses the issue of losing critical features, which can lead to diminished accuracy and robustness. The experiments presented in this paper are conducted on two datasets: KITTI, a publicly available dataset collected from real-world environments used to evaluate depth estimation performance for AGV platforms, and AirSim, a custom dataset generated using simulation software to assess depth estimation performance for UAV platforms. The experimental results demonstrate that the proposed method can overcome the adverse effects of varying working conditions and accurately perceive detailed depth information in specific regions, such as object edges and targets of different scales. Furthermore, the depth predicted by the proposed method is quantitatively compared with the ground truth depth, and a variety of evaluation metrics confirm that our method exhibits superior inference capability and robustness.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Vision and Imaging · Robotics and Sensor-Based Localization · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Engineering, Nanhang Jincheng College, Nanjing 211156, China

College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China

Funding

National Natural Science Foundation of China · Aeronautical Science Foundation of China · School-level Research Fund Project of Nanhang Jincheng College

References (29)

Show source-provided references
1. A survey on deploying mobile deep learning applications: A systemic and technical perspective10.1016/j.dcan.2021.06.001 ↗
2. Edge intelligence in intelligent transportation systems: A survey10.1109/TITS.2023.3275741 ↗
3. Raj, R., and Kos, A. (2022). A comprehensive study of mobile robot: History, developments, applications, and future research perspectives. Appl. Sci., 12.10.3390/app12146951 ↗
4. Yeong, D.J., Velasco-Hernandez, G., Barry, J., and Walsh, J. (2021). Sensor and sensor fusion technology in autonomous vehicles: A review. Sensors, 21.10.20944/preprints202102.0459.v1 ↗
5. Milburn, L., Gamba, J., Fernandes, M., and Semini, C. (2023, January 26–27). Computer-Vision Based Real Time Waypoint Generation for Autonomous Vineyard Navigation with Quadruped Robots. Proceedings of the 2023 IEEE International Conference on Autonomous Robot Systems and Competitions, Tomar, Portugal.10.1109/ICARSC58346.2023.10129563 ↗
6. Milestones in autonomous driving and intelligent vehicles: Survey of surveys10.1109/TIV.2022.3223131 ↗
7. A survey on vision-based UAV navigation10.1080/10095020.2017.1420509 ↗
8. Visual-based obstacle detection and tracking, and conflict detection for small UAS sense and avoid10.1016/j.ast.2021.107167 ↗
9. Object depth measurement and filtering from monocular images for unmanned aerial vehicles
10. Wang, Y., Chao, W.L., Garg, D., Hariharan, B., Campbell, M., and Weinberger, K.Q. (2019, January 15–20). Pseudo-lidar from visual depth estimation: Bridging the gap in 3d object detection for autonomous driving. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00864 ↗
11. 4D mm Wave radar for autonomous driving perception: A comprehensive survey10.1109/TIV.2024.3380244 ↗
12. Monocular depth estimation based on deep learning: An overview10.1007/s11431-020-1582-8 ↗
13. Accuracy of unmanned aerial systems photogrammetry and structure from motion in surveying and mapping: A review10.1007/s12524-021-01366-x ↗
14. Zhang, Y., Wu, Y., Tong, K., Chen, H., and Yuan, Y. (2023). Review of visual simultaneous localization and mapping based on deep learning. Remote Sens., 15.10.3390/rs15112740 ↗
15. Single image depth estimation: An overview10.1016/j.dsp.2022.103441 ↗
16. On the synergies between machine learning and binocular stereo for depth estimation from images: A survey
17. Masoumian, A., Rashwan, H.A., Cristiano, J., Asif, M.S., and Puig, D. (2022). Monocular depth estimation using deep learning: A review. Sensors, 22.10.3390/s22145353 ↗
18. Towards real-time monocular depth estimation for robotics: A survey10.1109/TITS.2022.3160741 ↗
19. Eigen, D., Puhrsch, C., and Fergus, R. (2014, January 8–13). Depth map prediction from a single image using a multi-scale deep network. Proceedings of the 2014 Advances in Neural Information Processing Systems, Montreal, QC, Canada.
20. Liu, F., Shen, C., and Lin, G. (2015, January 7). Deep convolutional neural fields for depth estimation from a single image. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7299152 ↗
21. Huang, B., Zheng, J.Q., Nguyen, A., Tuch, D., Vyas, K., Giannarou, S., and Elson, D.S. (October, January 27). Self-supervised generative adversarial network for depth estimation in laparoscopic images. Proceedings of the 24th International Conference on Medical Image Computing and Computer Assisted Intervention, Strasbourg, France.
22. Godard, C., Mac Aodha, O., Firman, M., and Brostow, G.J. (November, January 27). Digging into self-supervised monocular depth estimation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.10.1109/ICCV.2019.00393 ↗
23. Towards better data exploitation in self-supervised monocular depth estimation10.1109/LRA.2023.3337594 ↗
24. Zhou, Z., Rahman Siddiquee, M.M., Tajbakhsh, N., and Liang, J. (2018, January 20). Unet++: A nested u-net architecture for medical image segmentation. Proceedings of the Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support: 4th International Workshop, Granada, Spain.10.1007/978-3-030-00889-5_1 ↗
25. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
26. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 14–19). ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
27. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
28. Seif, G., and Dimitrios, A. (2018, January 15–20). Edge-Based Loss Function for Single Image Super-Resolution. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.10.1109/ICASSP.2018.8461664 ↗
29. Zhou, T., Brown, M., Snavely, N., and Lowe, D.G. (2017, January 21–26). Unsupervised learning of depth and ego-motion from video. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.700 ↗