journal article·2024Open access

Perpendicular-Cutdepth: Perpendicular Direction Depth Cutting Data Augmentation Method

Le Zou, Linsong Hu, Yifan Wang, Zhize Wu, Xiaofeng Wang

Computers, Materials & Continua· Volume 79· Issue 1

Abstract

Depth estimation is an important task in computer vision. Collecting data at scale for monocular depth estimation is challenging, as this task requires simultaneously capturing RGB images and depth information. Therefore, data augmentation is crucial for this task. Existing data augmentation methods often employ pixel-wise transformations, which may inadvertently disrupt edge features. In this paper, we propose a data augmentation method for monocular depth estimation, which we refer to as the Perpendicular-Cutdepth method. This method involves cutting real-world depth maps along perpendicular directions and pasting them onto input images, thereby diversifying the data without compromising edge features. To validate the effectiveness of the algorithm, we compared it with existing convolutional neural network (CNN) against the current mainstream data augmentation algorithms. Additionally, to verify the algorithm’s applicability to Transformer networks, we designed an encoder-decoder network structure based on Transformer to assess the generalization of our proposed algorithm. Experimental results demonstrate that, in the field of monocular depth estimation, our proposed method, Perpendicular-Cutdepth, outperforms traditional data augmentation methods. On the indoor dataset NYU, our method increases accuracy from 0.900 to 0.907 and reduces the error rate from 0.357 to 0.351. On the outdoor dataset KITTI, our method improves accuracy from 0.9638 to 0.9642 and decreases the error rate from 0.060 to 0.0598.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Numerical Analysis Techniques · Advanced Measurement and Metrology Techniques · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. Fault detection in gears using fault samples enlarged by a combination of numerical simulation and a generative adversarial network10.1109/TMECH.2021.3132459 ↗
2. FEM Simulation-based generative adversarial networks to detect bearing faults10.1109/TII.2020.2968370 ↗
3. A personalized diagnosis method to detect faults in gears using numerical simulation and extreme learning machine10.1016/j.knosys.2020.105653 ↗
4. A novel personalized diagnosis methodology using numerical simulation and an intelligent method to detect faults in a shaft10.3390/app6120414 ↗
5. Remote sensing image denoising based on improved semi-soft threshold10.1007/s11760-020-01722-3 ↗
6. New image denoising algorithm using monogenic wavelet transform and improved deep convolutional neural network10.1007/s11042-019-08569-y ↗
7. Machinery fault diagnosis based on domain adaptation to bridge the gap between simulation and measured signals
8. SASLN: Signals augmented self-taught learning networks for mechanical fault diagnosis under small sample condition10.1109/TIM.2021.3127641 ↗
9. Rethinking data augmentation for image super-resolution: A comprehensive analysis and a new strategy
10. KeepAugment: A simple information-preserving data augmentation approach
11. CutMix: Regularization strategy to train strong classifiers with localizable features
12. T. Devries and G. W. Taylor, “Improved regularization of convolutional neural networks with cutout,” arXiv preprint arXiv:1708.04552, 2017.
13. Random erasing data augmentation
14. Simple copy-paste is a strong data augmentation method for instance segmentation
15. Y. Ishii and T. Yamashita, “CutDepth: Edge-aware data augmentation in depth estimation,” arXiv preprint arXiv:2107.07684, 2021.
16. D. Kim, W. Ga, P. Ahn, D. Joo, S. Chun, and J. Kim, “Global-local path networks for monocular depth estimation with vertical cutdepth,” arXiv preprint arXiv:2201.07436, 2022.
17. How do neural networks see depth in single images?
18. Indoor segmentation and support inference from RGBD images
19. Vision meets robotics: The KITTI dataset10.1177/0278364913491297 ↗
20. J. H. Lee, M. K. Han, D. W. Ko, and I. H. Suh, “From big to small: Multi scale local planar guidance for monocular depth estimation,” arXiv preprint arXiv:1907.10326, 2019.
21. OmniFusion: 360 monocular depth estimation via geometry-aware fusion
22. Boosting lightweight depth estimation via knowledge distillation
23. Probabilistic and geometric depth: Detecting objects in perspective
24. EfficientNet: Rethinking model scaling for convolutional neural networks
25. Res2Net: A new multi-scale backbone architecture10.1109/TPAMI.2019.2938758 ↗
26. Dynamic spatial propagation network for depth completion
27. P3Depth: Monocular depth estimation with a piecewise planarity prior
28. AdaBins: Depth estimation using adaptive bins
29. SegFormer: Simple and efficient design for semantic segmentation with transformers
30. Swin transformer: Hierarchical vision transformer using shifted windows
31. Localbins: Improving depth estimation by learning local distributions
32. Depthformer: Multiscale vision transformer for monocular depth estimation with global local information fusion
33. Depth map decomposition for monocular depth estimation
34. Cascaded transposed long-range convolutions for monocular depth estimation
35. Monocular depth estimation using whole strip masking and reliability-based refinement
36. Densely connected convolutional networks