journal article·2024-10-15Open access

VFLD: Voxelized Fractal Local Descriptor

Francisco Gomez-Donoso, Felix Escalona, Florian Dargère, Miguel Cazorla

Applied Sciences· Volume 14· Issue 20

Abstract

A variety of methods for 3D object recognition and registration based on a deep learning pipeline have recently emerged. Nonetheless, these methods require large amounts of data that are not easy to obtain, sometimes rendering them virtually useless in real-life scenarios due to a lack of generalization capabilities. To counter this, we propose a novel local descriptor that takes advantage of the fractal dimension. For each 3D point, we create a descriptor by computing the fractal dimension of the neighbors at different radii. Our redmethod has many benefits, such as being agnostic to the sensor of choice and noise, up to a level, and having few parameters to tinker with. Furthermore, it requires no training and does not rely on semantic information. We test our descriptor using well-known datasets and it largely outperforms Fast Point Feature Histogram, which is the state-of-the-art descriptor for 3D data. We also apply our descriptor to a registration pipeline and achieve accurate three-dimensional representations of the scenes, which are captured with a commercial sensor.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Image Processing and 3D Reconstruction · Image Retrieval and Classification Techniques · Image and Object Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

University Institute for Computer Research, University of Alicante, P.O. Box 99, 03690 Alicante, Spain

Funding

MCIN/AEI/10.13039/501100011033

References (38)

Show source-provided references
1. Deep learning based point cloud registration: An overview10.1016/j.vrih.2020.05.002 ↗
2. Multiscale characterizations of topographic measurements on lithic materials and microwear using a GelSight Max: Investigating potential archaeological applications
3. Recognition of multiple partial discharge patterns by multi-class support vector machine using fractal image processing technique10.1049/iet-smt.2018.5020 ↗
4. Quantitative characterization of fracture structure in coal based on image processing and multifractal theory10.1016/j.coal.2020.103566 ↗
5. Feature recognition of irregular pellet images by regularized Extreme Learning Machine in combination with fractal theory10.1016/j.future.2021.08.003 ↗
6. A voxelized fractal descriptor for 3D object recognition10.1109/ACCESS.2020.3021455 ↗
7. Hana, X.F., Jin, J.S., Xie, J., Wang, M.J., and Jiang, W. (2018). A comprehensive review of 3D point cloud descriptors. arXiv.
8. Frome, A., Huber, D., Kolluri, R., Bülow, T., and Malik, J. (2004, January 11–14). Recognizing objects in range data using regional point descriptors. Proceedings of the European Conference on Computer Vision, Prague, Czech Republic.10.1007/978-3-540-24672-5_18 ↗
9. Tombari, F., Salti, S., and Di Stefano, L. (2010, January 25). Unique shape context for 3D data description. Proceedings of the ACM Workshop on 3D Object Retrieval, Firenze, Italy.10.1145/1877808.1877821 ↗
10. Rusu, R.B., Marton, Z.C., Blodow, N., and Beetz, M. Persistent point feature histograms for 3D point clouds. Proceedings of the International Conference on Intelligent Autonomous Systems (IAS-10), Baden-Baden, Germany.
11. Rusu, R.B., Blodow, N., Marton, Z.C., and Beetz, M. (2008, January 22–26). Aligning point cloud views using persistent feature histograms. Proceedings of the 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice, France.10.1109/IROS.2008.4650967 ↗
12. Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12–17). Fast point feature histograms (FPFH) for 3D registration. Proceedings of the 2009 IEEE International Conference on Robotics and Automation, Kobe, Japan.10.1109/ROBOT.2009.5152473 ↗
13. Rusu, R.B., Holzbach, A., Beetz, M., and Bradski, G. (October, January 27). Detecting and segmenting objects for mobile manipulation. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Kyoto, Japan.10.1109/ICCVW.2009.5457718 ↗
14. Tombari, F., Salti, S., and Di Stefano, L. (2010, January 5–11). Unique signatures of histograms for local surface description. Proceedings of the European Conference on Computer Vision, Heraklion, Crete, Greece.10.1007/978-3-642-15558-1_26 ↗
15. Zeng, A., Song, S., Nießner, M., Fisher, M., Xiao, J., and Funkhouser, T. (2017, January 21–26). 3dmatch: Learning local geometric descriptors from rgb-d reconstructions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.29 ↗
16. Gojcic, Z., Zhou, C., Wegner, J.D., and Wieser, A. (2019, January 15–20). The perfect match: 3d point cloud matching with smoothed densities. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00569 ↗
17. Lu, W., Wan, G., Zhou, Y., Fu, X., Yuan, P., and Song, S. (November, January 27). Deepvcp: An end-to-end deep neural network for point cloud registration. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
18. Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4–9). Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
19. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21–26). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
20. Yew, Z.J., and Lee, G.H. (2018, January 8–14). 3dfeat-net: Weakly supervised local 3d features for point cloud registration. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01267-0_37 ↗
21. Huang, S., Gojcic, Z., Usvyatsov, M., Wieser, A., and Schindler, K. (2021, January 20–25). Predator: Registration of 3d point clouds with low overlap. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00425 ↗
22. Ao, S., Hu, Q., Yang, B., Markham, A., and Guo, Y. (2021, January 20–25). Spinnet: Learning a general surface descriptor for 3d point cloud registration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01158 ↗
23. Fractal dimension applied to plant identification10.1016/j.ins.2008.01.023 ↗
24. Fractal dimension and fractal growth of urbanized areas10.1080/13658810210137013 ↗
25. Use of the Higuchi’s fractal dimension for the analysis of MEG recordings from Alzheimer’s disease patients10.1016/j.medengphy.2008.06.010 ↗
26. Approach to an irregular time series on the basis of the fractal theory10.1016/0167-2789(88)90081-4 ↗
27. Edgar., G.A. (1993). How long is the coast of Britain? Statistical self–similarity and fractional dimension. Classics on Fractals, Addison-Wesley.
28. Fractal-Based Generative Design of structural trusses using iterated function system10.1260/0266-3511.29.4.181 ↗
29. A Comprehensive Performance Evaluation of 3D Local Feature Descriptors10.1007/s11263-015-0824-y ↗
30. 3DHoPD: A Fast Low-Dimensional 3-D Descriptor10.1109/LRA.2017.2667721 ↗
31. HoPPF: A novel local surface descriptor for 3D object recognition10.1016/j.patcog.2020.107272 ↗
32. Zhou, Q.Y., Park, J., and Koltun, V. (2018). Open3D: A modern library for 3D data processing. arXiv.
33. Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7–12). 3D ShapeNets: A deep representation for volumetric shapes. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.
34. Dai, A., Chang, A.X., Savva, M., Halber, M., Funkhouser, T., and Nießner, M. (2017). ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. arXiv.10.1109/CVPR.2017.261 ↗
35. ViDRILO: The Visual and Depth Robot Indoor Localization with Objects information dataset10.1177/0278364915596058 ↗
36. Garcia-Garcia, A., Gomez-Donoso, F., Garcia-Rodriguez, J., Orts-Escolano, S., Cazorla, M., and Azorin-Lopez, J. (2016, January 24–29). PointNet: A 3D Convolutional Neural Network for real-time object class recognition. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.10.1109/IJCNN.2016.7727386 ↗
37. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography10.1145/358669.358692 ↗
38. A method for registration of 3-D shapes10.1109/34.121791 ↗