journal article·2023-11-27Open access

Three-Dimensional Surface Reconstruction from Point Clouds Using Euler’s Elastica Regularization

Jintao Song, Huizhu Pan, Yuting Zhang, Wenqi Lu, Jieyu Ding, Weibo Wei, Wanquan Liu, Zhenkuan Pan, Jinming Duan

Applied Sciences· Volume 13· Issue 23

Abstract

Euler’s elastica energy regularizer, initially employed in mathematical and physical systems, has recently garnered much attention in image processing and computer vision tasks. Due to the non-convexity, non-smoothness, and high order of its derivative, however, the term has yet to be effectively applied in 3D reconstruction. To this day, the industry is still searching for 3D reconstruction systems that are robust, accurate, efficient, and easy to use. While implicit surface reconstruction methods generally demonstrate superior robustness and flexibility, the traditional methods rely on initialization and can easily become trapped in local minima. Some low-order variational models are able to overcome these issues, but they still struggle with the reconstruction of object details. Euler’s elastica term, on the other hand, has been found to share the advantages of both the TV regularization term and the curvature regularization term. In this paper, we aim to address the problems of missing details and complex computation in implicit 3D reconstruction by efficiently using Euler’s elastica term. The main contributions of this article can be outlined in three aspects. Firstly, Euler’s elastica is introduced as a regularization term in 3D point cloud reconstruction. Secondly, a new dual algorithm is devised for the proposed model, significantly improving solution efficiency compared to the commonly used TV model. Lastly, numerical experiments conducted in 2D and 3D demonstrate the remarkable performance of Euler’s elastica in enhancing features of curved surfaces during point cloud reconstruction. The reconstructed point cloud surface adheres more closely to the initial point cloud surface when compared to the classical TV model. However, it is worth noting that Euler’s elastica exhibits a lesser capability in handling local extrema compared to the TV model.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Shape Modeling and Analysis · Medical Image Segmentation Techniques · Optical measurement and interference techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Computer Science and Technology, Qingdao University, Qingdao 266071, China

School of Electrical Engineering, Mathematical Science and Computing, Curtin University, Perth, WA 6102, Australia

School of Computer Science, University of Birmingham, Birmingham B15 2TT, UK

Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK

School of Intelligent Systems Engineering, Sun Yat-sen University, Shenzhen 510275, China

Funding

China Scholarship Council

References (37)

Show source-provided references
1. Michalkiewicz, M., Pontes, J.K., Jack, D., Baktashmotlagh, M., and Eriksson, A. (2019). Deep level sets: Implicit surface representations for 3D shape inference. arXiv.10.1109/ICCV.2019.00484 ↗
2. Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 15–20). DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00025 ↗
3. Dynamic graph cnn for learning on point clouds
4. Yu, X., Tang, L., Rao, Y., Huang, T., Zhou, J., and Lu, J. (2022, January 18–24). Point-BERT: Pre-Training 3D Point Cloud Transformers With Masked Point Modeling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01871 ↗
5. De Silva Edirimuni, D., Lu, X., Shao, Z., Li, G., Robles-Kelly, A., and He, Y. (2023, January 18–22). IterativePFN: True Iterative Point Cloud Filtering. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.01300 ↗
6. Williams, F., Schneider, T., Silva, C., Zorin, D., Bruna, J., and Panozzo, D. (2019, January 15–20). Deep geometric prior for surface reconstruction. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01037 ↗
7. Robust 3D reconstruction of building surfaces from point clouds based on structural and closed constraints10.1016/j.isprsjprs.2020.09.004 ↗
8. Ma, B., Liu, Y.S., and Han, Z. (2022, January 18–24). Reconstructing surfaces for sparse point clouds with on-surface priors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00621 ↗
9. Huang, Z., Wen, Y., Wang, Z., Ren, J., and Jia, K. (2022). Surface Reconstruction from Point Clouds: A Survey and a Benchmark. arXiv.
10. Three-dimensional alpha shapes10.1145/174462.156635 ↗
11. Amenta, N., Bern, M., and Kamvysselis, M. (1998, January 19–24). A new Voronoi-based surface reconstruction algorithm. Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, USA.10.1145/280814.280947 ↗
12. Xu, L., Lu, C., Xu, Y., and Jia, J. (2011, January 12–15). Image smoothing via L 0 gradient minimization. Proceedings of the 2011 SIGGRAPH Asia Conference, Hong Kong, China.
13. Zhao, H.K., Osher, S., and Fedkiw, R. (2001, January 7–12). Fast surface reconstruction using the level set method. Proceedings of the IEEE Workshop on Variational and Level Set Methods in Computer Vision, Vancouver, BC, Canada.
14. Ye, J., Bresson, X., Goldstein, T., and Osher, S. (2010). A fast variational method for surface reconstruction from sets of scattered points. CAM Rep., 10.
15. Robust and efficient implicit surface reconstruction for point clouds based on convexified image segmentation10.1007/s10915-012-9674-8 ↗
16. Surface reconstruction from unorganized points with l0 gradient minimization10.1016/j.cviu.2018.01.009 ↗
17. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations10.1016/0021-9991(88)90002-2 ↗
18. Fast global minimization of the active contour/snake model10.1007/s10851-007-0002-0 ↗
19. Implicit and nonparametric shape reconstruction from unorganized data using a variational level set method10.1006/cviu.2000.0875 ↗
20. Li, C., Xu, C., Gui, C., and Fox, M. (2005, January 20–26). Level set evolution without re-initialization: A new variational formulation. Proceedings of the CVPR 2005. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA.
21. Duan, J., Haines, B., Ward, W.O., and Bai, L. Surface reconstruction from point clouds using a novel variational model. Proceedings of the International Conference on Innovative Techniques and Applications of Artificial Intelligence, Cambridge, UK.
22. Duan, J. (2018). Variational and PDE-Based Methods for Image Processing. [Ph.D. Thesis, University of Nottingham].
23. Curvature regularized surface reconstruction from point clouds10.1137/20M1314525 ↗
24. Chen, D., Cohen, L.D., Mirebeau, J.M., and Tai, X.C. (2021, January 11–17). An elastica geodesic approach with convexity shape prior. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00682 ↗
25. Liu, H., Tai, X.C., Kimmel, R., and Glowinski, R. (2022). Elastica Models for Color Image Regularization. arXiv.10.1137/22M147935X ↗
26. A color elastica model for vector-valued image regularization10.1137/20M1354532 ↗
27. Image multiplicative denoising using adaptive Euler’s elastica as the regularization10.1007/s10915-021-01721-7 ↗
28. Elastica models for color image regularization10.1137/22M147935X ↗
29. Algorithms for finding global minimizers of image segmentation and denoising models10.1137/040615286 ↗
30. A simple fast algorithm for minimization of the elastica energy combining binary and level set representations
31. Song, J., Pan, H., Jieyu, D., Wei, W., and Pan, Z. (2022). New dual method for elastica regularization. PLoS ONE, 17.10.1371/journal.pone.0261195 ↗
32. Euler’s elastica and curvature-based inpainting10.1137/S0036139901390088 ↗
33. Euler’s Elastica and Beyond
34. A fast algorithm for Euler’s elastica model using augmented Lagrangian method10.1137/100803730 ↗
35. Image segmentation using Euler’s elastica as the regularization10.1007/s10915-013-9710-3 ↗
36. Fast sweeping algorithms for a class of Hamilton-Jacobi equations10.1137/S0036142901396533 ↗
37. A fast sweeping method for eikonal equations10.1090/S0025-5718-04-01678-3 ↗