journal article·2025-04-21Open access

A Texture-Based Simulation Framework for Pose Estimation

Yaoyang Shen, Ming Kong, Hang Yu, Lu Liu

Applied Sciences· Volume 15· Issue 8

Abstract

An accurate 3D pose estimation of spherical objects remains challenging in industrial inspections and robotics due to their geometric symmetries and limited feature discriminability. This study proposes a texture-optimized simulation framework to enhance pose prediction accuracy through optimizing the surface texture features of the design samples. A hierarchical texture design strategy was developed, incorporating complexity gradients (low to high) and color contrast principles, and implemented via VTK-based 3D modeling with automated Euler angle annotations. The framework generated 2297 synthetic images across six texture variants, which were used to train a MobileNet model. The validation tests demonstrated that the high-complexity color textures achieved superior performance, reducing the mean absolute pose error by 64.8% compared to the low-complexity designs. While color improved the validation accuracy universally, the test set analyses revealed its dual role: complex textures leveraged chromatic contrast for robustness, whereas simple textures suffered color-induced noise (a 35.5% error increase). These findings establish texture complexity and color complementarity as critical design criteria for synthetic datasets, offering a scalable solution for vision-based pose estimation. Physical experiments confirmed the practical feasibility, yielding 2.7–3.3° mean errors. This work bridges the simulation-to-reality gaps in symmetric object localization, with implications for robotic manipulation and industrial metrology, while highlighting the need for material-aware texture adaptations in future research.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Surveying and Cultural Heritage · Advanced Vision and Imaging · 3D Shape Modeling and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Measurement Technology and Instrumentation, China Jiliang University, Hangzhou 310020, China

Funding

National Natural Science Foundation of China

References (33)

Show source-provided references
1. KMFDSST Algorithm-Based Rotor Attitude Estimation for a Spherical Motor10.1109/TII.2023.3323709 ↗
2. Hansen, J.G., and de Figueiredo, R.P. (2024). Active Object Detection and Tracking Using Gimbal Mechanisms for Autonomous Drone Applications. Drones, 8.10.3390/drones8020055 ↗
3. A Discrete Quaternion Particle Filter Based on Deterministic Sampling for IMU Attitude Estimation10.1109/JSEN.2021.3109156 ↗
4. Hao, D., Zhang, G., Zhao, H., and Ding, H. (2025). A Combined Calibration Method for Workpiece Positioning in Robotic Machining Systems and a Hybrid Optimization Algorithm for Improving Tool Center Point Calibration Accuracy. Appl. Sci., 15.10.3390/app15031033 ↗
5. A feature matching and compensation method based on importance weighting for occluded human pose estimation10.1016/j.jksuci.2024.102061 ↗
6. Cross domain 2D-3D descriptor matching for unconstrained 6-DOF pose estimation10.1016/j.patcog.2023.109655 ↗
7. Yu, X., Zhuang, Z., Koniusz, P., and Li, H. (2020). 6dof object pose estimation via differentiable proxy voting loss. arXiv.
8. UAV Pose Estimation in GNSS-Denied Environment Assisted by Satellite Imagery Deep Learning Features10.1109/ACCESS.2020.3048342 ↗
9. Bogaart, M.V.D., Jacobs, N., Hallemans, A., and Meyns, P. (2025). Validity of Deep Learning-Based Motion Capture Using DeepLabCut to Assess Proprioception in Children. Appl. Sci., 15.10.3390/app15073428 ↗
10. Park, S., Jeong, W.-J., Manawadu, M., and Park, S.-Y. (2025). 6-DoF Pose Estimation from Single RGB Image and CAD Model Retrieval Using Feature Similarity Measurement. Appl. Sci., 15.10.3390/app15031501 ↗
11. Kubicki, B., Janowski, A., and Inglot, A. (2025). Multimodal Augmented Reality System for Real-Time Roof Type Recognition and Visualization on Mobile Devices. Appl. Sci., 15.10.3390/app15031330 ↗
12. Hodaň, T., Sundermeyer, M., Drost, B., Labbé, Y., Brachmann, E., Michel, F., Rother, C., and Matas, J. (2020, January 23–28). BOP challenge 2020 on 6D object localization. Proceedings of the Computer Vision–ECCV 2020 Workshops, Glasgow, UK. Proceedings, Part II 16.10.1007/978-3-030-66096-3_39 ↗
13. Peng, S., Liu, Y., Huang, Q., Zhou, X., and Bao, H. (2019, January 15–20). Pvnet: Pixel-wise voting network for 6dof pose estimation. Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA. CVPR 2019 Open Access Repository.10.1109/CVPR.2019.00469 ↗
14. Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.10.1017/CBO9780511811685 ↗
15. Perceived intrinsic 3D shape of faces is robust to changes in lighting direction, image rotation and polarity inversion10.1016/j.visres.2024.108535 ↗
16. International Collaboration for Turbulence Tracking the dynamics of translation and absolute orientation of a sphere in a turbulent flow10.1063/1.3554304 ↗
17. Translational and rotational dynamics of a large buoyant sphere in turbulence10.1007/s00348-016-2136-6 ↗
18. Dynamics of freely rising spheres: The effect of moment of inertia10.1017/jfm.2021.749 ↗
19. Deep learning-based estimation of ash content in coal: Unveiling the contributions of color and texture features10.1016/j.measurement.2024.114632 ↗
20. Contextual recovery network for low-light image enhancement with texture recovery10.1016/j.jvcir.2024.104050 ↗
21. Textural Features Corresponding to Visual Perception10.1109/TSMC.1978.4309999 ↗
22. Dzierżak, R. (2025). Impact of Texture Feature Count on the Accuracy of Osteoporotic Change Detection in Computed Tomography Images of Trabecular Bone Tissue. Appl. Sci., 15.10.3390/app15031528 ↗
23. Trevisani, S., and Guth, P.L. (2024). Terrain Analysis According to Multiscale Surface Roughness in the Taklimakan Desert. Land, 13.10.3390/land13111843 ↗
24. Design Characterization for Black-and-White Textures in Visualization
25. Goodman, J.W. (2005). Introduction to Fourier Optics, Roberts and Company Publishers.
26. High-speed 3D shape measurement with structured light methods: A review10.1016/j.optlaseng.2018.02.017 ↗
27. The development of the CIE 2000 colour-difference formula: CIEDE200010.1002/col.1049 ↗
28. Schroeder, W., Martin, K.M., and Lorensen, W.E. (1998). The Visualization Toolkit an Object-Oriented Approach to 3D Graphics, Prentice-Hall, Inc.
29. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
30. Song, W., Guo, C., Shen, L., and Zhang, Y. (2018, January 8–11). 3D pose measurement for industrial parts with complex shape by monocular vision. Proceedings of the SPIE 10827, Sixth International Conference on Optical and Photonic Engineering (icOPEN 2018), Shanghai, China.
31. Balntas, V., Doumanoglou, A., Sahin, C., Sock, J., Kouskouridas, R., and Kim, T.K. (2017, January 22–29). Pose Guided RGBD Feature Learning for 3D Object Pose Estimation. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.416 ↗
32. Pose estimation based on Geometric Algebra
33. 3D pose estimation of tomato peduncle nodes using deep keypoint detection and point cloud10.1016/j.biosystemseng.2024.04.017 ↗