journal article·2025-12-10Open access

Reference-Free Evaluation Metric for Fine-Grained 3D Shape Editing

JiangDong Miao, Bisser Raytchev, Takuji Nakashima, Takenori Hiraoka, Keigo Shimizu, Yanlei Gu, Toru Higaki

Applied Sciences· Volume 15· Issue 24

Abstract

Evaluating the quality of fine-grained 3D shape editing, such as adjusting a vehicle’s roof length or wheelbase, is essential for assessing generative models but remains challenging. Most existing metrics depend on auxiliary regressors or large-scale human evaluations, which may introduce bias, reduce reproducibility, and increase evaluation cost. To address these issues, a reference-free metric for evaluating fine-grained 3D shape editing is proposed. The method is based on the Rich-Attribute Sufficiency Assumption (RASA), which posits that when a geometric attribute set is sufficiently comprehensive, models with the same attribute vector should exhibit nearly identical shapes. Following this assumption, the dataset itself serves as a validation source: each source model is edited to match a small set of target attribute vectors, and the post-editing similarity to the targets reflects the editor’s accuracy and stability. Reproducible indicators are defined, including mean similarity, variation across targets, and calibration with respect to attribute distance. Empirical validation demonstrates the effectiveness of the proposed metric, showing approximately 9% degradation under semantic perturbations and less than 2% variation across different target-sampling settings, confirming both its discriminative sensitivity and robustness. This framework provides a low-cost, regressor-free benchmark for fine-grained editing and establishes its applicability through an explicit assumption and evaluation protocol.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Shape Modeling and Analysis · Additive Manufacturing and 3D Printing Technologies · Manufacturing Process and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School of Advanced Science and Engineering, Hiroshima University, Hiroshima 730-0046, Japan

Mazda Motor Corporation, Hiroshima 730-8670, Japan

Funding

Japan Society for the Promotion of Science

References (29)

Show source-provided references
1. Elrefaie, M., Qian, J., Wu, R., Chen, Q., Dai, A., and Ahmed, F. (2025, January 17–20). AI Agents in Engineering Design: A Multi-Agent Framework for Aesthetic and Aerodynamic Car Design. Proceedings of the 51st Design Automation Conference (DAC), Boston, MA, USA.10.1115/DETC2025-169682 ↗
2. Achlioptas, P., Diamanti, O., Mitliagkas, I., and Guibas, L. (2018). Learning Representations and Generative Models for 3D Point Clouds. arXiv.
3. Wu, J., Zhang, C., Xue, T., Freeman, W.T., and Tenenbaum, J.B. (2017). Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling. arXiv.
4. Foti, S., Koo, B., Stoyanov, D., and Clarkson, M.J. (2022). 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces. arXiv.10.1109/CVPR52688.2022.01817 ↗
5. Park, J.J., Florence, P., Straub, J., Newcombe, R., and Lovegrove, S. (2019, January 16–20). DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00025 ↗
6. Zhuang, J., Wang, C., Liu, L., Lin, L., and Li, G. (2023, January 12–15). DreamEditor: Text-Driven 3D Scene Editing with Neural Fields. Proceedings of the SIGGRAPH Asia 2023 Conference Papers, Sydney, NSW, Australia.10.1145/3610548.3618190 ↗
7. Li, Y., Dou, Y., Shi, Y., Lei, Y., Chen, X., Zhang, Y., Zhou, P., and Ni, B. (2024, January 20–27). FocalDreamer: Text-driven 3D Editing via Focal-fusion Assembly. Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence (AAAI-24), Vancouver, BC, Canada.10.1609/aaai.v38i4.28113 ↗
8. Tzathas, P., Maragos, P., and Roussos, A. (2023, January 3–7). 3D Neural Sculpting (3DNS): Editing Neural Signed Distance Functions. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00450 ↗
9. Mikaeili, A., Perel, O., Safaee, M., Cohen-Or, D., and Mahdavi-Amiri, A. (2023, January 2–6). SKED: Sketch-guided Text-based 3D Editing. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France.10.1109/ICCV51070.2023.01343 ↗
10. TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts10.1145/3658205 ↗
11. Sabat, B.O., Achille, A., Trager, M., and Soatto, S. (2024). NeRF-Insert: 3D Local Editing with Multimodal Control Signals. arXiv.
12. Dong, J., and Wang, Y.X. (2023, January 10–16). ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields. Proceedings of the 37th International Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, LA, USA.
13. Khalid, U., Iqbal, H., Karim, N., Hua, J., and Chen, C. (October, January 29). LatentEditor: Text Driven Local Editing of 3D Scenes. Proceedings of the Computer Vision – ECCV 2024: 18th European Conference, Milan, Italy. Part LXIV.10.1007/978-3-031-73039-9_21 ↗
14. Erkoç, Z., Gümeli, C., Wang, C., Nießner, M., Dai, A., Wonka, P., Lee, H.Y., and Zhuang, P. (2024). PrEditor3D: Fast and Precise 3D Shape Editing. arXiv.10.1109/CVPR52734.2025.00068 ↗
15. Enhancing the Aesthetics of 3D Shapes via Reference-based Editing10.1145/3687954 ↗
16. Zhuang, P., Koyejo, O., and Schwing, A.G. (2021). Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation. arXiv.
17. Hessel, J., Holtzman, A., Forbes, M., Bras, R.L., and Choi, Y. (2022). CLIPScore: A Reference-free Evaluation Metric for Image Captioning. arXiv.10.18653/v1/2021.emnlp-main.595 ↗
18. Chandrasekar, A., Chakrabarty, G., Bardhan, J., Hebbalaguppe, R., and AP, P. (2024). ReMOVE: A Reference-free Metric for Object Erasure. arXiv.10.1109/CVPRW63382.2024.00788 ↗
19. Ku, L.W., Martins, A., and Srikumar, V. (2024, January 11–16). VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand.10.18653/v1/2024.acl-long.663 ↗
20. Huang, I., Achlioptas, P., Zhang, T., Tulyakov, S., Sung, M., and Guibas, L. (2022). LADIS: Language Disentanglement for 3D Shape Editing. arXiv.10.18653/v1/2022.findings-emnlp.404 ↗
21. Achlioptas, P., Fan, J., Hawkins, R., Goodman, N., and Guibas, L. (November, January 27). ShapeGlot: Learning Language for Shape Differentiation. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
22. Achlioptas, P., Huang, I., Sung, M., Tulyakov, S., and Guibas, L. (2023, January 18–22). ShapeTalk: A Language Dataset and Framework for 3D Shape Edits and Deformations. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.01220 ↗
23. He, R., Huang, S., Nie, X., Hui, T., Liu, L., Dai, J., Han, J., Li, G., and Liu, S. (2023). Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training. arXiv.10.1109/CVPR52733.2024.00665 ↗
24. Madhavaram, V., Rawat, S., Devaguptapu, C., Sharma, C., and Kaul, M. (2024). Towards a Training Free Approach for 3D Scene Editing. arXiv.10.1109/WACV61041.2025.00286 ↗
25. Hu, J., Hui, K.H., Liu, Z., Zhang, H., and Fu, C.W. (August, January 28). CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization. Proceedings of the ACM SIGGRAPH 2024 Conference Papers (SIGGRAPH ’24), Denver, CO, USA.10.1145/3641519.3657412 ↗
26. Hong, S., Karras, J., Martin-Brualla, R., and Kemelmacher-Shlizerman, I. (2025). Perturb-and-Revise: Flexible 3D Editing with Generative Trajectories. arXiv.10.1109/CVPR52734.2025.01519 ↗
27. Fine-grained 3D vehicle shape manipulation via latent space editing10.1007/s00138-025-01739-z ↗
28. Liu, Z., Wang, Y., Vaidya, S., Ruehle, F., Halverson, J., Soljačić, M., Hou, T.Y., and Tegmark, M. (2025). KAN: Kolmogorov-Arnold Networks. arXiv.
29. Visualizing Data using t-SNE