journal article·2024-09-26Open access

MD-TransUNet: An Image Segmentation Network for Car Front Face Design

Jinyan Ouyang, Hongru Shi, Jianning Su, Shutao Zhang, Aimin Zhou

Applied Sciences· Volume 14· Issue 19

Abstract

To enhance the segmentation accuracy of car front face elements such as headlights and grilles for car front face design, and to improve the superiority and efficiency of solutions in automotive partial modification design, this paper introduces MD-TransUNet, a semantic segmentation network based on the TransUNet model. MD-TransUNet integrates multi-scale attention gates and dynamic-channel graph convolution networks to enhance image restoration across various design drawings. To improve accuracy and detail retention in segmenting automotive front face elements, dynamic-channel graph convolution networks model global channel relationships between contextual sequences, thereby enhancing the Transformer’s channel encoding capabilities. Additionally, a multi-scale attention-based decoder structure is employed to restore feature map dimensions, mitigating the loss of detail in the local feature encoding by the Transformer. Experimental results demonstrate that the MSAG module significantly enhances the model’s ability to capture details, while the DCGCN module improves the segmentation accuracy of the shapes and edges of headlights and grilles. The MD-TransUNet model outperforms existing models on the automotive front face dataset, achieving mF-score, mIoU, and OA metrics of 95.81%, 92.08%, and 98.86%, respectively. Consequently, the MD-TransUNet model increases the precision of automotive front face element segmentation and achieves a more advanced and efficient approach to partial modification design.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Face recognition and analysis · Advanced Neural Network Applications · Vehicle License Plate Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Design and Art, Lanzhou University of Technology, Lanzhou 730050, China

Funding

National Natural Science Foundation of China · Gansu Provincial Education Science

References (41)

Show source-provided references
1. Foreign Direct Investment in Automobile Sector in India
2. Successful Foreign Direct Investment Through the Development of Parts Supply Industries in the Host Country: A Study of India’s Automobile Manufacturing Sector10.1111/deve.12401 ↗
3. Volkova, N.A., Katanaev, N.T., and Chebyshev, A.E. (2022). End-to-end design of a competitive car with a high level of handling and safety indicators. Вестник Университета, 79–89.10.26425/1816-4277-2022-5-79-89 ↗
4. Shutong, W. (2023). Methods of Automotive Design with Artificial Intelligence Intervention. China Sci. Technol. Inf., 159–162.
5. Vehicle manufacturing efficiency improvement strategy based on full life cycle
6. Wang, B. (2019). Automotive Styling Creative Design, Tsinghua University Press. Chapter 1.
7. GEO: A Computational Design Framework for Automotive Exterior Facelift
8. Zhang, Q., Liu, Z., Yang, B., and Wang, C. (2023). Product styling cognition based on Kansei engineering theory and implicit measurement. Appl. Sci., 13.10.3390/app13179577 ↗
9. Form generative approach for front face design of electric vehicle under female aesthetic preferences10.1016/j.aei.2024.102571 ↗
10. Duan, J.J., Luo, P.S., Liu, Q., Sun, F.A., and Zhu, L.M. (2023). A modeling design method for complex products based on LSTM neural network and Kansei engineering. Appl. Sci., 13.10.3390/app13020710 ↗
11. GAC Research Institute (2023, June 16). GAC Group Research and Development. Available online: https://www.gac.com.cn/cn/.
12. Huang, J., Dong, X., Song, W., Li, H., Zhou, J., Cheng, Y., Liao, S., Chen, L., Yan, Y., and Liao, S. (2024). Consistentid: Portrait generation with multimodal fine-grained identity preserving. arXiv.
13. Chen, W., Zhang, J., Wu, J., Wu, H., Xiao, X., and Lin, L. (2024). ID-Aligner: Enhancing Identity-Preserving Text-to-Image Generation with Reward Feedback Learning. arXiv.
14. Wang, Q., Li, B., Li, X., Cao, B., Ma, L., Lu, H., and Jia, X. (2024). CharacterFactory: Sampling Consistent Characters with GANs for Diffusion Models. arXiv.
15. Guo, Z., Wu, Y., Chen, Z., Chen, L., and He, Q. (2024). PuLID: Pure and Lightning ID Customization via Contrastive Alignment. arXiv.
16. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
17. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv.
18. BGRD-TransUNet: A novel TransUNet-based model for ultrasound breast lesion segmentation10.1109/ACCESS.2024.3368170 ↗
19. Pan, S., Liu, X., Xie, N., and Chong, Y. (2023). EG-TransUNet: A transformer-based U-Net with enhanced and guided models for biomedical image segmentation. BMC Bioinform., 24.10.1186/s12859-023-05196-1 ↗
20. Jiang, T., Zhou, J., Xie, B., Liu, L., Ji, C., Liu, Y., Liu, B., and Zhang, B. (2024). Improved YOLOv8 Model for Lightweight Pigeon Egg Detection. Animals, 14.10.3390/ani14081226 ↗
21. Instance segmentation algorithm for sorting dismantling components of end-of-life vehicles10.1016/j.engappai.2024.108318 ↗
22. Automatic Outer Contour Detection and Quantification of Vehicles Using Monocular Vision10.1155/2024/6692820 ↗
23. Tang, F., Wang, L., Ning, C., Xian, M., and Ding, J. (2023, January 18–21). Cmu-net: A strong convmixer-based medical ultrasound image segmentation network. Proceedings of the 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI), Cartagena, Colombia.10.1109/ISBI53787.2023.10230609 ↗
24. Dual encoder-based dynamic-channel graph convolutional network with edge enhancement for retinal vessel segmentation10.1109/TMI.2022.3151666 ↗
25. Song, C.H., Yoon, J., Choi, S., and Avrithis, Y. (2023, January 2–7). Boosting vision transformers for image retrieval. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.10.1109/WACV56688.2023.00019 ↗
26. Courant, R., Edberg, M., Dufour, N., and Kalogeiton, V. (2023). Transformers and visual Transformers. Machine Learning for Brain Disorders, Humana.10.1007/978-1-0716-3195-9_6 ↗
27. A survey on traditional and graph theoretical techniques for image segmentation
28. Spatio-temporal-spectral hierarchical graph convolutional network with semisupervised active learning for patient-specific seizure prediction10.1109/TCYB.2021.3071860 ↗
29. Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv.
30. Multiscale dynamic graph convolutional network for hyperspectral image classification10.1109/TGRS.2019.2949180 ↗
31. Graph convolutional network hashing10.1109/TCYB.2018.2883970 ↗
32. Label co-occurrence learning with graph convolutional networks for multi-label chest x-ray image classification10.1109/JBHI.2020.2967084 ↗
33. Powers, D.M.W. (2020). Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation. arXiv.
34. A review of the F-measure: Its history, properties, criticism, and alternatives10.1145/3606367 ↗
35. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
36. Status of land cover classification accuracy assessment10.1016/S0034-4257(01)00295-4 ↗
37. Azad, R., Heidari, M., Shariatnia, M., Aghdam, E.K., Karimijafarbigloo, S., Adeli, E., and Merhof, D. (2022). Transdeeplab: Convolution-free transformer-based deeplab v3+ for medical image segmentation. Predictive Intelligence in Medicine, Springer Nature.10.1007/978-3-031-16919-9_9 ↗
38. Yin, M., Yao, Z., Cao, Y., Li, X., Zhang, Z., Lin, S., and Hu, H. (2020, January 23–28). Disentangled non-local neural networks. Proceedings of the Computer Vision—ECCV 2020, 16th European Conference, Glasgow, UK.10.1007/978-3-030-58555-6_12 ↗
39. Safa, A., Mohamed, A., Issam, B., and Mohamed-Yassine, H. (2023, January 21–23). SegFormer: Semantic segmentation based tranformers for corrosion detection. Proceedings of the 2023 International Conference on Networking and Advanced Systems (ICNAS), Algiers, Algeria.10.1109/ICNAS59892.2023.10330461 ↗
40. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
41. Strudel, R., Garcia, R., Laptev, I., and Schmid, C. (2021, January 11–17). Segmenter: Transformer for semantic segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00717 ↗