journal article·2025-09-17Open access

Hybrid AI-Driven Computer-Aided Engineering Optimization: Large Language Models Versus Regression-Based Models Validated Through Finite-Element Analysis

Che Ting Chien, Chao Heng Chien

Applied Sciences· Volume 15· Issue 18

Abstract

This study investigates the application potential of large language models (LLMs), particularly GPT-4o, in generating geometric parameter suggestions during the early stages of structural design. Design recommendations from the LLM are validated using a finite-element solver (FFE Plus solver), forming the core workflow of the proposed approach. To assess its effectiveness, the LLM’s performance is compared against traditional regression-based surrogate models, which serve as baseline references. A two-hole hanger bracket serves as the case study, evaluating prediction accuracy, data efficiency, generalization capability, and workflow complexity across three materials: 6061-T6, AISI 304, and AISI 1020. The key evaluation indicators include safety factor (SF) and Mass. The results show that the regression models offer high accuracy and interpretability but require extensive amounts of simulation data; in this study, each material required 252 samples to adequately cover the design space. In contrast, GPT-4o produced feasible design suggestions using only 18 initial samples, combining semantic prompting and finite-element analysis. Its prediction accuracy improved significantly with a small number of iterations, demonstrating superior data efficiency and cross-material adaptability. Overall, the findings suggest that, when paired with appropriate prompting strategies and validation mechanisms, LLMs hold great promise as an assistive tool in early-stage structural design optimization.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Multi-Objective Optimization Algorithms · Manufacturing Process and Optimization · Probabilistic and Robust Engineering Design

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical and Materials Engineering, Tatung University, Taipei City 104, Taiwan

Funding

Tatung University

References (46)

Show source-provided references
1. Generative AI and ChatGPT: Applications, challenges, and AI-human collaboration
2. Luckin, R., and Holmes, W.L. (2016). Intelligence Unleashed: An Argument for AI in Education, Pearson.
3. Examining the potential and pitfalls of ChatGPT in science and engineering problem-solving10.3389/feduc.2023.1330486 ↗
4. Makatura, L., Foshey, M., Wang, B., HähnLein, F., Ma, P., Deng, B., Tjandrasuwita, M., Spielberg, A., Owens, C.E., and Chen, P.Y. (2023). How can large language models help humans in design and manufacturing?. arXiv.10.21428/e4baedd9.745b62fa ↗
5. Liu, S., Chen, C., Qu, X., Tang, K., and Ong, Y.-S. (July, January 30). Large Language Models as Evolutionary Optimizers. Presented at the 2024 IEEE Congress on Evolutionary Computation (CEC), Yokohama, Japan.10.1109/CEC60901.2024.10611913 ↗
6. Evolving to multi-modal knowledge graphs for engineering design: State-of-the-art and future challenges10.1080/09544828.2023.2301230 ↗
7. White, J., Fu, Q., Hays, S., Sandborn, M., Olea, C., Gilbert, H., Elnashar, A., Spencer-Smith, J., and Schmidt, D.C. (2023). A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv.
8. Prompt Engineering with ChatGPT: A Guide for Academic Writers10.1007/s10439-023-03272-4 ↗
9. Multivariable Modeling with Cubic Regression Splines: A Principled Approach10.1177/1536867X0700700103 ↗
10. Luedeke, T., Bonertz, R., and Vielhaber, M. (2014, January 27–29). Weight Optimization Approach for Conceptual Design-Requirements, Functions, Working Principles. Proceedings of the NordDesign 2014, Espoo, Finland.
11. Metamodels for Computer-based Engineering Design: Survey and recommendations10.1007/PL00007198 ↗
12. Akande, T.O., Alabi, O.O., and Ajagbe, S.A. (2024). A Deep Learning-Based CAE Approach for Simulating 3D Vehicle Wheels Under Real-World Conditions. Artif. Intell. Appl., 1–5.10.47852/bonviewAIA42021882 ↗
13. Taking the Human Out of the Loop: A Review of Bayesian Optimization10.1109/JPROC.2015.2494218 ↗
14. A fast and elitist multiobjective genetic algorithm: NSGA-II10.1109/4235.996017 ↗
15. Comparative studies of metamodelling techniques under multiple modelling criteria10.1007/s00158-001-0160-4 ↗
16. Multiobjective optimization for crash safety design of vehicles using stepwise regression model10.1007/s00158-007-0163-x ↗
17. Surrogate-assisted reliability-based design optimization: A survey and a unified modular framework10.1007/s00158-019-02290-y ↗
18. A comparative study of metamodeling methods for multiobjective crashworthiness optimization10.1016/j.compstruc.2005.02.025 ↗
19. Deshpande, S., and Szefer, J. (2023, January 24–27). Analyzing ChatGPT’s Aptitude in an Introductory Computer Engineering Course. Paper Presented at the 2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE), Las Vegas, NV, USA.10.1109/CSCE60160.2023.00172 ↗
20. Application of CHATGPT in civil engineering10.37284/eaje.6.1.1272 ↗
21. Tian, J., Hou, J., Wu, Z., Shu, P., Liu, Z., Xiang, Y., Gu, B., Filla, N., Li, Y., and Liu, N. (2024). Assessing large language models in mechanical engineering education: A study on mechanics-focused conceptual understanding. arXiv.
22. Cao, Y., Li, S., Liu, Y., Yan, Z., Dai, Y., Yu, P.S., and Sun, L. (2023). A comprehensive survey of ai-generated content (aigc): A history of generative ai from gan to chatgpt. arXiv.
23. Jadhav, Y., and Farimani, A.B. (2024). Large language model agent as a mechanical designer. arXiv.
24. Li, H., Hao, Y., Zhai, Y., and Qian, Z. (2023, January 3–9). Assisting Static Analysis with Large Language Models: A Chatgpt Experiment. Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering, San Francisco, CA, USA.10.1145/3611643.3613078 ↗
25. Lange, R., Tian, Y., and Tang, Y. (2024, January 14–18). Large Language Models as Evolution Strategies. Proceedings of the Genetic and Evolutionary Computation Conference Companion, Melbourne, Australia.10.1145/3638530.3654238 ↗
26. ChatGPT for design, manufacturing, and education10.1016/j.procir.2023.04.001 ↗
27. Berenguer, A., Morejón, A., Tomás, D., and Mazón, J.-N. (2024). Leveraging Large Language Models for Sensor Data Retrieval. Appl. Sci., 14.10.3390/app14062506 ↗
28. Han, Z., Wang, J., Yan, X., Jiang, Z., Zhang, Y., Liu, S., Gong, Q., and Song, C. (2025). CoReaAgents: A Collaboration and Reasoning Framework Based on LLM-Powered Agents for Complex Reasoning Tasks. Appl. Sci., 15.10.3390/app15105663 ↗
29. Prompt engineering as a new 21st century skill10.3389/feduc.2024.1366434 ↗
30. Gu, J., Han, Z., Chen, S., Beirami, A., He, B., Zhang, G., Liao, R., Qin, Y., Tresp, V., and Torr, P. (2023). A systematic survey of prompt engineering on vision-language foundation models. arXiv.
31. Zhou, Y., Muresanu, A.I., Han, Z., Paster, K., Pitis, S., Chan, H., and Ba, J. (2023). Large Language Models are Human-Level Prompt Engineers. arXiv.
32. Prompt engineering in consistency and reliability with the evidence-based guideline for LLMs10.1038/s41746-024-01029-4 ↗
33. Prompt engineering importance and applicability with generative AI10.4236/jcc.2024.1210002 ↗
34. Schmidt, D.C., Spencer-Smith, J., Fu, Q., and White, J. (2023, September 25). Cataloging Prompt Patterns to Enhance the Discipline of Prompt Engineering. Available online: https://www.dre.vanderbilt.edu/~schmidt/PDF/ADA_Europe_Position_Paper.pdf.
35. Dai, J., Pan, X., Sun, R., Ji, J., Xu, X., Liu, M., Wang, Y., and Yang, Y. (2023). Safe rlhf: Safe reinforcement learning from human feedback. arXiv.
36. Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., and Fung, P. (2023, January 6–10). Towards Mitigating LLM Hallucination via Self Reflection. Paper Presented at the Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore.10.18653/v1/2023.findings-emnlp.123 ↗
37. Martino, A., Iannelli, M., and Truong, C. (May, January 28). Knowledge Injection to Counter Large Language Model (LLM) Hallucination. Paper Presented at the European Semantic Web Conference, Crete, Greece.
38. Friel, R., and Sanyal, A. (2023). Chainpoll: A high efficacy method for LLM hallucination detection. arXiv.
39. McDonald, D., Papadopoulos, R., and Benningfield, L. (2024). Reducing LLM hallucination using knowledge distillation: A case study with mistral large and mmlu benchmark. techRxiv.10.36227/techrxiv.171665607.76504195/v1 ↗
40. Varshney, K.R. (February, January 31). Engineering Safety in Machine Learning. Paper Presented at the 2016 Information Theory and Applications Workshop (ITA), La Jolla, CA, USA.10.1109/ITA.2016.7888195 ↗
41. Unpacking human-AI interaction in safety-critical industries: A systematic literature review10.1109/ACCESS.2024.3437190 ↗
42. Rueß, H., and Burton, S. (2022). Safe AI—How is this Possible?. arXiv.
43. Geissler, F., Roscher, K., and Trapp, M. (2024, January 25–27). Concept-Guided LLM Agents for Human-AI Safety Codesign. Proceedings of the AAAI Symposium Series, Stanford, CA, USA.10.1609/aaaiss.v3i1.31188 ↗
44. Liu, H., Liao, J., Feng, D., Xu, K., and Wang, H. (2024). Autofeedback: An llm-based framework for efficient and accurate api request generation. arXiv.
45. Li, M., Zhao, Y., Yu, B., Song, F., Li, H., Yu, H., Li, Z., Huang, F., and Li, Y. (2023). Api-bank: A comprehensive benchmark for tool-augmented llms. arXiv.10.18653/v1/2023.emnlp-main.187 ↗
46. Wang, Y., Yu, J., Yao, Z., Zhang, J., Xie, Y., Tu, S., Fu, Y., Feng, Y., Zhang, J., and Zhang, J. (2024). A solution-based LLM API-using methodology for academic information seeking. arXiv.10.1145/3690624.3709412 ↗