Quantitative Assessment of Generative Large Language Models on Design Pattern Application
Source abstract
Abstract
Design patterns offer reusable solutions for common software issues, enhancing quality. The advent of generative large language models (LLMs) marks progress in software development, but their efficacy in applying design patte... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Model-Driven Software Engineering Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (41)
Show source-provided references
1. Gamma · Design patterns: elements of reusable object-oriented software · 1995
2. A metamodeling approach to pattern-based model refactoring10.1109/MS.2003.1231152 ↗
3. OpenAI. ChatGPT. 2024 [cited 2025 Jan 31]. Available from: https://chat.openai.com/.
4. Google. Gemini. 2024 [cited 2025 Jan 31]. Available from: https://gemini.google.com/app.
5. GitHub. Github Copilot. 2021 [cited 2025 Jan 31]. Available from: https://copilot.github.com/.
6. Application of large language models to software engineering tasks: opportunities, risks, and implications
7. Towards Human-Bot collaborative software architecting with ChatGPT
8. Zhang Q, Zhang T, Zhai J, Fang C, Yu B, Sun W, et al. A critical review of large language model on software engineering: an example from ChatGPT and automated program repair. arXiv:2310.08879. 2024.
9. Kirinuki H, Tanno H. ChatGPT and human synergy in black-box testing: a comparative analysis. arXiv:2401.13924. 2024.
10. Assessment of ChatGPT’s proficiency in software development
11. Precise specification and automatic application of design patterns
12. Formalising design patterns
13. Formalizing design patterns
14. Formal specification of design patterns—a balanced approach10.5381/jot.2003.2.4.a4 ↗
15. Precise modeling of design patterns
16. Precise visual specification of design patterns
17. Design pattern modelling and instantiation using DPML
18. Using role-based modeling language (RBML) as precise characterizations of model families
19. White J, Hays S, Fu Q, Spencer-Smith J, Schmidt DC. Chatgpt prompt patterns for improving code quality, refactoring, requirements elicitation, and software design. arXiv:2303.07839. 2023.10.1007/978-3-031-55642-5_4 ↗
20. GitHub Copilot AI pair programmer: asset or liability?10.1016/j.jss.2023.111734 ↗
21. Accelerating software development with AI: exploring the impact of ChatGPT and GitHub Copilot
22. Nascimento N, Alencar P, Cowan D. Comparing software developers with ChatGPT: an empirical investigation. arXiv:2305.11837. 2023.
23. Use chat GPT to solve programming bugs
24. Is GitHub’s Copilot as bad as humans at introducing vulnerabilities in code?10.1007/s10664-023-10380-1 ↗
25. Assured offline LLM-based software engineering
26. Using ChatGPT in software requirements engineering: a comprehensive review10.3390/fi16060180 ↗
27. Accelerating software development using generative AI: ChatGPT case study
28. On the use of ChatGPT to support agile software development
29. ChatGPT application in systematic literature reviews in software engineering: an evaluation of its accuracy to support the selection activity
30. Artificial intelligence-based tools in software development processes: application of ChatGPT
31. ChatGPT in action: analyzing its use in software development
32. DevGPT: studying developer-ChatGPT conversations
33. Hassan AE, Oliva GA, Lin D, Chen B, Ming Z. Rethinking software engineering in the foundation model era: from task-driven AI Copilots to goal-driven AI pair programmers. arXiv:2404.10225. 2024.
34. Pudari R, Ernst NA. From Copilot to pilot: towards AI supported software development. arXiv:2303.04142. 2023.
35. ChatGPT as a software development Bot: a project-based study
36. Large language models for software engineering: survey and open problems
37. Nguyen-Duc A, Cabrero-Daniel B, Przybylek A, Arora C, Khanna D, Herda T, et al. Generative artificial intelligence for software engineering—a research agenda. arXiv:2310.18648. 2023.10.2139/ssrn.4622517 ↗
38. ChatGPT for software development: opportunities and challenges10.1109/MITP.2024.3379831 ↗
39. Wang Y, Chen Y, Li Z, Tang Z, Guo R, Wang X, et al. Towards efficient and reliable LLM serving: a real-world workload study. arXiv:2401.17644. 2024.
40. Sridhara G, Ranjani HG, Mazumdar S. ChatGPT: a study on its utility for ubiquitous software engineering tasks. arXiv:2305.16837. 2023.
41. Kim DK. Source code. [cited 2025 Jan 31]. Available from: https://github.com/hanbyul1/Design-Pattern-Refactoring.