Redefining the Programmer: Human-AI Collaboration, LLMs, and Security in Modern Software Engineering
Source abstract
Abstract
The rapid integration of artificial intelligence (AI) into software development, driven by large language models (LLMs), is reshaping the role of programmers from traditional coders into strategic collaborators within Industry 4.0 ecosystems. This qualitative study employs a hermeneutic phenomenological approach to explore the lived experiences of Information Technology (IT) professionals as they navigate a dynamic technological landscape marked by intelligent automation, shifting professional identities, and emerging ethical concerns. Findings indicate that developers are actively adapting to AI-augmented environments by engaging in continuous upskilling, prompt engineering, interdisciplinary collaboration, and heightened ethical awareness. However, participants also voiced growing concerns about the reliability and security of AI-generated code, noting that these tools can introduce hidden vulnerabilities and reduce critical engagement due to automation bias. Many described instances of flawed logic, insecure patterns, or syntactically correct but contextually inappropriate suggestions, underscoring the need for rigorous human oversight. Additionally, the study reveals anxieties around job displacement and the gradual erosion of fundamental coding skills, particularly in environments where AI tools dominate routine development tasks. These findings highlight an urgent need for educational reforms, industry standards, and organizational policies that prioritize both technical robustness and the preservation of human expertise. As AI becomes increasingly embedded in software engineering workflows, this research offers timely insights into how developers and organizations can responsibly integrate intelligent systems to promote accountability, resilience, and innovation across the software development lifecycle.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Ethics and Social Impacts of AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. Human-AI collaboration in software engineering: lessons learned from a hands-on workshop
2. Hybrid learning-based digital twin for manufacturing process: modeling framework and implementation10.1016/j.rcim.2023.102545 ↗
3. Laws, ethics, and fairness in software engineering10.1109/MS.2024.3469488 ↗
4. De-skilling, cognitive offloading, and misplaced responsibilities: potential ironies of AI-assisted design
5. Artificial intelligence, cyber-threats and industry 4.0: challenges and opportunities10.1007/s10462-020-09942-2 ↗
6. Unlocking the Synergy: increasing productivity through Human-AI collaboration in the industry 5.0 Era10.1016/j.cie.2024.110657 ↗
7. Song F, Agarwal A, Wen W. The impact of generative AI on collaborative open-source software development: evidence from GitHub copilot [Internet]. [cited 2025 Aug 1]. Available from: 10.2139/ssrn.4856935.10.2139/ssrn.4856935 ↗
8. Applications of AI in classical software engineering10.1186/s42467-020-00005-4 ↗
9. Promptology: enhancing human-AI interaction in large language models10.3390/info15100634 ↗
10. Ciniselli M, Puccinelli N, Qiu K, Grazia L. From today’s code to tomorrow’s symphony: the AI transformation of developer’s routine by 2030. arXiv:2405.12731. 2024. doi: 10.48550/arXiv.2405.12731.
11. State of the art of the security of code generated by LLMs: a systematic literature review
12. Investigating and designing for trust in AI-powered code generation tools
13. Asleep at the keyboard? Assessing the security of GitHub copilot’s code contributions10.1145/3610721 ↗
14. It’s weird that it knows what I want: usability and interactions with copilot for novice programmers10.1145/3617367 ↗
15. A multifaceted vision of the human-AI collaboration: a comprehensive review10.1109/ACCESS.2025.3536095 ↗
16. VIRTSI: a novel trust dynamics model enhancing artificial intelligence collaboration with human users-insights from a ChatGPT evaluation study10.1016/j.ins.2024.120759 ↗
17. CyberCortex.AI: an AI-based operating system for autonomous robotics and complex automation10.1002/rob.22426 ↗
18. Hermeneutic phenomenological analysis: the ‘possibility’ beyond ‘actuality’ in thematic analysis10.1111/jan.13255 ↗
19. Maintaining the reversibility of foldings: making the ethics (politics) of information technology visible10.1007/s10676-006-9133-z ↗
20. The psychological effects of AI-assisted programming on students and professionals
21. Man or machine-or something in between? Social responses to voice assistants at work and their effects on job satisfaction10.1016/j.chb.2023.107919 ↗
22. Impact of artificial intelligence-enabled job characteristics and perceived substitution crisis on innovative work behavior of employees from high-tech firms10.1016/j.chb.2022.107215 ↗
23. Understanding security behaviors in personal computer usage: a threat avoidance perspective
24. Watson · Conceptual analyses of curriculum inquiry methodologies · 2022 · 7 · 616
25. The evolution of software development orchestration: current state and an agenda for future research10.1080/0960085X.2020.1831834 ↗
26. Weaknesses in LLM-generated code for embedded systems networki
27. Investigates the impact of AI-generated code tools on software readability code quality factor
28. AI-augmented software development: boosting efficiency and quality
29. Professionals’ responses to the introduction of AI innovations in radiology and their implications for future adoption: a qualitative study10.1186/s12913-021-06861-y ↗
30. Transparency and the black box problem: why we do not trust AI10.1007/s13347-021-00477-0 ↗
31. AI-driven innovations in software engineering: a review of current practices and future directions10.3390/app15031344 ↗
32. Hybrid intelligence10.1007/s12599-019-00595-2 ↗
33. Digitalization and industry 4.0: what skills improve professional behaviours?
34. Bridging the gap between ethics and practice10.1145/3419764 ↗
35. Transitioning from industry 4.0 to 5.0: sustainable supply chain management and talent management insights10.4102/sajhrm.v23i0.2874 ↗
36. Navigating software development in the ChatGPT and GitHub copilot era10.1016/j.bushor.2024.05.009 ↗
37. In situ bidirectional human-robot value alignment10.1126/scirobotics.abm4183 ↗
38. Software engineering by and for humans in an AI era10.1145/3715111 ↗