journal article·2021Open access

Automated Test Case Generation from Requirements: A Systematic Literature Review

Ahmad Mustafa, Wan M. N. Wan-Kadir, Noraini Ibrahim, Muhammad Arif Shah, Muhammad Younas, Atif Khan, Mahdi Zareei, Faisal Alanazi

Computers, Materials & Continua· Volume 67· Issue 2

Abstract

Software testing is an important and cost intensive activity in software development. The major contribution in cost is due to test case generations. Requirement-based testing is an approach in which test cases are derivative from requirements without considering the implementation’s internal structure. Requirement-based testing includes functional and nonfunctional requirements. The objective of this study is to explore the approaches that generate test cases from requirements. A systematic literature review based on two research questions and extensive quality assessment criteria includes studies. The study identifies 30 primary studies from 410 studies spanned from 2000 to 2018. The review’s finding shows that 53% of journal papers, 42% of conference papers, and 5% of book chapters’ address requirements-based testing. Most of the studies use UML, activity, and use case diagrams for test case generation from requirements. One of the significant lessons learned is that most software testing errors are traced back to errors in natural language requirements. A substantial amount of work focuses on UML diagrams for test case generations, which cannot capture all the system’s developed attributes. Furthermore, there is a lack of UML-based models that can generate test cases from natural language requirements by refining them in context. Coverage criteria indicate how efficiently the testing has been performed 12.37% of studies use requirements coverage, 20% of studies cover path coverage, and 17% study basic coverage.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Software Engineering Research · Software Engineering Techniques and Practices · Software Reliability and Analysis Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (25)

Show source-provided references
1. IEEE, “ISO/IEC/IEEE international standard—systems and software engineering,” ISO/IEC/IEEE 29148:2011(E), pp. 1–94, 2011.
2. Jorgensen · Software Testing: A Craftsman’s Approach · 2016
3. IEEE Standards Committee, “IEEE standard for software and system test documentation,” IEEE Std 829-2008 (Revision of IEEE Std 829-1998)—Redline, pp. 1–161, 2008.
4. Global software testing under deadline pressure: Vendor-side experiences10.1016/j.infsof.2013.04.005 ↗
5. Integrating risk-based testing in industrial test processes10.1007/s11219-013-9226-y ↗
6. Testability estimation model (TEM OOD)
7. Testing TLS using planning-based combinatorial methods and execution framework10.1007/s11219-018-9412-z ↗
8. A semi-automated approach for generating natural language requirements documents based on business process models10.1016/j.infsof.2017.08.009 ↗
9. Automated test case generation from domain specific models of high-level requirements
10. An empirical study of requirements-based test generation on an automobile control system
11. B. Kitchenham and S. Charters, “Guidelines for performing systematic literature reviews in software engineering,” Technical report, EBSE, 2007.
12. A systematic review of systematic review process research in software engineering10.1016/j.infsof.2013.07.010 ↗
13. Utting · Practical model-based testing: A tools approach · 2010
14. SDL 2011: Integrating system and software modeling
15. Automatic generation of test cases for critical systems based on MC/DC criteria
16. Sound and quasi-complete detection of infeasible test requirements
17. Evolution of software in automated production systems: Challenges and research directions10.1016/j.jss.2015.08.026 ↗
18. Requirements traceability in automated test generation10.1145/1082983.1083282 ↗
19. Sabaliauskaite · LNCS Department of Computer Science, Lund University · 2010 · 6182 · 128
20. Applying a systematic approach to link requirements and testing: A case study
21. Ellis · Business analysis benchmark: The impact of business requirements on the success of technology projects · 2008
22. Experimentation in software engineering: An introduction—kluwer academic publishers
23. OWL-S based test case generation
24. OWL-S based interaction testing of web service-based system
25. Testing control flow of composite service