A Methodical Approach to Functional Exploratory Testing for Embedded Systems
Source abstract
Abstract
Functional exploratory testing is often considered a time- and resource-consuming activity, especially within embedded systems testing. The purpose of this paper is to present a case study of functional exploratory testing that demonstrates it to be a highly valuable technique and proves that applying the proposed methodical approach can overcome its disadvantages. This paper also provides a step-by-step framework that aids with the implementation of exploratory testing. The case study presents a low-voltage, near-motor variable frequency drive product. The results prove the effectiveness of the proposed approach.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Software Testing and Debugging Techniques · VLSI and Analog Circuit Testing · Embedded Systems Design Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Digital Systems, Silesian University of Technology, 44-100 Gliwice, Poland
Rockwell Automation, Intelligent Devices, Power Control Business, 39 Konduktorska Str., 40-155 Katowice, Poland
Funding
Rockwell Automation
References (31)
Show source-provided references
1. Gregory, J., and Crispin, L. (2015). More Agile Testing, Addison Wesley.
2. Chapter Three–On Testing Embedded Software10.1016/bs.adcom.2015.11.005 ↗
3. A software fault tree key node metric. Evaluation and Assessment in Software Engineering10.1016/j.jss.2007.01.042 ↗
4. Kimla, R. (2021, January 4–7). Overview of Metrics Applicable in Embedded Systems Functional Testing. Proceedings of the 17th International Conference of Computational Methods in Science and Engineering, ICCMSE 2021, Heraklion, Greece.10.1063/5.0119761 ↗
5. Metric-Driven Verification Methodology with Regression Management10.1007/s10836-019-05777-0 ↗
6. Functional testing of measurement-based control systems: An application to automotive10.1016/j.measurement.2014.03.017 ↗
7. Challenges concerning test case specifications in automotive software testing: Assessment of frequency and criticality10.1007/s11219-020-09523-0 ↗
8. Regression testing for large-scale embedded software development—Exploring the state of practice10.1016/j.infsof.2019.106254 ↗
9. Multifactor Algorithm for Test Case Selection and Ordering10.21123/bsj.2021.18.2(Suppl.).1056 ↗
10. Hasnain, M., Ghani, I., Pasha, M.F., and Jeong, S.R. (2021). Ontology-Based Regression Testing: A Systematic Literature Review. Appl. Sci., 11.10.3390/app11209709 ↗
11. Regression Testing in an Industrial Environment10.1145/274946.274960 ↗
12. Tsai, W., Na, Y., Paul, R., Lu, F., and Saimi, A. (2002, January 26–29). Adaptive scenario-based object-oriented test frameworks for testing embedded systems. Proceedings of the 26th Annual International Computer Software and Applications, Oxford, UK.
13. An experiment on the effectiveness and efficiency of exploratory testing10.1007/s10664-014-9301-4 ↗
14. Time and Area Optimized Testing of Automotive ICs10.1109/TVLSI.2020.3025138 ↗
15. Towards runtime verification of collaborative embedded systems10.1007/s00450-019-00425-6 ↗
16. Kaner, C., Falk, J.L., and Nguyen, H.Q. (1999). Testing Computer Software, John Wiley & Sons, Inc.. [2nd ed.].
17. Kaner, C., Bach, J., and Pettichord, B. (2001). Lessons Learned in Software Testing, John Wiley & Sons, Inc.
18. Makondo, W., Nallanthighal, R., Mapanga, I., and Kadebu, P. (2016, January 21–24). Exploratory Test Oracle using Multi-Layer Perceptron Neural Network. Proceedings of the 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Jaipur, India.10.1109/ICACCI.2016.7732202 ↗
19. De Oliveira Neves, V., Delamaro, M., and Masiero, P. (2014, January 3–7). An Environment to Support Structural Testing of Autonomous Vehicles. Proceedings of the Brazilian Symposium on Computing Systems Engineering, Manaus, Brazil.10.1109/SBESC.2014.27 ↗
20. The Role of the Tester’s Knowledge in Exploratory Software Testing10.1109/TSE.2012.55 ↗
21. Efficient and effective exploratory testing of large-scale software systems10.1016/j.jss.2020.110890 ↗
22. Yu, J., Zhang, J., Pan, L., Chen, Y., Wu, N., and Sun, W. (2021, January 10–12). Software Exploratory Testing: Present, Problem and Prospect. Proceedings of the 3rd International Academic Exchange Conference on Science and Technology Innovation (IAECST), Guangzhou, China.10.1109/IAECST54258.2021.9695695 ↗
23. Levels of Exploration in Exploratory Testing: From Freestyle to Fully Scripted10.1109/ACCESS.2018.2834957 ↗
24. Bach, J. (2022, August 17). Exploratory Testing. Available online: https://www.satisfice.com/exploratory-testing.
25. Mårtensson, T., Ståhl, D., Martini, A., and Bosch, J. (2021, January 1–3). The MaLET Model—Maturity Levels for Exploratory Testing. Proceedings of the 2021 47th Euromicro Conference on Software Engineering and Advanced Applications (SEAA), Palermo, Italy.10.1109/SEAA53835.2021.00019 ↗
26. Schaefer, C.J., and Do, H. (April, January 31). Model-Based Exploratory Testing: A Controlled Experiment. Proceedings of the 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation Workshops, Cleveland, OH, USA.10.1109/ICSTW.2014.31 ↗
27. Nishi, Y., and Shibasaki, Y. (2021, January 12–16). Boosted Exploratory Test Architecture: Coaching Test Engineers with Word Similarity. Proceedings of the 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), Porto de Galinhas, Brazil.10.1109/ICSTW52544.2021.00038 ↗
28. Eidenbenz, R., Franke, C., Sivanthi, T., and Schoenborn, S. (2021, January 12–16). Boosting Exploratory Testing of Industrial Automation Systems with AI. Proceedings of the 2021 14th IEEE Conference on Software Testing, Verification and Validation (ICST), Porto de Galinhas, Brazil.10.1109/ICST49551.2021.00048 ↗
29. Fatima, S., Mansoor, B., Ovais, L., Sadruddin, S.A., and Hashmi, S.A. (2022). Automated Testing with Machine Learning Frameworks: A Critical Analysis. Eng. Proc., 20.10.3390/engproc2022020012 ↗
30. Kloos, J., Hussain, T., and Eschbach, R. (2011, January 21–25). Risk-Based Testing of Safety-Critical Embedded Systems Driven by Fault Tree Analysis. Proceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops, Berlin, Germany.10.1109/ICSTW.2011.90 ↗
31. Souza, E., Gusmão, C., and Venâncio, J. (2010, January 12–14). Risk-Based Testing: A Case Study. Proceedings of the 2010 Seventh International Conference on Information Technology: New Generations, Las Vegas, NV, USA.10.1109/ITNG.2010.203 ↗