journal article·2020-10-04Open access

The Derivation of Defect Priorities and Core Defects through Impact Relationship Analysis between Embedded Software Defects

Sang Moo Huh, Woo-Je Kim

Applied Sciences· Volume 10· Issue 19

Abstract

As embedded software is closely related to hardware equipment, any defect in embedded software can lead to major accidents. Thus, all defects must be collected, classified, and tested based on their severity. In the pure software field, a method of deriving core defects already exists, enabling the collection and classification of all possible defects. However, in the embedded software field, studies that have collected and categorized relevant defects into an integrated perspective are scarce, and none of them have identified core defects. Therefore, the present study collected embedded software defects worldwide and identified 12 types of embedded software defect classifications through iterative consensus processes with embedded software experts. The impact relation map of the defects was drawn using the decision-making trial and evaluation laboratory (DEMATEL) method, which analyzes the influence relationship between elements. As a result of analyzing the impact relation map, the following core embedded software defects were derived: hardware interrupt, external interface, timing error, device error, and task management. All defects can be tested using this defect classification. Moreover, knowing the correct test order of all defects can eliminate critical defects and improve the reliability of embedded systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Software Engineering Research · Software Reliability and Analysis Research · Software System Performance and Reliability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School of Public Policy and Information Technology, Seoul National University of Science and Technology, Gongneung-ro 232, Nowon-gu, Seoul 01811, Korea

Department of Industrial Engineering, Seoul National University of Science and Technology, Gongneung-ro 232, Nowon-gu, Seoul 01811, Korea

References (44)

Show source-provided references
1. An investigation of the Therac-25 accidents10.1109/MC.1993.274940 ↗
2. Lann, G.L. (1996). The Ariane 5 Flight 501 failure—A case study in system engineering for computing systems. [Research Report] RR-3079. INRIA, Available online: https://hal.inria.fr/inria-00073613.
3. Esparza, J., Spanfelner, B., and Grumberg, O. (2010). A gentle introduction to formal verification of computer systems by abstract interpretation. Logics and Languages for Reliability and Security, IOS Press.
4. What types of defects are really discovered in code reviews?10.1109/TSE.2008.71 ↗
5. A method to establish severity weight of defect factors for application software using ANP [Korean]10.5626/JOK.2015.42.11.1349 ↗
6. IEEE (2010). IEEE standard classification for software anomalies. IEEE Std. 1044–2009 (Revision of IEEE Std 1044–1993), IEEE. Available online: http://www.ctestlabs.org/neoacm/1044_2009.pdf.
7. Huber, J.T. (2020, September 02). A Comparison of IBM’s Orthogonal Defect Classification to Hewlett Packard’s Defect Origins, Types and Modes 1.0. Hewlett Packard Co. Available online: http://www.stickyminds.com/sitewide.asp?Function=edetail&ObjectType=ART&ObjectId=2883.
8. IBM (2020, September 02). Orthogonal Defect Classification v5.2 for Software Design and Code. IBM. Available online: https://researcher.watson.ibm.com/researcher/files/us-pasanth/ODC-5-2.pdf.
9. Five top causes of nasty embedded software bugs
10. Five more top causes of nasty embedded software bugs
11. Lutz, R. Analyzing software requirements errors in safety-critical, embedded systems. Proceedings of the IEEE International Symposium on Requirements Engineering.
12. Hagar, J.D. (2013). Software Test Attacks to Break Mobile and Embedded Devices, Chapman and Hall/CRC.10.1201/b15526 ↗
13. A study of verification for embedded software [Korean]
14. Programming enhancements for embedded software development-focus on MISRA-C [Korean]
15. Bennett, T., and Wennberg, P. (2005). Eliminating embedded software defects prior to integration test. J. Def. Softw. Eng. Triakis Corp., Available online: https://pdfs.semanticscholar.org/3070/1dcef9b58d6c167751aaeaff7c9628cf04c4.pdf.
16. Seo, J. (2009). Embedded Software Interface Test Based on the Status of System [Korean]. [Ph.D. Thesis, Department of Computer Science and Engineering Graduate School, EWHA Womans University]. Available online: http://www.riss.kr/link?id=T11551362.
17. Choi, Y.N. (2010). Automated Debugging Cooperative Method for Dynamic Memory Defects in Embedded Software System Test [Korean]. [Master’s Thesis, Department of Computer Science and Engineering Graduate School, EWHA Womans University]. Available online: http://dspace.ewha.ac.kr/handle/2015.oak/188271.
18. Lee, S. (2011). Automated Method for Reliability Verification in Embedded Software System Exception Handling Test [Korean]. [Master’s Thesis, Department of Computer Science and Engineering Graduate School, Ewha Womans University]. Available online: https://dspace.ewha.ac.kr/handle/2015.oak/188659.
19. Faultprog: Testing the accuracy of binary-level software fault injection10.1109/TDSC.2016.2522968 ↗
20. Reclassification of fault, error, and failure types for reliability verification of defense embedded systems [Korean]
21. JTAG fault injection methodology for reliability verification of defense embedded systems [Korean]
22. Lee, H.-J. (2012). Statistical JTAG Fault Injection Methodology for Reliability Verification of Aerospace Embedded Systems [Korean]. [Master’s Thesis, Department of Electronics and Information Engineering Korea Aerospace University]. Available online: http://www.riss.kr/link?id=T12740845.
23. Jankowicz, D. (2005). The Easy Guide to Repertory Grids, John Wiley and Sons.
24. Si, S.-L., You, X.-Y., Liu, H.-C., and Zhang, P. (2018). DEMATEL technique: A systematic review of the state-of-the-art literature on methodologies and applications. Math. Probl. Eng.10.1155/2018/3696457 ↗
25. The qualitative content analysis process10.1111/j.1365-2648.2007.04569.x ↗
26. Content analysis: A flexible methodology10.1353/lib.2006.0053 ↗
27. Qualitative content analysis
28. Using DEMATEL method to analyze the causal relations on technological innovation capability evaluation factors in Thai technology-based firms
29. Asgharpour, M.J. (2003). Group Decision Making and Game Theory in Operation Research, University of Tehran Publications. [3rd ed.].
30. Reprioritization of failures in a system failure mode and effects analysis by decision making trial and evaluation laboratory technique10.1016/j.ress.2005.09.005 ↗
31. Ölçer, M.G. (2013). Developing a spreadsheet based decision support system using DEMATEL and ANP approaches. [Master’s Thesis, DEÜ Fen Bilimleri Enstitüsü]. Available online: http://hdl.handle.net/20.500.12397/7682.
32. Evaluation criteria for blog design and analysis of causal relationships using factor analysis and DEMATEL10.1016/j.eswa.2011.07.006 ↗
33. A DEMATEL method in identifying key success factors of hospital service quality10.1016/j.knosys.2010.01.013 ↗
34. A novel hybrid MCDM model combined with DEMATEL and ANP with applications
35. Research on software hazard classification10.1016/j.proeng.2014.09.098 ↗
36. Noergaard, T. (2005). Embedded Systems Architecture: A Comprehensive Guide for Engineers and Programmers, Elsevier Inc.. [1st ed.].
37. A functionality-based evaluation model for embedded software [Korean]
38. An interface test tool based on an emulator for improving embedded software testing [Korean]
39. An interface test model for hardware-dependent software and embedded OS API of the embedded system10.1016/j.csi.2006.07.002 ↗
40. Rodriguez Dapena, P. (2002). Software Safety Verification in Critical Software Intensive Systems. [Ph.D. Thesis, Technische Universiteit Eindhoven].
41. Sung, A. (2007). Interface based embedded software test for real-time operating system [Korean]. [Ph.D. Thesis, Department of Computer Science and Engineering, Ewha Womans University]. Available online: http://www.riss.kr/link?id=T11039605.
42. Jung, H. (2007). Failure Mode Based Test Methods for Embedded Software [Korean]. [Master’s Thesis, Ajou University Graduate School of Engineering]. Available online: http://www.riss.kr/link?id=T11077107.
43. Jones, N. (2020, September 02). A Taxonomy of Bug Types in Embedded Systems. Stack Overflow, Embeddedgurus.Com. Available online: https://embeddedgurus.com/stack-overflow/2009/10/a-taxonomy-of-bug-types-in-embedded-systems.
44. Emulation of software faults: A field data study and a practical approach10.1109/TSE.2006.113 ↗