Big Data Testing Techniques: Taxonomy, Challenges and Future Trends
Source abstract
Abstract
Big Data is reforming many industrial domains by providing decision support through analyzing large data volumes. Big Data testing aims to ensure that Big Data systems run smoothly and error-free while maintaining the performance and quality of data. However, because of the diversity and complexity of data, testing Big Data is challenging. Though numerous research efforts deal with Big Data testing, a comprehensive review to address testing techniques and challenges of Big Data is not available as yet. Therefore, we have systematically reviewed the Big Data testing techniques’ evidence occurring in the period 2010–2021. This paper discusses testing data processing by highlighting the techniques used in every processing phase. Furthermore, we discuss the challenges and future directions. Our findings show that diverse functional, non-functional and combined (functional and non-functional) testing techniques have been used to solve specific problems related to Big Data. At the same time, most of the testing challenges have been faced during the MapReduce validation phase. In addition, the combinatorial testing technique is one of the most applied techniques in combination with other techniques (i.e., random testing, mutation testing, input space partitioning and equivalence testing) to find various functional faults through Big Data testing.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Software Testing and Debugging Techniques · Software System Performance and Reliability · Radiation Effects in Electronics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (74)
Show source-provided references
1. Manyika · Big Data: The Next Frontier for Innovation, Competition and Productivity · 2011 · 1
2. Minimizing the number of deployed UAVs for delay-bounded data collection of IoT devices
3. Big data: What it is and why you should care
4. Number of monthly active facebook users worldwide as of first quarter 2022 (in millions)
5. Towards differentiating business intelligence, big data, data analytics and knowledge discovery
6. Olendorf · Big Data and Visual Analytics · 2017 · 19110.1007/978-3-319-63917-8_11 ↗
7. What makes Big data, Big data? exploring the ontological characteristics of 26 datasets10.1177/2053951716631130 ↗
8. On the impact of high performance computing in Big data analytics for medicine
9. Big data: Testing approach to overcome quality challenges
10. Quality assurance for big data application-issues, challenges, and needs
11. Testing MapReduce programs: A systematic mapping study
12. Big data and quality: A literature review
13. Getting ready for big data testing: A practitioner’s perception
14. State of art in testing for big data
15. A survey on quality assurance techniques for big data applications
16. Scalability and validation of big data bioinformatics software10.1016/j.csbj.2017.07.002 ↗
17. Benchmarking big data systems: A review10.1109/TSC.2017.2730882 ↗
18. Big data application in biomedical research and health care: A literature review10.4137/BII.S31559 ↗
19. Testing MapReduce programs: A mapping study
20. A preliminary overview of the situation in big data testing
21. Kitchenham · Tech. Rep. EBSE Technical Report EBSE-2007–01 · 2007
22. Systematic reviews in the social sciences: A practical guide
23. Lessons from applying the systematic literature review process within the software engineering domain10.1016/j.jss.2006.07.009 ↗
24. Using forward snowballing to update systematic reviews in software engineering
25. Guidelines for snowballing in systematic literature studies and a replication in software engineering
26. A machine learning based framework for verification and validation of massive scale image data10.1109/TBDATA.2017.2680460 ↗
27. Towards an MDE-based approach to test entity reconciliation applications
28. Configuration/Infrastructure-aware testing of MapReduce programs10.25046/aj020111 ↗
29. Towards dependability testing of MapReduce systems
30. Applying MapReduce algorithm to performance testing in lexical analysis on HDFS
31. Experiences in testing and analysing data intensive systems
32. Knowledge management initiatives in software testing: A mapping study10.1016/j.infsof.2014.05.016 ↗
33. Applying combinatorial test data generation to big data applications
34. Extending search-based software testing techniques to big data applications
35. Infrastructure-aware functional testing of mapreduce programs
36. Automatic testing of design faults in mapreduce applications10.1109/TR.2018.2802047 ↗
37. Testing data transformations in MapReduce programs
38. Towards ex vivo testing of mapreduce applications
39. MRTree: Functional testing based on mapReduce’s execution behavior
40. New ideas track: Testing mapreduce-style programs
41. High-volume performance test framework using big data
42. Big data transformation testing based on data reverse engineering
43. A framework for ensuring the quality of a big data service
44. Early integration testing for entity reconciliation in the context of heterogeneous data sources10.1109/TR.2018.2809866 ↗
45. A productivity improvement of distributed software testing using checkpoint
46. A scalable big data test framework
47. Research of performance test technology for big data applications
48. Big data validation needs and challenges
49. Issues with conducting controlled on-line experiments for e-commerce
50. J. E. Marynowski, M. Albonico, E. C. de Almeida and G. Sunye, “Testing mapreduce-based systems,” arXiv preprint, arXiv, 2012.
51. Challenges and techniques for testing of big data10.1016/j.procs.2016.05.285 ↗
52. A multi agents based approach for testing MapReduce systems
53. Generalized big data test framework for etl migration
54. A Method- level test generation framework for debugging big data applications
55. Automated data- processing function identification using deep neural network10.1109/ACCESS.2020.2981537 ↗
56. Designing and implementing library parallel processing of large data
57. Energy efficient big data networks: Impact of volume and variety10.1109/TNSM.2017.2787624 ↗
58. Method for testing the fault tolerance of mapreduce frameworks10.1016/j.comnet.2015.04.009 ↗
59. Modeling expands value of performance testing for big data applications
60. Challenges of software testing for astronomical big data
61. Exploring the specificities and challenges of testing big data systems
62. Runtime performance challenges in big data systems
63. Tutorial workshop [9 abstracts]
64. Some impacts of big data on usability practice10.1145/2424840.2424842 ↗
65. Xiang · New Software Engineering Paradigm Based on Complexity Science · 2011 · 37110.1007/978-1-4419-7326-9_14 ↗
66. A. Pebdani, “A data flow multiprocessor ray tracing model,” Ph.D. Thesis, Detroit, MI, USA, 1993.
67. A novel big data analytics tool for video data analytics
68. Cloud-based infrastructure for mobile testing as a service
69. Business intelligence in the cloud
70. Big data validation case study
71. Sanitizing and minimizing databases for software application test outsourcing
72. Harnessing multiple source test cases in metamorphic testing: A case study in bioinformatics
73. Solving big data challenges for enterprise application performance management
74. Design and implementation of english exam system based on c/s