Unsupervised Detection of Changes in Usage-Phases of a Mobile App
Source abstract
Abstract
Under the fierce competition and budget constraints, most mobile apps are launched without sufficient tests. Thus, there exists a great demand for automated app testing. Recent developments in various machine learning techniques have made automated app testing a promising alternative to manual testing. This work proposes novel approaches for one of the core functionalities of automated app testing: the detection of changes in usage-phases of a mobile app. Because of the flexibility of app development languages and the lack of standards, each mobile app is very different from other apps. Furthermore, the graphical user interfaces for similar functionalities are rarely consistent or similar. Thus, we propose methods detecting usage-phase changes through object recognition and metrics utilizing graphs and generative models. Contrary to the existing change detection methods requiring learning models, the proposed methods eliminate the burden of training models. This elimination of training is suitable for mobile app testing whose typical usage-phase is composed of less than 10 screenshots. Our experimental results on commercial mobile apps show promising improvement over the state-of-the-practice method based on SIFT (scale-invariant feature transform).
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Malware Detection Techniques · Anomaly Detection Techniques and Applications · Data Stream Mining Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Engineering, Kangwon National University, Chuncheon-si, Gangwon-do 24341, Korea
Apptest.ai, Songpa-gu, Seoul 05854, Korea
Funding
National Research Foundation of Korea
References (37)
Show source-provided references
1. Mao, K., Harman, M., and Jia, Y. (2016, January 18–20). Sapienz: Multi-objec tive automated testing for android applications. Proceedings of the 25th International Symposium on Software Testing and Analysis, Saarbrücken, Germany.10.1145/2931037.2931054 ↗
2. Google (2020, May 25). Android Monkey. Available online: https://developer.android.com/studio/test/monkey.
3. Wetzlmaier, T., Ramler, R., and Putschögl, W. (2016, January 11–15). A framework for monkey GUI testing. Proceedings of the 9th IEEE International Conference on Software Testing, Verification and Validation, Chicago, IL, USA.10.1109/ICST.2016.51 ↗
4. Using monkey test tools
5. White, T.D., Fraser, G., and Brown, G.J. (2019, January 15–19). Improving random GUI testing with image-based widget detection. Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis, Beijing, China.10.1145/3293882.3330551 ↗
6. Degott, C., Borges, N.P., and Zeller, A. (2019, January 15–19). Learning user interface element interactions. Proceedings of the ACM SIGSOFT International Symposium on Software Testing and Analysis, Beijing, China.10.1145/3293882.3330569 ↗
7. Saumya, C., Koo, J., Kulkarni, M., and Bagchi, S. (2019, January 22–27). XSTRESSOR: Automatic generation of large-scale worst-case test inputs by inferring path conditions. Proceedings of the 12th IEEE International Conference on Software Testing, Verification and Validation, Xi’an, China.10.1109/ICST.2019.00011 ↗
8. Moran, K., Linares-Vásquez, M., Bernal-Cárdenas, C., Vendome, C., and Poshyvanyk, D. (2016, January 10–15). Automatically discovering, reporting and reproducing android application crashes. Proceedings of the IEEE International Conference on Software Testing, Verification and Validation, Chicago, IL, USA.10.1109/ICST.2016.34 ↗
9. An overview on concept drift learning10.1109/ACCESS.2018.2886026 ↗
10. Learning under concept drift: A review
11. Coding for computing10.1109/18.915643 ↗
12. Graph kernels
13. Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer.
14. A survey of appearance models in visual object tracking
15. Unsupervised SAR image change detection based on SIFT keypoints and region information10.1109/LGRS.2016.2554606 ↗
16. Graph-based anomaly detection and description: A survey10.1007/s10618-014-0365-y ↗
17. A survey on data processing for data stream mining: Current status and future directions10.1016/j.neucom.2017.01.078 ↗
18. Learning with drift detection
19. Trends in extreme learning machines: A review10.1016/j.neunet.2014.10.001 ↗
20. Dynamic extreme learning machine for data stream classification10.1016/j.neucom.2016.12.078 ↗
21. Dasu, T., Krishnan, S., Venkatasubramanian, S., and Yi, K. (2006, January 24–27). An information-theoretic approach to detecting changes in multi-dimensional data streams. Proceedings of the 38th Symposium on the Interface of Statistics, Computing Science, and Applications, Pasadena, CA, USA.
22. Constrained least-squares density-difference estimation10.1587/transinf.E97.D.1822 ↗
23. A PDF-free change detection test based on density difference estimation10.1109/TNNLS.2016.2619909 ↗
24. Two nonparametric control charts for detecting arbitrary distribution changes10.1080/00224065.2012.11917887 ↗
25. Alippi, C., Boracchi, G., Carrera, D., and Roveri, M. (2016, January 9–15). Change detection in multivariate datastreams: Likelihood and detectability loss. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, NY, USA.
26. Anomaly detection in dynamic networks: A survey10.1002/wics.1347 ↗
27. Grattarola, D., Zambon, D., Alippi, C., and Livi, L. (2019). Change detection in graph streams by learning graph embeddings on constant-curvature manifolds. arXiv.10.1109/TNNLS.2019.2927301 ↗
28. Concept drift and anomaly detection in graph streams10.1109/TNNLS.2018.2804443 ↗
29. Wackerly, D.D., Mendenhall, W., and Scheaffer, R.L. (2008). Likelihood ratio tests. Mathematical Statistics with Applications, Thomson Brooks/Cole.
30. Alippi, C., and Roveri, M. (2006, January 21–24). An adaptive CUSUM-based test for signal change detection. Proceedings of the International Symposium on Circuits and Systems, Island of Kos, Greece.
31. Faster R-CNN: towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
32. Lowe, D.G. (1999, January 20–27). Object recognition from local scale-invariant features. Proceedings of the International Conference on Computer Vision, Kerkyra, Greece.10.1109/ICCV.1999.790410 ↗
33. Park, M.-H., Park, R.-H., and Lee, S.W. Shot boundary detection using scale invariant feature matching. Proceedings of SPIE Visual Communications and Image Processing.
34. Guan, B., and Ye, H. (2019). Target image video search based on local features. arXiv.10.1109/ICIP40778.2020.9191208 ↗
35. Korhonen, A., and Krymolowski, Y. (September, January 31). On the robustness of entropy-based similarity measures in evaluation of subcategorization acquisition systems. Proceedings of the 6th Conference on Natural Language Learning (CoNLL-2002), Taipei, Taiwan.10.3115/1118853.1118867 ↗
36. A survey on graph kernels10.1007/s41109-019-0195-3 ↗
37. Halting in Random Walk Kernels