Analysis of Machine Learning Techniques for Information Classification in Mobile Applications
Source abstract
Abstract
Due to the daily use of mobile technologies, we live in constant connection with the world through the Internet. Technological innovations in smart devices have allowed us to carry out everyday activities such as communicating, working, studying or using them as a means of entertainment, which has led to smartphones displacing computers as the most important device connected to the Internet today, causing users to demand smarter applications or functionalities that allow them to meet their needs. Artificial intelligence has been a major innovation in information technology that is transforming the way users use smart devices. Using applications that make use of artificial intelligence has revolutionised our lives, from making predictions of possible words based on typing in a text box, to being able to unlock devices through pattern recognition. However, these technologies face problems such as overheating and battery drain due to high resource consumption, low computational capacity, memory limitations, etc. This paper reviews the most important artificial intelligence algorithms for mobile devices, emphasising the challenges and problems that can arise when implementing these technologies in low-resource devices.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: IoT and Edge/Fog Computing · Currency Recognition and Detection · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Group of Analysis, Security and Systems (GASS), Department of Software Engineering and Artificial Intelligence (DISIA), Faculty of Computer Science and Engineering, Office 431, Universidad Complutense de Madrid (UCM), Calle Profesor José García Santesmases, 9, Ciudad Universitaria, 28040 Madrid, Spain
Funding
European Commission under the Horizon 2020 research and innovation programme
References (87)
Show source-provided references
1. Impact of smartphone’s on society
2. Statista (2023, April 10). Share of Users Worldwide Accessing the Internet in 3rd Quarter 2022, by Device. Available online: https://www.statista.com/statistics/1289755/internet-access-by-device-worldwide/.
3. (2023, January 15). Why On-Device Machine Learning?. Available online: https://developers.google.com/learn/topics/on-device-ml/learn-more.
4. (2023, January 15). Addressing the Challenges of On-Device Machine Learning. Available online: https://blog.developer.adobe.com/addressing-the-challenges-of-on-device-machine-learning-1f71ebcedd69.
5. Addepto (2023, January 15). What Are the Top 10 Challenges of Machine Learning?. Available online: https://addepto.com/blog/what-are-the-top-10-challenges-of-machine-learning/.
6. Linkedin (2023, January 15). The Benefits and Challenges of Edge Machine Learning. Available online: https://www.linkedin.com/pulse/benefits-challenges-edge-machine-learning-wallaroolabs.
7. Ribeiro, M., Grolinger, K., and Capretz, M.A. (2015). MLaaS: Machine Learning as a Service, IEEE.10.1109/ICMLA.2015.152 ↗
8. (2023, January 06). Google Cloud, AI and Machine LEARNING Products. Available online: https://cloud.google.com/products/ai.
9. (2023, January 06). IBM Watson Machine Learning. Available online: https://www.ibm.com/cloud/watson-studio.
10. (2023, January 06). Welcome to Machine Learning Studio. Available online: https://studio.azureml.net/.
11. (2023, January 06). Oracle Machine Learning. Available online: https://docs.oracle.com/en/database/oracle/machine-learning/oml4py/1/mlpug/machine-learning-classes-and-algorithms.html.
12. (2023, January 06). Machine Learning on AWS. Available online: https://aws.amazon.com/machine-learning.
13. JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services10.1109/TMC.2019.2947893 ↗
14. Wang, X., Xu, Y., Xu, K., Tagliasacchi, A., Zhou, B., Mahdavi-Amiri, A., and Zhang, H. (2020, January 6–12). PIE-NET: Parametric Inference of Point Cloud Edges. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Online.
15. Long, Y., Chakraborty, I., Srinivasan, G., and Roy, K. (2021, January 7–10). Complexity-Aware Adaptive Training and Inference for Edge-Cloud Distributed AI Systems. Proceedings of the 2021 IEEE 41st International Conference on Distributed Computing Systems (ICDCS), Washington, DC, USA.10.1109/ICDCS51616.2021.00061 ↗
16. Laskaridis, S., Venieris, S.I., Almeida, M., Leontiadis, I., and Lane, N.D. (2020, January 21–25). SPINN: Synergistic Progressive Inferenceof Neural Networks over Device and Cloud. Proceedings of the 26th Annual International Conference on Mobile Computing and Networking, MOBICOM ’20, London, UK.10.1145/3372224.3419194 ↗
17. DataMix: Efficient Privacy-Preserving Edge-Cloud Inference10.1007/978-3-030-58621-8_34 ↗
18. Ogden, S.S., Kong, X., and Guo, T. (2021, January 19–23). PieSlicer: Dynamically Improving Response Time for Cloud-based CNN Inference. Proceedings of the ACM/SPEC International Conference on Performance Engineering, Virtual Event.10.1145/3427921.3450256 ↗
19. Li, Y., Han, Z., Zhang, Q., Li, Z., and Tan, H. (2020, January 6–9). Automating Cloud Deployment for Deep Learning Inference of Real-time Online Services. Proceedings of the IEEE INFOCOM 2020—IEEE Conference on Computer Communications, Toronto, ON, Canada.10.1109/INFOCOM41043.2020.9155267 ↗
20. Reda, M., Suwwan, R., Alkafri, S., Rashed, Y., and Shanableh, T. (2022). AgroAId: A Mobile App System for Visual Classification of Plant Species and Diseases Using Deep Learning and TensorFlow Lite. Informatics, 9.10.3390/informatics9030055 ↗
21. Mondal, S., Modi, S., Garg, S., Das, D., and Mukherjee, S. (2020). ICAN: Introspective Convolutional Attention Network for Semantic Text Classification, Institute of Electrical and Electronics Engineers Inc.10.1109/ICSC.2020.00031 ↗
22. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
23. Vatsal, S., Purre, N., Moharana, S., Ramena, G., and Mohanty, D. (2020, January 3–5). On-Device Information Extraction from Sms Using Hybrid Hierarchical Classification. Proceedings of the 2020 IEEE 14th International Conference on Semantic Computing (ICSC), San Diego, CA, USA.10.1109/ICSC.2020.00036 ↗
24. Garg, S., Harichandana, S.S., and Kumar, S. (2021, January 2–4). On-Device Document Classification using Multimodal Features. Proceedings of the 3rd ACM India Joint International Conference on Data Science & Management of Data (8th ACM IKDD CODS & 26th COMAD), Bangalore, India.10.1145/3430984.3431030 ↗
25. Buiu, C., Dănăilă, V.R., and Răduţă, C.N. (2020). MobileNetV2 ensemble for cervical precancerous lesions classification. Processes, 8.10.3390/pr8050595 ↗
26. Ignatov, A., Malivenko, G., Timofte, R., Tseng, Y., Xu, Y.S., Yu, P.H., Chiang, C.M., Kuo, H.K., Chen, M.H., and Cheng, C.M. (2022, January 21–25). PyNet-V2 Mobile: Efficient On-Device Photo Processing With Neural Networks. Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR), Montreal, QC, Canada.10.1109/ICPR56361.2022.9956598 ↗
27. FedSpam: Privacy Preserving SMS Spam Prediction
28. A new hybrid machine learning model for predicting the bitcoin (BTC-USD) price10.1016/j.jbef.2022.100741 ↗
29. Android skin cancer detection and classification based on MobileNet v2 model10.26555/ijain.v6i2.492 ↗
30. GitHub (2023, January 08). MobileNet. Available online: https://github.com/tensorflow/tfjs-models/tree/master/mobilenet.
31. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
32. Koonce, B. (2021). Convolutional Neural Networks with Swift for Tensorflow, Apress.10.1007/978-1-4842-6168-2 ↗
33. Huang, J., Mei, L., Long, M., Liu, Y., Sun, W., Li, X., Shen, H., Zhou, F., Ruan, X., and Wang, D. (2022). Bm-net: Cnn-based mobilenet-v3 and bilinear structure for breast cancer detection in whole slide images. Bioengineering, 9.10.3390/bioengineering9060261 ↗
34. Michele, A., Colin, V., and Santika, D.D. (2021). Procedia Computer Science, Proceedings of the 4th International Conference on Computer Science and Computational Intelligence (ICCSCI 2019): Enabling Collaboration to Escalate Impact of Research Results for Society, Yogyakarta, Indonesia, 12–13 September 2019, Elsevier.
35. Bi, C., Wang, J., Duan, Y., Fu, B., Kang, J.R., and Shi, Y. (2020). MobileNet based apple leaf diseases identification. Mob. Netw. Appl., 1–9.10.1007/s11036-020-01640-1 ↗
36. Rajbongshi, A., Sarker, T., Ahamad, M.M., and Rahman, M.M. (2020, January 22–24). Rose Diseases Recognition using MobileNet. Proceedings of the 2020 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Istanbul, Turkey.10.1109/ISMSIT50672.2020.9254420 ↗
37. Classification of tomato leaf diseases using MobileNet v2
38. Sae-Lim, W., Wettayaprasit, W., and Aiyarak, P. (2019, January 10–12). Convolutional Neural Networks Using MobileNet for Skin Lesion Classification. Proceedings of the 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE), Chonburi, Thailand.10.1109/JCSSE.2019.8864155 ↗
39. Venkateswarlu, I.B., Kakarla, J., and Prakash, S. (2020, January 3–5). Face mask detection using MobileNet and Global Pooling Block. Proceedings of the 2020 IEEE 4th Conference on Information & Communication Technology (CICT), Chennai, India.10.1109/CICT51604.2020.9312083 ↗
40. A Smartphone-Based Skin Disease Classification Using MobileNet CNN10.30534/ijatcse/2019/116852019 ↗
41. Souid, A., Sakli, N., and Sakli, H. (2021). Classification and Predictions of Lung Diseases from Chest X-rays Using MobileNet V2. Appl. Sci., 11.10.3390/app11062751 ↗
42. Hartanto, C.A., and Wibowo, A. (2020, January 24–25). Development of Mobile Skin Cancer Detection using Faster R-CNN and MobileNet v2 Model. Proceedings of the 2020 7th International Conference on Information Technology, Computer, and Electrical Engineering (ICITACEE), Kota Semarang, Indonesia.10.1109/ICITACEE50144.2020.9239197 ↗
43. A New Image Recognition and Classification Method Combining Transfer Learning Algorithm and MobileNet Model for Welding Defects10.1109/ACCESS.2020.3005450 ↗
44. Recognition of local birds of Bangladesh using MobileNet and Inception-v3
45. Detection and Localization of Multiple Image Splicing Using MobileNet V110.1109/ACCESS.2021.3130342 ↗
46. Estudio comparativo de arquitecturas de CNNs en hojas de Pimiento Morrón infectadas con virus PHYVV o PEPGMV10.13053/rcs-148-7-22 ↗
47. (2023, January 10). EfficientNet: Improving Accuracy and Efficiency through AutoML and Model Scaling. Available online: https://ai.googleblog.com/2019/05/efficientnet-improving-accuracy-and.html.
48. (2023, January 06). EfficientNet Keras (and TensorFlow Keras). Available online: https://pypi.org/project/efficientnet/.
49. Plant leaf disease classification using EfficientNet deep learning model10.1016/j.ecoinf.2020.101182 ↗
50. Yi, S.L., Yang, X.L., Wang, T.W., She, F.R., Xiong, X., and He, J.F. (2021). Diabetic Retinopathy Diagnosis Based on RA-EfficientNet. Appl. Sci., 11.10.3390/app112211035 ↗
51. Deep Learning-based Mobile Tourism Recommender System
52. GitHub (2023, January 10). EfficientNet-Lite. Available online: https://github.com/tensorflow/tpu/blob/master/models/official/efficientnet/lite/.
53. Blog, T. (2023, January 15). Higher Accuracy on Vision Models with EfficientNet-Lite. Available online: https://blog.tensorflow.org/2020/03/higher-accuracy-on-vision-models-with-efficientnet-lite.html.
54. Tan, M., and Le, Q. (2021, January 18–24). Efficientnetv2: Smaller models and faster training. Proceedings of the 38th International Conference on Machine Learning, ICML, Online.
55. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
56. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, Nevada, USA.10.1109/CVPR.2016.90 ↗
57. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
58. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
59. Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18–23). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00907 ↗
60. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
61. Thompson, C.W., and Ross, K.M. (1987). Natural-Language Interface Generating System. (4,688,195), U.S. Patent.
62. Understanding mobile handheld device use and adoption10.1145/953460.953484 ↗
63. Jiao, X., Yin, Y., Shang, L., Jiang, X., Chen, X., Li, L., Wang, F., and Liu, Q. (2019). Tinybert: Distilling bert for natural language understanding. arXiv.10.18653/v1/2020.findings-emnlp.372 ↗
64. Sun, Z., Yu, H., Song, X., Liu, R., Yang, Y., and Zhou, D. (2020). Mobilebert: A compact task-agnostic bert for resource-limited devices. arXiv.10.18653/v1/2020.acl-main.195 ↗
65. Sanh, V., Debut, L., Chaumond, J., and Wolf, T. (2019). DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. arXiv.
66. Saha, U., Mahmud, M.S., Keya, M., Lucky, E.A.E., Khushbu, S.A., Noori, S.R.H., and Syed, M.M. (2022, January 20–21). Exploring Public Attitude Towards Children by Leveraging Emoji to Track Out Sentiment Using Distil-BERT a Fine-Tuned Model. Proceedings of the Third International Conference on Image Processing and Capsule Networks, Online, Bangkok, Thailand.10.1007/978-3-031-12413-6_26 ↗
67. Palliser-Sans, R., and Rial-Farràs, A. (2021). HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans Detection. arXiv.10.18653/v1/2021.semeval-1.131 ↗
68. Chaudhary, Y., Gupta, P., Saxena, K., Kulkarni, V., Runkler, T.A., and Schütze, H. (2020). TopicBERT for Energy Efficient Document Classification. arXiv.10.18653/v1/2020.findings-emnlp.152 ↗
69. (2023, January 06). For Mobile & Edge. Available online: https://www.tensorflow.org/lite/performance/model_optimization.
70. Rashidi, M. (2023, January 06). Application of TensorFlow Lite on Embedded Devices: A Hands-On Practice of TensorFlow Model Conversion to TensorFlow Lite Model and Its Deployment on Smartphone to Compare Model’s Performance. Available online: https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1698946&dswid=-2072.
71. Brahmbhatt, S. (2013). Practical OpenCV, Apress.10.1007/978-1-4302-6080-6 ↗
72. (2023, January 06). Google ML Kit. Available online: https://developers.google.com/ml-kit.
73. (2023, January 06). Machine Learning. Available online: https://developer.apple.com/machine-learning/.
74. Google (2023, January 06). Google Cloud AI. Available online: https://developer.apple.com/machine-learning/.
75. CAFFE2 (2023, January 06). Caffe2: Anew Lightweight, Modular, and Scalable Deep Learning Framework. Available online: https://caffe2.ai/docs/caffe-migration.html.
76. Cloud, G. (2023, January 06). DialogFlow. Available online: https://cloud.google.com/dialogflow.
77. Del Sole, A. (2018). Microsoft Computer Vision APIs Distilled: Getting Started with Cognitive Services, Apress.10.1007/978-1-4842-3342-9 ↗
78. Google (2023, January 06). Firebase ML Kit. Available online: https://firebase.google.com/docs/ml-kit.
79. Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O’Reilly. [1st ed.].
80. Martínez-Villaseñor, L., Batyrshin, I., and Marín-Hernández, A. (2019). Methodology for the Implementation of Virtual Assistants for Education Using Google Dialogflow, Springer International Publishing.
81. Masood, A., and Hashmi, A. (2019). Cognitive Computing Recipes: Artificial Intelligence Solutions Using Microsoft Cognitive Services and TensorFlow, Apress.10.1007/978-1-4842-4106-6 ↗
82. PyTorch (2023, January 06). PyTorch Mobile. Available online: https://pytorch.org/mobile/home/.
83. Federated learning review: Fundamentals, enabling technologies, and future applications10.1016/j.ipm.2022.103061 ↗
84. IBM (2023, January 15). What Is Federated Learning?. Available online: https://research.ibm.com/blog/what-is-federated-learning.
85. Research, G. (2023, January 15). Federated Learning: Collaborative Machine Learning without Centralized Training Data. Available online: https://ai.googleblog.com/2017/04/federated-learning-collaborative.html.
86. Team, D.S. (2023, January 15). Aprendizaje Federado. Available online: https://datascience.eu/es/aprendizaje-automatico/aprendizaje-federado/.
87. From federated learning to federated neural architecture search: A survey10.1007/s40747-020-00247-z ↗