Intelligent Virtual Assistant for Mobile Workers: Towards Hybrid, Frugal and Contextualized Solutions
Source abstract
Abstract
Field workers require expeditious and pertinent access to information to execute their duties, frequently in arduous environments. Conventional document search interfaces are ill-suited to these contexts, while fully automated approaches often lack the capacity to adapt to the variability of situations. This article explores a hybrid approach based on the use of specialized small language models (SLMs), combining natural language interaction, context awareness (static and dynamic), and structured command generation. The objective of this study is to demonstrate the feasibility of providing contextualized assistance for mobile agents using an intelligent conversational agent, while ensuring that reasonable resource consumption is maintained. The present case study pertains to the supervision of illumination systems on a university campus by technical agents. The static and the dynamic contexts are integrated into the user command to generate a prompt that queries a previously fine-tuned SLM. The methodology employed, the construction of five datasets for the purposes of evaluation, and the refinement of selected SLMs are presented herein. The findings indicate that models of smaller scale demonstrate the capacity to comprehend natural language queries and generate responses that can be effectively utilized by a tangible system. This work opens prospects for intelligent, resource-efficient, and contextualized assistance in industrial or constrained environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: AI in Service Interactions · Advanced Manufacturing and Logistics Optimization · Transportation and Mobility Innovations
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Université Côte d’Azur, CNRS, I3S, France/Les Algorithmes—bât. Euclide B, 2000 Route des Lucioles, 06900 Sophia Antipolis, France
References (33)
Show source-provided references
1. Context in problem solving: A survey10.1017/S0269888999141018 ↗
2. Zhou, H., Huang, M., and Zhu, X. (2016, January 11–16). Context-aware natural language generation for spoken dialogue systems. Proceedings of the COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan.
3. Comparison of Rule-based Chat Bots with Different Machine Learning Models10.1016/j.procs.2025.04.030 ↗
4. A contemporary review on chatbots, AI-powered virtual conversational agents, ChatGPT: Applications, open challenges and future research directions10.1016/j.cosrev.2024.100632 ↗
5. Smajić, A., and Mušić, D. (2025, January 17–19). Application of Natural Language Processing Algorithms for Chatbots. Proceedings of the 2025 IEEE 17th International Conference on Computer Research and Development (ICCRD), Shangrao, China.10.1109/ICCRD64588.2025.10963028 ↗
6. “Alexa, Can I Trust You?”10.1109/MC.2017.3571053 ↗
7. Ray, P.P. (2025). A Review on LLMs for IoT Ecosystem: State-of-the-art, Lightweight Models, Use Cases, Key Challenges, Future Directions. TechRxiv.10.36227/techrxiv.174844330.01320055/v1 ↗
8. Shen, Z. (2024). LLM with Tools: A Survey. arXiv.
9. Qu, C., Dai, S., Wei, X., Cai, H., Wang, S., Yin, D., Xu, J., and Wen, J.-r. (2025). Tool learning with large language models: A survey. Front. Comput. Sci., 19.10.1007/s11704-024-40678-2 ↗
10. Toolformer: Language models can teach themselves to use tools
11. Kong, Y., Ruan, J., Chen, Y., Zhang, B., Bao, T., Shiwei, S., Qing, D., Hu, X., Mao, H., and Li, Z. (2024, January 12–16). TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Industry Systems. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track, Miami, FL, USA.10.18653/v1/2024.emnlp-industry.27 ↗
12. Gorilla: Large language model connected with massive apis
13. Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K., and Cao, Y. (2023, January 1–5). React: Synergizing reasoning and acting in language models. Proceedings of the International Conference on Learning Representations (ICLR), Kigali, Rwanda.
14. Sahoo, P., Singh, A.K., Saha, S., Jain, V., Mondal, S., and Chadha, A. (2025). A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applications. arXiv.10.1007/979-8-8688-0569-1_4 ↗
15. Chain-of-thought prompting elicits reasoning in large language models
16. Tree of thoughts: Deliberate problem solving with large language models
17. Li, W., Wang, X., Li, W., and Jin, B. (2025). A Survey of Automatic Prompt Engineering: An Optimization Perspective. arXiv.
18. Li, Z., Liu, Y., Su, Y., and Collier, N. (2024). Prompt Compression for Large Language Models: A Survey. arXiv.
19. Zhang, Z., Li, J., Lan, Y., Wang, X., and Wang, H. (2025). An Empirical Study on Prompt Compression for Large Language Models. arXiv.
20. Frantar, E., Ashkboos, S., Hoefler, T., and Alistarh, D. (2023). GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers. arXiv.
21. AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration10.1145/3714983.3714987 ↗
22. Qlora: Efficient finetuning of quantized llms
23. Alizadeh, K., Mirzadeh, S.I., Belenko, D., Khatamifard, S., Cho, M., Del Mundo, C.C., Rastegari, M., and Farajtabar, M. (2024, January 11–16). Llm in a flash: Efficient large language model inference with limited memory. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Bangkok, Thailand.10.18653/v1/2024.acl-long.678 ↗
24. SpecExec: Massively Parallel Speculative Decoding For Interactive LLM Inference on Consumer Devices
25. Xu, D., Zhang, H., Yang, L., Liu, R., Huang, G., Xu, M., and Liu, X. (April, January 30). Fast On-device LLM Inference with NPUs. Proceedings of the 30th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Rotterdam, The Netherlands.
26. A Review on Edge Large Language Models: Design, Execution, and Applications10.1145/3729216 ↗
27. Nwankwo, L., and Rueckert, E. (2024, January 11–15). The conversation is the command: Interacting with real-world autonomous robots through natural language. Proceedings of the Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, Boulder, CO, USA.10.1145/3610978.3640723 ↗
28. The Internet of Things in the Era of Generative AI: Vision and Challenges10.1109/MIC.2024.3443169 ↗
29. Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. (2021). LoRA: Low-Rank Adaptation of Large Language Models. arXiv.
30. Language models are few-shot learners
31. Van Rijsbergen, C.J. (1979). Information Retrieval, Butterworths.
32. Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2019). Bertscore: Evaluating text generation with bert. arXiv.
33. Deutsch, D., Dror, R., and Roth, D. (2022). On the limitations of reference-free evaluations of generated text. arXiv.10.18653/v1/2022.emnlp-main.753 ↗