journal article·2024Open access

A Weighted Multi-Layer Analytics Based Model for Emoji Recommendation

Amira M. Idrees, Abdul Lateef Marzouq Al-Solami

Computers, Materials & Continua· Volume 78· Issue 1

Abstract

The developed system for eye and face detection using Convolutional Neural Networks (CNN) models, followed by eye classification and voice-based assistance, has shown promising potential in enhancing accessibility for individuals with visual impairments. The modular approach implemented in this research allows for a seamless flow of information and assistance between the different components of the system. This research significantly contributes to the field of accessibility technology by integrating computer vision, natural language processing, and voice technologies. By leveraging these advancements, the developed system offers a practical and efficient solution for assisting blind individuals. The modular design ensures flexibility, scalability, and ease of integration with existing assistive technologies. However, it is important to acknowledge that further research and improvements are necessary to enhance the system’s accuracy and usability. Fine-tuning the CNN models and expanding the training dataset can improve eye and face detection as well as eye classification capabilities. Additionally, incorporating realtime responses through sophisticated natural language understanding techniques and expanding the knowledge base of ChatGPT can enhance the system’s ability to provide comprehensive and accurate responses. Overall, this research paves the way for the development of more advanced and robust systems for assisting visually impaired individuals. By leveraging cutting-edge technologies and integrating them into a modular framework, this research contributes to creating a more inclusive and accessible society for individuals with visual impairments. Future work can focus on refining the system, addressing its limitations, and conducting user studies to evaluate its effectiveness and impact in real-world scenarios.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Tactile and Sensory Interactions · EEG and Brain-Computer Interfaces · Gaze Tracking and Assistive Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (26)

Show source-provided references
1. Emoji prediction using LSTM and Naive Bayes
2. Opico: A study of emoji-first communication in a mobile social app
3. Learning Pakistani culture through the namaz emoji
4. Contextual emotion detection in text using Deep Learning and Big Data
5. Mining the relationship between Emoji usage patterns and personality
6. A proposed customer relationship framework based on information retrieval for effective firms’ competitiveness
7. Utilizing data mining techniques for attributes’ intra-relationship detection in a higher collaborative environment
8. News’ credibility detection on social media using machine learning algorithms
9. Extracting cultural commonsense knowledge at scale
10. Product selection based on sentiment analysis of online reviews: An intuitionistic fuzzy TODIM method10.1007/s40747-022-00678-w ↗
11. Extracting and ranking product features in consumer reviews based on evidence theory10.1007/s12652-021-03664-1 ↗
12. Revealing patterns of Twitter emoji usage in Barcelona and Madrid
13. Beyond just text: Semantic Emoji similarity modeling to support expressive communication10.1145/3039685 ↗
14. A semantics-based measure of emoji similarity
15. Are emoji predictable?
16. Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm
17. Interpretable emoji prediction via label-wise attention LSTMs
18. Tübingen-oslo at SemEval-2018 task 2: SVMs perform better than RNNs in emoji prediction
19. Emoji recommendation in private instant messages
20. Tweet emoji prediction using hierarchical model with attention
21. Attention-based BiLSTM models for personality recognition from user-generated content10.1016/j.ins.2022.03.038 ↗
22. Microblog sentiment analysis based on deep memory network with structural attention10.1007/s40747-022-00904-5 ↗
23. E. Wang and D. Qin, “Kaggle Website,” 2023. [Online]. Available: https://www.kaggle.com/datasets/ericwang1011/tweets-with-emoji (accessed on 22/06/2023)
24. M. Thoma, “The WiLI benchmark dataset for written,” arXiv:1801.07779v1, 2018.
25. D. Larionov, “Archive team: The Twitter stream grab,” [Online]. Available: https://archive.org/details/twitterstream (accessed on 22/05/2023)
26. A multi-label emoji classification method using balanced pointwise mutual information-based feature selection10.1016/j.csl.2021.101330 ↗