A Machine Learning Approach to User Profiling for Data Annotation of Online Behavior
Source abstract
Abstract
The user’s intent to seek online information has been an active area of research in user profiling. User profiling considers user characteristics, behaviors, activities, and preferences to sketch user intentions, interests, and motivations. Determining user characteristics can help capture implicit and explicit preferences and intentions for effective user-centric and customized content presentation. The user’s complete online experience in seeking information is a blend of activities such as searching, verifying, and sharing it on social platforms. However, a combination of multiple behaviors in profiling users has yet to be considered. This research takes a novel approach and explores user intent types based on multidimensional online behavior in information acquisition. This research explores information search, verification, and dissemination behavior and identifies diverse types of users based on their online engagement using machine learning. The research proposes a generic user profile template that explains the user characteristics based on the internet experience and uses it as ground truth for data annotation. User feedback is based on online behavior and practices collected by using a survey method. The participants include both males and females from different occupation sectors and different ages. The data collected is subject to feature engineering, and the significant features are presented to unsupervised machine learning methods to identify user intent classes or profiles and their characteristics. Different techniques are evaluated, and the K-Mean clustering method successfully generates five user groups observing different user characteristics with an average silhouette of 0.36 and a distortion score of 1136. Feature average is computed to identify user intent type characteristics. The user intent classes are then further generalized to create a user intent template with an Inter-Rater Reliability of 75%. This research successfully extracts different user types based on their preferences in online content, platforms, criteria, and frequency. The study also validates the proposed template on user feedback data through Inter-Rater Agreement process using an external human rater.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Digital Marketing and Social Media · Technology Adoption and User Behaviour · Consumer Market Behavior and Pricing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. User intent in multimedia search: A survey of the state of the art and future challenges10.1145/2954930 ↗
2. Determinants of users’ information dissemination behavior on social networking sites: An elaboration likelihood model perspective10.1108/IntR-01-2017-0038 ↗
3. Multimodal analysis of user behavior and browsed content under different image search intents10.1007/s13735-018-0150-6 ↗
4. What social media told us in the time of COVID-19: A scoping review10.1016/S2589-7500(20)30315-0 ↗
5. The role of social media content format and platform in users’ engagement behavior
6. Sentiment analysis with tweets behaviour in Twitter streaming API10.32604/csse.2023.030842 ↗
7. A framework for personalizing a typical web search sessions with concept-based user profiles using selective machine learning techniques10.1007/978-3-031-01333-1 ↗
8. The influence of image search intents on user behavior and satisfaction
9. Information propagation in online social networks–A simulation case study
10. How types of facebook users approach news verification in the mobile media age: Insights from the dual-information-processing model10.1080/15205436.2020.1839104 ↗
11. When do audiences verify? How perceptions about message and source influence audience verification of news headlines
12. Factors influencing fake news rebuttal acceptance during the COVID-19 pandemic and the moderating effect of cognitive ability10.1016/j.chb.2021.107174 ↗
13. Understanding differentiated internet use in older adults: A study of informational, social, and instrumental online activities10.1016/j.chb.2019.03.031 ↗
14. Gender-specific information search behavior
15. Identifying gender of internet users based on access history
16. Personality traits and Internet usage across generation cohorts: Insights from a nationally representative study10.1007/s12144-018-0033-2 ↗
17. User OCEAN personality model construction method using a BP neural network10.3390/electronics11193022 ↗
18. Investigating Taiwan Instagram users’ behaviors for social media and social commerce development10.1016/j.entcom.2021.100461 ↗
19. Identifying user behavior in online social networks
20. Examining gender differences in people’s information-sharing decisions on social networking sites
21. Factors influencing user participation in social media: Evidence from twitter usage during COVID-19 pandemic in Saudi Arabia10.1016/j.techsoc.2021.101651 ↗
22. The relationship between user perception and user behaviour in interactive information retrieval evaluation.10.1007/978-3-319-30671-1_22 ↗
23. Deep contextualized word embedding for text-based online user profiling to detect social bots on Twitter
24. H. Kyungsik, “How do you perceive this author? Understanding and modeling authors’ communication quality in social media,” PLoS One, vol. 13, no. 2, pp. e0192061, 2018. doi: 10.1371/journal.pone.0192061; 2938997910.1371/journal.pone.0192061 ↗
25. The impact of trust in the news media on online news consumption and participation
26. Comparative study of social media, TV and newspapers news credibility
27. Professional versus social media: News credibility and impact
28. Review of data preprocessing techniques in data mining
29. Agresti · Categorial data analysis · 2013
30. C. Seger, “An investigation of categorical variable encoding techniques in machine learning: Binary versus one-hot and feature hashing,” Accessed: Oct. 26, 2018. https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-237426
31. Encoding high-cardinality string10.1109/TKDE.2020.2992529 ↗
32. Benchmark for filter methods for feature selection in high-dimensional classification data10.1016/j.csda.2019.106839 ↗
33. Stability of feature selection algorithm: A review
34. The chi-square test of independence10.11613/BM.2013.018 ↗
35. Wright · Biom · 1992 · 48 · 100510.2307/2532694 ↗
36. Bonferroni adjustments in tests for regression coefficients
37. A survey of user profiling: State-of-the-art, challenges, and solutions10.1109/ACCESS.2019.2944243 ↗
38. A systematic review on supervised and unsupervised machine learning algorithms for data science10.1007/978-3-030-22475-2_1 ↗
39. A temporal context-aware model for user behavior modeling in social media systems
40. A framework for computing the privacy scores of users in online social networks10.1145/1870096.1870102 ↗
41. Feature wise normalization: An effective way of normalizing data10.1016/j.patcog.2021.108307 ↗
42. A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects10.1016/j.engappai.2022.104743 ↗
43. Data clustering: Application and trends10.1007/s10462-022-10325-y ↗
44. J. O. Palacio-Niño and F. Berzal, “Evaluation metrics for unsupervised learning algorithms,” arXiv preprint arXiv:1905.05667, 2019.
45. Personality predictions based on user behavior on the Facebook social media platform10.1109/ACCESS.2018.2876502 ↗
46. Personality classification based on profiles of social networks’ users and the five-factor model of personality10.1186/s13673-018-0147-4 ↗
47. Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice