Personality Trait Detection via Transfer Learning
Source abstract
Abstract
Personality recognition plays a pivotal role when developing user-centric solutions such as recommender systems or decision support systems across various domains, including education, e-commerce, or human resources. Traditional machine learning techniques have been broadly employed for personality trait identification; nevertheless, the development of new technologies based on deep learning has led to new opportunities to improve their performance. This study focuses on the capabilities of pre-trained language models such as BERT, RoBERTa, ALBERT, ELECTRA, ERNIE, or XLNet, to deal with the task of personality recognition. These models are able to capture structural features from textual content and comprehend a multitude of language facets and complex features such as hierarchical relationships or long-term dependencies. This makes them suitable to classify multi-label personality traits from reviews while mitigating computational costs. The focus of this approach centers on developing an architecture based on different layers able to capture the semantic context and structural features from texts. Moreover, it is able to fine-tune the previous models using the MyPersonality dataset, which comprises 9,917 status updates contributed by 250 Facebook users. These status updates are categorized according to the well-known Big Five personality model, setting the stage for a comprehensive exploration of personality traits. To test the proposal, a set of experiments have been performed using different metrics such as the exact match ratio, hamming loss, zero-one-loss, precision, recall, F1-score, and weighted averages. The results reveal ERNIE is the top-performing model, achieving an exact match ratio of 72.32%, an accuracy rate of 87.17%, and 84.41% of F1-score. The findings demonstrate that the tested models substantially outperform other state-of-the-art studies, enhancing the accuracy by at least 3% and confirming them as powerful tools for personality recognition. These findings represent substantial advancements in personality recognition, making them appropriate for the development of user-centric applications.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Personality Traits and Psychology · Authorship Attribution and Profiling · Cybercrime and Law Enforcement Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (77)
Show source-provided references
1. An alternative “Description of personality”: The big-five factor structure10.1037/0022-3514.59.6.1216 ↗
2. The big five versus the big four: The relationship between the myers-briggs type indicator (MBTI) and NEO-PI five factor model of personality10.1016/0191-8869(96)00033-5 ↗
3. The power of personalization: A systematic review of personality-adaptive chatbots10.1007/s42979-023-02092-6 ↗
4. Recent trends in deep learning based personality detection10.1007/s10462-019-09770-z ↗
5. A survey on personality-aware recommendation systems
6. Personality traits, risk perception, and protective behaviors of Arab residents of Qatar during the COVID-19 pandemic10.1007/s11469-020-00352-7 ↗
7. Personality recognition on social media with label distribution learning10.1109/ACCESS.2017.2719018 ↗
8. Predicting self-reported proactive personality classification with weibo text and short answer text10.1109/ACCESS.2021.3078052 ↗
9. Personality prediction system from facebook users
10. Deep learning based fusion strategies for personality prediction10.1016/j.eij.2021.05.004 ↗
11. Personality predictions based on user behavior on the facebook social media platform10.1109/ACCESS.2018.2876502 ↗
12. Sentipede: A smart system for sentiment-based personality detection from short texts
13. Yang · Transfer Learning · 202010.1017/9781139061773 ↗
14. A data-centric review of deep transfer learning with applications to text data10.1016/j.ins.2021.11.061 ↗
15. A survey of transfer learning10.1186/s40537-016-0043-6 ↗
16. Transfer learning for activity recognition: A survey10.1007/s10115-013-0665-3 ↗
17. A general framework for scalable transductive transfer learning10.1007/s10115-013-0647-5 ↗
18. A survey on heterogeneous transfer learning10.1186/s40537-017-0089-0 ↗
19. Cross-lingual adaptation using structural correspondence learning10.1145/2036264.2036277 ↗
20. A survey on multi-task learning10.1109/TKDE.2021.3070203 ↗
21. Pre-trained models: Past, present and future10.1016/j.aiopen.2021.08.002 ↗
22. BERT: A sentiment analysis odyssey10.1057/s41270-021-00109-8 ↗
23. Developing a BERT based triple classification model using knowledge graph embedding for question answering system10.1007/s10489-021-02460-w ↗
24. Y. Liu and M. Lapata, “Text summarization with pretrained encoders,” arXiv Preprint. arXiv:1908.08345, 2019.10.18653/v1/D19-1387 ↗
25. DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter
26. ALBERT: A Lite BERT for self-supervised learning of language representations
27. Y. Liu et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv preprint arXiv:1907.11692, 2019.
28. Self-training improves pre-training for few-shot learning in task-oriented dialog systems
29. Masked autoencoders are scalable vision learners
30. DropMAE: Masked autoencoders with spatial-attention dropout for tracking tasks
31. Contrastive audio-visual masked autoencoder
32. G. Li, H. Zheng, D. Liu, C. Wang, B. Su, and C. Zheng, “Semmae: Semantic-guided masking for learning masked autoencoders, 36th Conference on Neural Information Processing Systems (NeurIPS 2022), vol. 35, pp. 14290–14302.
33. Fanni · Introduction to Artificial Intelligence · 2023 · 8710.1007/978-3-031-25928-9_5 ↗
34. A review on optimization techniques for medical image analysis10.1002/cpe.7443 ↗
35. Deep learning based modeling of groundwater storage change
36. CDLSTM: A novel model for climate change forecasting
37. Analysis of environmental factors using AI and ML methods10.1038/s41598-022-16665-7 ↗
38. Persona traits identification based on myers-briggs type indicator(MBTI)—A text classification approach
39. Reddit: A gold mine for personality prediction
40. A comparative study of different classifiers for myers-brigg personality prediction model
41. Personality prediction based on Twitter information in Bahasa Indonesia
42. Machine learning approach to personality type prediction based on the Myers–Briggs type indicator10.3390/mti4010009 ↗
43. Predicting the big 5 personality traits from digital footprints on social media: A meta-analysis10.1016/j.paid.2017.12.018 ↗
44. Knowledge of words: An interpretable approach for personality recognition from social media10.1016/j.knosys.2020.105550 ↗
45. Personality traits classification on twitter
46. Deep learning-based document modeling for personality detection from text10.1109/MIS.2017.23 ↗
47. Who am I? Personality detection based on deep learning for texts
48. A hybrid deep learning technique for personality trait classification from text10.1109/ACCESS.2021.3121791 ↗
49. Personality detection from text using convolutional neural network
50. Deep learning-based personality recognition from text posts of online social networks10.1007/s10489-018-1212-4 ↗
51. User personality prediction based on topic preference and sentiment analysis using LSTM model10.1016/j.patrec.2020.07.035 ↗
52. Personality classification of social users based on feature fusion10.3390/s21206758 ↗
53. A sentiment-aware deep learning approach for personality detection from text10.1016/j.ipm.2021.102532 ↗
54. TraitLWNet: A novel predictor of personality trait by analyzing Persian handwriting based on lightweight deep convolutional neural network10.1007/s11042-022-12295-3 ↗
55. Hybrid machine learning technique for personality classification from online text using HEXACO model
56. Personality prediction model for social media using machine learning technique10.1016/j.compeleceng.2022.107852 ↗
57. Automatic personality prediction: An enhanced method using ensemble modeling10.1007/s00521-022-07444-6 ↗
58. A multi-modal personality prediction system10.1016/j.knosys.2021.107715 ↗
59. Psychological human traits detection based on universal language modeling10.1016/j.eij.2020.09.001 ↗
60. S. Aslan and U. Güdükbay, “Multimodal video-based apparent personality recognition using long short-term memory and convolutional neural networks,” arXiv preprint arXiv:1911.00381, 2019.
61. Bottom-up and top-down: Predicting personality with psycholinguistic and language model features
62. BERT: Pre-training of deep bidirectional transformers for language understanding
63. XLNet: Generalized autoregressive pretraining for language understanding
64. ELECTRA: Pre-training text encoders as discriminators rather than generators
65. Enhanced language representation with informative entities
66. Pre-trained models for natural language processing: A survey10.1007/s11431-020-1647-3 ↗
67. Attention is all you need
68. A primer in BERTology: What we know about how BERT works10.1162/tacl_a_00349 ↗
69. From static to dynamic word representations: A survey10.1007/s13042-020-01069-8 ↗
70. A survey of pretrained language models
71. Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines10.1037/a0039210 ↗
72. Transformers: State-of-the-art natural language processing
73. M. S. Sorower, “A literature survey on algorithms for multi-label learning,” Oregon State University, Corvallis, USA, vol. 18, pp. 1–25, 2010.
74. ERNIE 2.0: A continual pre-training framework for language understanding
75. DNNBoT: Deep neural network-based botnet detection and classification
76. A T1OWA fuzzy linguistic aggregation methodology for searching feature-based opinions10.1016/j.knosys.2019.105131 ↗
77. A T1OWA and aspect-based model for customizing recommendations on eCommerce10.1016/j.asoc.2020.106768 ↗