journal article·2026-07-02Open access

Quantifying Airline Reputation from Multilingual Online Content: Artificial Intelligence and a Practical Application in a Lightweight Reputation-Intelligence Framework

Luís F. F. M. Santos

Applied Sciences· Volume 16· Issue 13

Abstract

This paper presents “Quantifying Airline Reputation from Multilingual Online Content: Artificial Intelligence and a Practical Application in a Lightweight Reputation-Intelligence Framework.” Airline reputation is increasingly shaped by multilingual digital narratives that evolve faster than conventional survey cycles, creating a need for timely and interpretable monitoring tools. This study develops and evaluates a lightweight reputation-intelligence framework that integrates brand-safe retrieval, multilingual transformer-based sentiment inference, zero-shot natural-language-inference aspect categorization, TF–IDF/KMeans topic induction, and short-horizon forecasting. The framework formalizes document-level outputs into managerial indicators, including a Net Sentiment Index, polarity shares, aspect scores, topic summaries, and projected sentiment trajectories. On a 3990-document annotated sentiment subset, the multilingual transformer achieved 0.9015 accuracy, 0.9048 macro-F1, 0.9050 weighted-F1, a Cohen’s kappa of 0.8492, and a Net Sentiment Index of 48.5%, while errors were concentrated between adjacent polarity classes. Aspect evaluation showed that supervised in-domain learning substantially outperformed zero-shot inference, clarifying the trade-off between cold-start portability and benchmark accuracy. The results support the framework as a pilot decision-support architecture for airline reputation sensing rather than as a definitive large-scale benchmark. The approach offers scalable and CPU-friendly monitoring capability for airlines, airports, consultants, and public-sector users, while future work should expand multilingual annotation and domain adaptation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Public Relations and Crisis Communication · Digital Marketing and Social Media · Aviation Industry Analysis and Trends

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Management, Engineering and Aeronautics, ISEC Lisboa, Alameda das Linhas de Torres 179, 1750-142 Lisbon, Portugal

AEROG–LAETA—Aeronautics and Astronautics Research Center, Universidade da Beira Interior, 6201-001 Covilhã, Portugal

Funding

Fundação para a Ciência e a Tecnologia

References (59)

Show source-provided references
1. From emotional data to decisions: A systematic review on how airlines use sentiments and emotions to stay ahead10.1016/j.jairtraman.2025.102911 ↗
2. Li, Z., Yang, C., and Huang, C. (2024). A Comparative Sentiment Analysis of Airline Customer Reviews Using Bidirectional Encoder Representations from Transformers (BERT) and Its Variants. Mathematics, 12.10.3390/math12010053 ↗
3. Deep learning-driven sentiment analysis for customer satisfaction optimization in airline reviews10.1108/IMDS-08-2024-0836 ↗
4. Identification of opinion trends using sentiment analysis of airlines passengers’ reviews10.1016/j.jairtraman.2022.102232 ↗
5. Text mining approach to explore dimensions of airline customer satisfaction using online customer reviews10.1016/j.jairtraman.2019.101760 ↗
6. Airline reviews processing: Abstractive summarization and rating-based sentiment classification using deep transfer learning
7. The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms10.1287/mnsc.49.10.1407.17308 ↗
8. The effect of word of mouth on sales: Online book reviews10.1509/jmkr.43.3.345 ↗
9. Does Chatter Really Matter? Dynamics of User-Generated Content and Stock Performance10.1287/mksc.1110.0682 ↗
10. Doganis, R. (2019). Flying Off Course: Airline Economics and Marketing, Routledge. [5th ed.].10.4324/9781315402987 ↗
11. Belobaba, P., Odoni, A., and Barnhart, C. (2024). The Global Airline Industry, Wiley. [3rd ed.].
12. A national customer satisfaction barometer: The Swedish experience10.1177/002224299205600103 ↗
13. SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality
14. Customer experience creation: Determinants, dynamics and management strategies10.1016/j.jretai.2008.11.001 ↗
15. The behavioral consequences of service quality10.1177/002224299606000203 ↗
16. An alternative approach to understanding airline customers’ attitudes and behaviors10.1016/j.jairtraman.2025.102960 ↗
17. Opinion mining and sentiment analysis10.1561/1500000011 ↗
18. New avenues in opinion mining and sentiment analysis10.1109/MIS.2013.30 ↗
19. Hutto, C.J., and Gilbert, E. (2014, January 1–4). VADER: A parsimonious rule-based model for sentiment analysis of social media text. Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media, Ann Arbor, MI, USA.10.1609/icwsm.v8i1.14550 ↗
20. Kim, Y. (2014, January 25–29). Convolutional Neural Networks for Sentence Classification. Proceedings of the EMNLP, Doha, Qatar.
21. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
22. Pennington, J., Socher, R., and Manning, C. (2014, January 25–29). GloVe: Global Vectors for Word Representation. Proceedings of the EMNLP, Doha, Qatar.10.3115/v1/D14-1162 ↗
23. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
24. Attention Is All You Need
25. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the NAACL-HLT, Minneapolis, MN, USA.
26. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv.
27. Madeira, T., Melício, R., Valério, D., and Santos, L.F.F.M. (2021). Machine Learning and Natural Language Processing for Prediction of Human Factors in Aviation Incident Reports. Aerospace, 8.10.3390/aerospace8020047 ↗
28. Nogueira, R.P.R., Melicio, R., Valério, D., and Santos, L.F.F.M. (2023). Learning Methods and Predictive Modeling to Identify Failure by Human Factors in the Aviation Industry. Appl. Sci., 13.10.3390/app13064069 ↗
29. Lázaro, F.L., Nogueira, R.P.R., Melicio, R., Valério, D., and Santos, L.F.F.M. (2024). Human Factors as Predictor of Fatalities in Aviation Accidents: A Neural Network Analysis. Appl. Sci., 14.10.3390/app14020640 ↗
30. Lázaro, F.L., Madeira, T., Melicio, R., Valério, D., and Santos, L.F.F.M. (2025). Identifying Human Factors in Aviation Accidents with Natural Language Processing and Machine Learning Models. Aerospace, 12.10.3390/aerospace12020106 ↗
31. Lázaro, F.L., Santos, L.F.F.M., Valério, D., and Melicio, R. (2025). Artificial Intelligence and Aviation: A Deep Learning Strategy for Improved Data Classification and Management. Appl. Sci., 15.10.3390/app15179403 ↗
32. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., and Stoyanov, V. (2020, January 5–10). Unsupervised Cross-lingual Representation Learning at Scale. Proceedings of the ACL, Online.10.18653/v1/2020.acl-main.747 ↗
33. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
34. Language Models are Few-Shot Learners
35. Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C.L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., and Ray, A. (2022). Training Language Models to Follow Instructions with Human Feedback. arXiv.10.52202/068431-2011 ↗
36. OpenAI (2023). GPT-4 Technical Report. arXiv.
37. Zhao, W.X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., and Dong, Z. (2023). A Survey of Large Language Models. arXiv.
38. Bommasani, R., Hudson, D.A., Adeli, E., Altman, R., Arora, S., von Arx, S., Bernstein, M.S., Bohg, J., Bosselut, A., and Brunskill, E. (2021). On the Opportunities and Risks of Foundation Models. arXiv.
39. Brody, S., and Elhadad, N. (2010, January 2–4). An unsupervised aspect-sentiment model for online reviews. Proceedings of the Human Language Technologies: The 2010 Annual Conference of the NAACL, Los Angeles, CA, USA.
40. Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., and Manandhar, S. (2016, January 16–17). SemEval-2016 Task 5: Aspect Based Sentiment Analysis. Proceedings of the SemEval, San Diego, CA, USA.
41. A survey on aspect-level sentiment analysis10.1109/TKDE.2015.2485209 ↗
42. Yin, W., Hay, J., Roth, D., and Schütze, H. (2019, January 3–7). Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approach. Proceedings of the EMNLP-IJCNLP, Hong Kong, China.10.18653/v1/D19-1404 ↗
43. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation
44. A systematic analysis of performance measures for classification tasks10.1016/j.ipm.2009.03.002 ↗
45. A coefficient of agreement for nominal scales10.1177/001316446002000104 ↗
46. Reliability in content analysis: Some common misconceptions and recommendations
47. Latent Dirichlet Allocation
48. Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv.
49. Term-weighting approaches in automatic text retrieval10.1016/0306-4573(88)90021-0 ↗
50. Some methods for classification and analysis of multivariate observations
51. Least squares quantization in PCM10.1109/TIT.1982.1056489 ↗
52. Social media analytics in hospitality and tourism: A systematic literature review and future trends
53. Deep learning based recommender system: A survey and new perspectives10.1145/3158369 ↗
54. Jurafsky, D., and Martin, J.H. (2023). Speech and Language Processing, Prentice Hall. [3rd ed.].
55. Liu, B. (2012). Sentiment Analysis and Opinion Mining, Morgan & Claypool Publishers.10.1007/978-3-031-02145-9 ↗
56. Examining customer perception and behaviour through social media research—An empirical study of the United Airlines overbooking crisis10.1016/j.tre.2019.05.004 ↗
57. United Airlines crisis from the stakeholder perspective: Exploring customers’ ethical judgment, trust and distrust, and behavioral intentions10.1016/j.pubrev.2020.101908 ↗
58. CNNMoney (2017). United Loses $250 Million of Its Market Value, CNNMoney.
59. United Airlines (2017). United Airlines Announces Changes to Improve Customer Experience, United Airlines.