LEGF-DST: LLMs-Enhanced Graph-Fusion Dual-Stream Transformer for Fine-Grained Chinese Malicious SMS Detection
Source abstract
Abstract
With the widespread use of SMS (Short Message Service), the proliferation of malicious SMS has emerged as a pressing societal issue. While deep learning-based text classifiers offer promise, they often exhibit suboptimal perf... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Spam and Phishing Detection · Misinformation and Its Impacts · Advanced Malware Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (53)
Show source-provided references
1. Simple SMS spam filtering on independent mobile phone10.1002/sec.577 ↗
2. Graph-based KNN algorithm for spam SMS detection
3. SMS spam filtering and thread identification using bi-level text classification and clustering techniques10.1177/0165551515616310 ↗
4. Factorial design analysis applied to the performance of SMS anti-spam filtering systems10.1016/j.eswa.2016.08.038 ↗
5. Spam SMS filtering based on text features and supervised machine learning techniques10.1007/s11042-022-12991-0 ↗
6. A discrete hidden markov model for SMS spam detection10.3390/app10145011 ↗
7. Legitimate and spam sms classification employing novel ensemble feature selection algorithm10.1007/s11042-023-16327-4 ↗
8. An enhanced random forest approach using coclust clustering: MIMIC-III and SMS spam collection application
9. A high-quality feature selection method based on frequent and correlated items for text classification10.1007/s00500-023-08587-x ↗
10. Two-phase fuzzy feature-filter based hybrid model for spam classification10.1016/j.jksuci.2022.10.025 ↗
11. A deep learning method for automatic SMS spam classification: Performance of learning algorithms on indigenous dataset10.1002/cpe.6989 ↗
12. Deep learning to filter SMS spam10.1016/j.future.2019.09.001 ↗
13. Category-learning attention mechanism for short text filtering10.1016/j.neucom.2022.08.076 ↗
14. Chinese spam detection using a hybrid BiGRU-CNN network with joint textual and phonetic embedding10.3390/electronics11152418 ↗
15. Z. Lan, “ALBERT: A lite bert for self-supervised learning of language representations,” 2019, arXiv:1909.11942.
16. Y. Liu, “RoBERTa: A robustly optimized BERT pretraining approach,” 2019, arXiv:1907.11692.
17. Y. Sun et al., “ERNIE: Enhanced representation through knowledge integration,” 2019, arXiv:1904.09223.
18. TinyBERT: Distilling BERT for natural language understanding
19. A spam transformer model for SMS spam detection10.1109/ACCESS.2021.3081479 ↗
20. Enhancing spam message classification and detection using transformer-based embedding and ensemble learning10.3390/s23083861 ↗
21. A BERT-GCN-based detection method for FBS telecom fraud Chinese SMS texts
22. Chinese fraudulent text message detection based on graph neural networks
23. SpotSpam: Intention analysis-driven SMS spam detection using bert embeddings10.1145/3538491 ↗
24. J. Achiam et al., “GPT-4 technical report,” 2023, arXiv:2303.08774.
25. J. Cui, Z. Li, Y. Yan, B. Chen, and L. Yuan, “Chatlaw: Open-source legal large language model with integrated external knowledge bases,” 2023, arXiv:2306.16092.
26. S. Wu et al., “BloombergGPT: A large language model for finance,” 2023, arXiv:2303.17564.
27. A generalist vision-language foundation model for diverse biomedical tasks
28. H. Wang et al., “HuaTuo: Tuning llama model with chinese medical knowledge,” 2023, arXiv:2304.06975.
29. Using large language models in psychology
30. Large language models for human-robot interaction: A review10.1016/j.birob.2023.100131 ↗
31. Z. Mao, R. Kobayashi, H. Nabae, and K. Suzumori, “Large language model-empowered multimodal strain sensory system for shape recognition, monitoring, and human interaction of tensegrity,” 2024, arXiv:2406.10264.
32. Data augmentation for intent classification with off-the-shelf large language models
33. J. Ye et al., “LLM-DA: Data augmentation via large language models for few-shot named entity recognition,” 2024, arXiv:2402.14568.
34. CALLM: Enhancing clinical interview analysis through data augmentation with large language models10.1109/JBHI.2024.3435085 ↗
35. RumorLLM: A rumor large language model-based fake-news-detection data-augmentation approach10.3390/app14083532 ↗
36. Graph convolutional networks for text classification
37. Text graph transformer for document classification
38. BERTGCN: Transductive text classification by combining GNN and BERT
39. Tensor graph convolutional networks for text classification
40. Training language models to follow instructions with human feedback
41. EDA: Easy data augmentation techniques for boosting performance on text classification tasks
42. T. GLM. et al., “ChatGLM: A family of large language models from GLM-130B to GLM-4 all tools,” 2024, arXiv:2406.12793.
43. A. Yang et al., “Baichuan 2: Open large-scale language models,” 2023, arXiv:2309.10305.
44. RoFormer: Enhanced transformer with rotary position embedding10.1016/j.neucom.2023.127063 ↗
45. Attention is all you need
46. P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio and Y. Bengio, “Graph attention networks,” 2017, arXiv:1710.10903.
47. Supervised contrastive learning
48. Lies in the air: Characterizing fake-base-station spam ecosystem in China
49. CatBoost: Unbiased boosting with categorical features
50. A sensitivity analysis of (and practitioners’ guide to) convolutional neural networks for sentence classification
51. Deep pyramid convolutional neural networks for text categorization
52. Empirical evaluation of gated recurrent neural networks on sequence modeling
53. Text generation for imbalanced text classification