journal article·2022Open access

A Novel Optimized Language-Independent Text Summarization Technique

Hanan A. Hosni Mahmoud, Alaaeldin M. Hafez

Computers, Materials & Continua· Volume 73· Issue 3

Abstract

A substantial amount of textual data is present electronically in several languages. These texts directed the gear to information redundancy. It is essential to remove this redundancy and decrease the reading time of these data. Therefore, we need a computerized text summarization technique to extract relevant information from group of text documents with correlated subjects. This paper proposes a language-independent extractive summarization technique. The proposed technique presents a clustering-based optimization technique. The clustering technique determines the main subjects of the text, while the proposed optimization technique minimizes redundancy, and maximizes significance. Experiments are devised and evaluated using BillSum dataset for the English language, MLSUM for German and Russian and Mawdoo3 for the Arabic language. The experiments are evaluated using ROUGE metrics. The results showed the effectiveness of the proposed technique compared to other language-dependent and language-independent summarization techniques. Our technique achieved better ROUGE metrics for all the utilized datasets. The technique accomplished an F-measure of 41.9% for Rouge-1, 18.7% for Rouge-2, 39.4% for Rouge-3, and 16.8% for Rouge-4 on average for all the dataset using all three objectives. Our system also exhibited an improvement of 26.6%, 35.5%, 34.65%, and 31.54% w.r.t. The recent model contributed in the summarization of BillSum in terms of ROUGE metric evaluation. Our model’s performance is higher than the compared models, especially in the metric results of ROUGE_2 which is bi-gram matching.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Advanced Text Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (40)

Show source-provided references
1. Searching web text documents using a classification approach10.1108/IJWIS-11-2015-0039 ↗
2. An approach to automatic language-independent text classification using simplified lesk algorithm and wordnet10.5121/ijctcm.2013.3502 ↗
3. Transfer learning for arabic named entity recognition with deep neural networks10.1109/ACCESS.2020.2973319 ↗
4. Arabic text processing model: Verbs roots and conjugation automation10.1109/ACCESS.2020.2999259 ↗
5. Impact of stemming and word embedding on deep learning-based arabic text categorization10.1109/ACCESS.2020.3009217 ↗
6. A superior arabic text categorization deep model (SATCDM)10.1109/ACCESS.2020.2970504 ↗
7. Firefly algorithm based feature selection for arabic text classification10.1016/j.jksuci.2018.06.004 ↗
8. Text tokens detection and multi-classification using advanced deep learning techniques
9. A novel deep learning-based multilevel parallel attention neural (MPAN) model for multidomain arabic sentiment analysis10.1109/ACCESS.2021.3049626 ↗
10. Deep learning10.1038/nature14539 ↗
11. Parameters compressing in deep learning10.32604/cmc.2020.06130 ↗
12. Automatic text classification: A comprehensive survey
13. Comparison of automatic methods for reducing the weighted-sum fit-front to a single solution applied to multi-text documents text classification
14. Review of automatic language-independent text classification techniques & methods
15. Assessing phrase scoring techniques for tokenization text classification
16. Efficient voting-based tokenization automatic text classification using prominent feature set10.1080/03772063.2015.1136574 ↗
17. Automatic arabic text classification: A survey10.1007/s10462-015-9442-x ↗
18. A comprehensive study of text classification algorithms
19. Solving multi-text documents classification as an orienteering problem10.3390/a11070096 ↗
20. A statistical approach for text documents classification
21. Query pnowball: A co-occurrence-based approach to multi-text documents classification for question answering
22. Fuzzy logic based multi text documents classification with improved phrase scoring and redundancy removal technique
23. ADAN-CNN for offensive speech identification in social media
24. ArabADAN: Transformer-based model for arabic language understanding
25. GA MR FFNN PNN and GMM based models for automatic text classification10.1016/j.csl.2008.04.002 ↗
26. An efficient single text documents arabic language-independent text classification using a combination of statistical and semantic features
27. A survey of language-independent text classification tokenization techniques
28. Discourse analysis of arabic text documents and application to automatic classification
29. Enhancing diversity and coverage of text documents summaries through subspace clustering and clustering-based optimization10.1016/j.ins.2014.04.028 ↗
30. BillSum database https://www.tensorflow.org/datasets/catalog/billsum.
31. MLSUM database: https://github.com/huggingface/datasets/tree/master/datasets/mlsum.
32. Arabic database: https://github.com/mawdoo3.com.
33. Exploiting relevance coverage and novelty for query-focused multi-text documents classification10.1016/j.knosys.2013.02.015 ↗
34. Multiobjective evolutionary algorithms: A survey of the state of the art10.1016/j.swevo.2011.03.001 ↗
35. Tokenization multi-text documents text classification using a multi-objective artificial bee colony optimization approach10.1016/j.knosys.2017.11.029 ↗
36. UNL based document summarization based on levels of users
37. Assessing phrase scoring techniques for extractive text summarization10.1016/j.eswa.2013.04.023 ↗
38. Semantic based text summarization using universal networking language
39. Automatic text summarization: A comprehensive survey
40. Comparison of automatic methods for reducing the weighted-sum fit-front to a single solution applied to multi-text documents text summarization10.1016/j.knosys.2019.03.002 ↗