An Automated English Essay Scoring Engine Based on Neutrosophic Ontology for Electronic Education Systems
Source abstract
Abstract
Most educators agree that essays are the best way to evaluate students’ understanding, guide their studies, and track their growth as learners. Manually grading student essays is a tedious but necessary part of the learning process. Automated Essay Scoring (AES) provides a feasible approach to completing this process. Interest in this area of study has exploded in recent years owing to the difficulty of simultaneously improving the syntactic and semantic scores of an article. Ontology enables us to consider the semantic constraints of the actual world. However, there are several uncertainties and ambiguities that cannot be accounted for by standard ontologies. Numerous AES strategies based on fuzzy ontologies have been proposed in recent years to reduce the possibility of imprecise knowledge presentation. However, no known efforts have been made to utilize ontologies with a higher level of fuzzification in order to enhance the effectiveness of identifying semantic mistakes. This paper presents the first attempt to address this problem by developing a model for efficient grading of English essays using latent semantic analysis (LSA) and neutrosophic ontology. In this regard, the presented work integrates commonly used syntactic and semantic features to score the essay. The integration methodology is implemented through feature-level fusion. This integrated vector is used to check the coherence and cohesion of the essay. Furthermore, the role of neutrosophic ontology is investigated by adding neutrosophic membership functions to the crisp ontology to detect semantic errors and give feedback. Neutrosophic logic allows the explicit inclusion of degrees of truthfulness, falsity, and indeterminacy. According to the comparison with state-of-the-art AES methods, the results show that the proposed model significantly improves the accuracy of scoring the essay semantically and syntactically and is able to provide feedback.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Educational Technology and Assessment · Text and Document Classification Technologies · Online Learning and Analytics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Technology, Institute of Graduate Studies and Research, Alexandria University, 163 Horreya Avenue, El Shatby, P.O. Box 832, Alexandria 21526, Egypt
Department of Computer, Ministry of Education, Baghdad 10082, Iraq
References (77)
Show source-provided references
1. An efficient and enhancement of recent approaches to build an automated essay scoring system10.1016/j.procs.2022.12.046 ↗
2. A novel automated essay scoring approach for reliable higher educational assessments10.1007/s12528-021-09283-1 ↗
3. A Human-centric automated essay scoring and feedback system for the development of ethical reasoning
4. Vijaya, S., Guruvyas, K., Patil, P., and Acharya, J. (2022). Proceedings of Third International Conference on Communication, Computing and Electronics Systems, Springer.
5. Rokade, A., Patil, B., Rajani, S., Revandkar, S., and Shedge, R. (2018, January 20–21). Automated grading system using natural language processing. Proceedings of the Second International Conference on Inventive Communication and Computational Technologies, Coimbatore, India.10.1109/ICICCT.2018.8473170 ↗
6. Computer Science Meets Education: Natural Language Processing for Automatic Grading of Open-Ended Questions in eBooks10.1177/0735633120927486 ↗
7. Applying natural language processing to automatically assess student conceptual understanding from textual responses10.14742/ajet.7121 ↗
8. Automatic assessment of descriptive answers in online examination system using semantic relational features10.1007/s11227-018-2381-y ↗
9. Efficacy of Deep Neural Embeddings based Semantic Similarity in Automatic Essay Evaluation10.12785/ijcds/1001122 ↗
10. Hoblos, J. (2020, January 14–16). Experimenting with latent semantic analysis and latent Dirichlet allocation on automated essay grading. Proceedings of the Seventh International Conference on Social Networks Analysis, Management and Security, Paris, France.10.1109/SNAMS52053.2020.9336533 ↗
11. Bhatt, R., Patel, M., Srivastava, G., and Mago, V. (2020, January 11–14). A graph based approach to automate essay evaluation. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Toronto, ON, Canda.10.1109/SMC42975.2020.9282902 ↗
12. Automated evaluation of Telugu text essays using latent semantic analysis
13. Computing semantic relatedness using latent semantic analysis and fuzzy formal concept analysis
14. Adel, E., El-Sappagh, S., Barakat, S., Hu, J., and Elmogy, M. (2021). An Extended Semantic Interoperability Model for Distributed Electronic Health Record Based on Fuzzy Ontology Semantics. Electronics, 10.10.3390/electronics10141733 ↗
15. Dhiman, S., Thukral, A., and Bedi, P. (2022). Proceedings of Third International Conference in Artificial Intelligence and Speech Technology, Springer International Publishing.
16. Urbieta, I., Nieto, M., García, M., and Otaegui, O. (2021). Design and Implementation of an Ontology for Semantic Labeling and Testing: Automotive Global Ontology (AGO). Appl. Sci., 11.10.3390/app11177782 ↗
17. Semantic publishing: A semantic representation of scholarly publications based on the SPAR ontologies
18. Thanasingh. Fuzzy rule based ontology reasoning10.1007/s12652-020-02163-z ↗
19. Model based on neutrosophic ontologies for the study of entrepreneurship competence
20. Bhutani, K., and Aggarwal, S. (2015, January 14–17). Experimenting with neutrosophic ontologies for medical data classification. Proceedings of the IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions, Kanpur, India.10.1109/WCI.2015.7495535 ↗
21. CAFOB: Context-aware fuzzy-ontology-based tourism recommendation system10.1016/j.eswa.2022.116877 ↗
22. Managing Group Decision Making criteria values using Fuzzy Ontologies10.1016/j.procs.2022.01.021 ↗
23. A systematic review of ontology use in E-Learning recommender system10.1016/j.caeai.2022.100047 ↗
24. Cross, V., and Chen, S. (2018). Proceedings of the International Conference of the North American Fuzzy Information Processing Society, Springer International Publishing.
25. Compensatory fuzzy logic with single valued neutrosophic numbers in the analysis of university strategic management10.54216/IJNS.180414 ↗
26. Medical diagnosis problems based on neutrosophic sets and their hybrid structures: A 1]
27. An automated essay scoring systems: A systematic literature review10.1007/s10462-021-10068-2 ↗
28. Ifenthaler, D. (2022). Handbook of Open, Distance and Digital Education, Springer Nature.
29. English Writing Feedback Based on Online Automatic Evaluation in the Era of Big Data
30. Li, X., Long, X., and Chen, S.L. (2023). Proceedings of the ICNC-FSKD 2022: Advances in Natural Computation, Fuzzy Systems and Knowledge Discovery, Springer.
31. Sriwanna, K. (2018, January 1–4). Text classification for subjective scoring using K-nearest neighbors. Proceedings of the International Conference on Digital Arts, Media and Technology, Chiang Mai, Thailand.10.1109/ICDAMT.2018.8376511 ↗
32. Zupanc, K., and Bosnić, Z. (2018, January 25–27). Increasing accuracy of automated essay grading by grouping similar graders. Proceedings of the 8th International Conference on Web Intelligence, Mining and Semantics, Novi Sad, Serbia.10.1145/3227609.3227645 ↗
33. Contreras, J., Hilles, S., and Abubakar, Z. (2018, January 11–12). Automated essay scoring with ontology based on text mining and NLTK tools. Proceedings of the International Conference on Smart Computing and Electronic Enterprise, Shah Alam, Malaysia.10.1109/ICSCEE.2018.8538399 ↗
34. Automated Essay Scoring using Ontology Generator and Natural Language Processing with Question Generator based on Blooms Taxonomy’s Cognitive Level10.35940/ijeat.A9974.109119 ↗
35. Ajetunmobi, S., and Daramola, O. (2017, January 29–31). Ontology-based information extraction for subject-focused automatic essay evaluation. Proceedings of the International Conference on Computing Networking and Informatics, Lagos, Nigeria.10.1109/ICCNI.2017.8123781 ↗
36. SEDNN: Shared and enhanced deep neural network model for cross-prompt automated essay scoring10.1016/j.knosys.2020.106491 ↗
37. Huda, A., Putri, M., Awalluddin, A., and Sholeha, R. (2022, January 21–22). Text summarization of hadiths in Indonesian language using the combination of fuzzy logic scoring and latent semantic analysis (LSA). Proceedings of the International Conference on Wireless and Telematics, Yogyakarta, Indonesia.10.1109/ICWT55831.2022.9935408 ↗
38. Mittal, H., and Devi, M. (2016). Proceedings of the International Conference on Innovations in Computer Science and Engineering, Springer.
39. Fauzi, M., Utomo, D., Setiawan, B., and Pramukantoro, E. (2017, January 17–20). Automatic essay scoring system using N-gram and cosine similarity for gamification based E-learning. Proceedings of the International Conference on Advances in Image Processing, Beijing, China.10.1145/3133264.3133303 ↗
40. Construction of English Translation Model Based on Neural Network Fuzzy Semantic Optimal Control
41. Automatic Scoring of English Essays Based on Machine Learning Technology in a Wireless Network Environment
42. An automated essay evaluation system using natural language processing and sentiment analysis
43. An automatic scoring method for Chinese-English spoken translation based on attention LSTM
44. Human–machine collaborative scoring of subjective assignments based on sequential three-way decisions10.1016/j.eswa.2022.119466 ↗
45. Tashu, T., Maurya, C., and Horvath, T. (2022). Deep Learning Architecture for Automatic Essay Scoring. arXiv.
46. Automated assessment of subjective assignments: A hybrid approach10.1016/j.eswa.2022.117315 ↗
47. Feature Engineering and Ensemble-Based Approach for Improving Automatic Short-Answer Grading Performance10.1109/TLT.2019.2897997 ↗
48. Automatic Content Analyzer
49. Farag, Y., Yannakoudakis, H., and Briscoe, T. (2018). Neural automated essay scoring and coherence modeling for adversarial crafted input. arXiv.10.18653/v1/N18-1024 ↗
50. Li, X., Chen, M., Nie, J., Liu, Z., Feng, Z., and Cai, Y. (2018). Proceedings of the China National Conference on Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data, Springer International Publishing.
51. Automated essay evaluation with semantic analysis10.1016/j.knosys.2017.01.006 ↗
52. Optimization of Window Size for Calculating Semantic Coherence Within an Essay
53. Darwish, S., and Mohamed, S. (2020). Proceedings of the International Conference on Advanced Machine Learning Technologies and Applications, Springer International Publishing.
54. Spatial autocorrelation analysis and ecological niche modelling allows inference of range dynamics driving the population genetic structure of a Neotropical savanna tree10.1111/jbi.12622 ↗
55. Automatic essay exam scoring system: A systematic literature review10.1016/j.procs.2022.12.166 ↗
56. Application of an Automated Essay Scoring engine to English writing assessment using Many-Facet Rasch Measurement10.1177/02655322221076025 ↗
57. Ke, Z., and Ng, V. (2019, January 10). Automated Essay Scoring: A Survey of the State of the Art. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI-19), Macao, China.10.24963/ijcai.2019/879 ↗
58. Sharma, A., Kabra, A., and Kapoor, R. (2021). Proceedings of the European Conference of Machine Learning and Knowledge Discovery in Databases, Springer International Publishing.
59. Gomaa, W., and Fahmy, A. (2020). Proceedings of the International Conference on Advanced Machine Learning Technologies and Applications, Springer International Publishing.
60. Azman, A., Alksher, M., Doraisamy, S., Yaakob, R., and Alshari, E. (2020). Proceedings of the Computational Science and Technology, Springer.
61. Automated Arabic essay scoring based on hybrid stemming with WordNet10.22452/mjcs.sp2021no2.4 ↗
62. Li, T., Wang, S., Lillis, D., and Yang, Z. (2020). Combining Machine Learning and Logical Reasoning to Improve Requirements Traceability Recovery. Appl. Sci., 10.10.3390/app10207253 ↗
63. Combining and learning word embedding with WordNet for semantic relatedness and similarity measurement10.1002/asi.24289 ↗
64. A study on student performance, engagement, and experience with Kaggle in class data challenges10.1080/10691898.2021.1892554 ↗
65. Data Envelopment Analysis of linguistic features and passage relevance for open-domain Question Answering10.1016/j.knosys.2022.108574 ↗
66. Ontology visualization PROTÉGÉ tools—A review
67. The selection of LASER as surgical instrument in medical using neutrosophic soft set with generalized fuzzy TOPSIS, WSM and WPM along with MATLAB coding
68. Kappa and Beyond: Is There Agreement?10.1177/2192568220911648 ↗
69. Kappa coefficients for dichotomous-nominal classifications10.1007/s11634-020-00394-8 ↗
70. Park, Y., Choi, Y., Park, C., and Lee, K. (2022). EssayGAN: Essay data augmentation based on generative adversarial networks for automated essay scoring. Appl. Sci., 12.10.3390/app12125803 ↗
71. Zupanc, K., and Bosnic, Z. (2014, January 7–10). Automated essay evaluation augmented with semantic coherence measures. Proceedings of the IEEE International Conference on Data Mining, Virtual Conference.10.1109/ICDM.2014.21 ↗
72. Automated Writing Evaluation and Feedback: Multiple Metrics of Efficacy10.1177/0735633119830764 ↗
73. Comparison of dimension reduction methods for automated essay grading
74. Liang, G., On, B., Jeong, D., Kim, H., and Choi, G. (2018). Automated essay scoring: A Siamese bidirectional LSTM neural network architecture. Symmetry, 10.10.3390/sym10120682 ↗
75. Dasgupta, T., Naskar, A., Dey, L., and Saha, R. (2018, January 19). Augmenting textual qualitative features in deep convolution recurrent neural network for automatic essay scoring. Proceedings of the 5th Workshop on Natural Language Processing Techniques for Educational Applications, Melbourne, Australia.10.18653/v1/W18-3713 ↗
76. Recent trends in deep learning based natural language processing10.1109/MCI.2018.2840738 ↗
77. Jiang, Z., Liu, M., Yin, Y., Yu, H., Cheng, Z., and Gu, Q. (2021, January 19). Learning from graph propagation via ordinal distillation for one-shot automated essay scoring. Proceedings of the Web Conference, Ljubljana, Slovenia.10.1145/3442381.3450017 ↗