Automating Transfer Credit Assessment-A Natural Language Processing-Based Approach
Source abstract
Abstract
Student mobility or academic mobility involves students moving between institutions during their post-secondary education, and one of the challenging tasks in this process is to assess the transfer credits to be offered to the incoming student. In general, this process involves domain experts comparing the learning outcomes of the courses, to decide on offering transfer credits to the incoming students. This manual implementation is not only labor-intensive but also influenced by undue bias and administrative complexity. The proposed research article focuses on identifying a model that exploits the advancements in the field of Natural Language Processing (NLP) to effectively automate this process. Given the unique structure, domain specificity, and complexity of learning outcomes (LOs), a need for designing a tailor-made model arises. The proposed model uses a clustering-inspired methodology based on knowledge-based semantic similarity measures to assess the taxonomic similarity of LOs and a transformer-based semantic similarity model to assess the semantic similarity of the LOs. The similarity between LOs is further aggregated to form course to course similarity. Due to the lack of quality benchmark datasets, a new benchmark dataset containing seven course-to-course similarity measures is proposed. Understanding the inherent need for flexibility in the decision-making process the aggregation part of the model offers tunable parameters to accommodate different levels of leniency. While providing an efficient model to assess the similarity between courses with existing resources, this research work also steers future research attempts to apply NLP in the field of articulation in an ideal direction by highlighting the persisting research gaps.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Topic Modeling
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. Student mobility & credit transfer: A national and global survey
2. Automating articulation: Applying natural language processing to post-secondary credit transfer10.1109/ACCESS.2019.2910145 ↗
3. Bloom · Handbook I: Cognitive Domain · 1956
4. Anderson · Bloom’s Taxonomy · 1994
5. Evolution of semantic similarity-A survey10.1145/3440755 ↗
6. Semantic similarity and machine learning with ontologies10.1093/bib/bbaa199 ↗
7. Development and application of a metric on semantic nets10.1109/21.24528 ↗
8. Verbs, semantics and lexical selection
9. Combining local context and WordNet similarity for word sense identification10.7551/mitpress/7287.003.0018 ↗
10. T. Mikolov, K. Chen, G. Corrado and J. Dean, “Efficient estimation of word representations in vector space,” arXiv:1301.3781, 2013.
11. GloVe: Global vectors for word representation
12. Attention is all you need
13. BERT: Pre-training of deep bidirectional transformers for language understanding
14. Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv:1907.11692, 2019.
15. ALBERT: A lite BERT for self-supervised learning of language representations
16. BioBERT: A pre-trained biomedical language representation model for biomedical text mining10.1093/bioinformatics/btz682 ↗
17. SciBERT: A pretrained language model for scientific text
18. M. M. A. Qudar and V. Mago, “TweetBERT: A pretrained language representation model for twitter text analysis,” arXiv:2010.11091, 2020.
19. Exploring the limits of transfer learning with a unified text-to-text transformer
20. A. Radford, K. Narasimhan, T. Salimans and I. Sutskever, “Improving language understanding by generative pre-training,” 2018.
21. Language models are unsupervised multitask learners
22. Language models are few-shot learners
23. Energy and policy considerations for deep learning in NLP
24. GPT-3: Its nature, scope, limits, and consequences10.1007/s11023-020-09548-1 ↗
25. When BERT plays the lottery, All tickets Are winning
26. Changing the world by changing the data
27. Evaluation of final examination papers in engineering: A case study using bloom’s taxonomy10.1109/TE.2009.2014221 ↗
28. Wordnet: A lexical database for English10.1145/219717.219748 ↗
29. Simverb-3500: A large-scale evaluation set of verb similarity
30. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis10.1016/0377-0427(87)90125-7 ↗
31. BERTScore: Evaluating text generation with BERT
32. Sentence-BERT: Sentence embeddings using siamese BERT-networks
33. Hcti at semeval-2017 task 1: Use convolutional neural network to evaluate semantic textual similarity
34. A SICK cure for the evaluation of compositional distributional semantic models
35. The multiple dimensions of transfer: Examining the transfer function in American higher education10.1177/0091552117725177 ↗
36. A primer in BERTology: What we know about how BERT works10.1162/tacl_a_00349 ↗
37. Comparative analysis of word embeddings in assessing semantic similarity of complex sentences10.1109/ACCESS.2021.3135807 ↗
38. The state of course learning outcomes at leading universities10.1080/03075079.2017.1392500 ↗