journal article·2024Open access

HybridGAD: Identification of AI-Generated Radiology Abstracts Based on a Novel Hybrid Model with Attention Mechanism

Tuğba Çelikten, Aytuğ Onan

Computers, Materials & Continua· Volume 80· Issue 2

Abstract

The purpose of this study is to develop a reliable method for distinguishing between AI-generated, paraphrased, and human-written texts, which is crucial for maintaining the integrity of research and ensuring accurate information flow in critical fields such as healthcare. To achieve this, we propose HybridGAD, a novel hybrid model that combines Long Short-Term Memory (LSTM), Bidirectional LSTM (Bi-LSTM), and Bidirectional Gated Recurrent Unit (Bi-GRU) architectures with an attention mechanism. Our methodology involves training this hybrid model on a dataset of radiology abstracts, encompassing texts generated by AI, paraphrased by AI, and written by humans. The major findings of our analysis indicate that HybridGAD achieves a high accuracy of 98%, significantly outperforming existing state-of-the-art models. This high performance is attributed to the model’s ability to effectively capture the contextual nuances and structural differences between AI-generated and human-written texts. In conclusion, HybridGAD not only enhances the accuracy of text classification in the field of radiology but also paves the way for more advanced medical diagnostic processes by ensuring the authenticity of textual information. Future research will focus on integrating textual and visual data for comprehensive radiology assessments and improving model generalization with partially labeled data. This study underscores the potential of HybridGAD in transforming medical text classification and highlights its applicability in ensuring the integrity and reliability of research in healthcare and beyond.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Healthcare and Education · Radiomics and Machine Learning in Medical Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (37)

Show source-provided references
1. Bidirectional convolutional recurrent neural network architecture with group-wise enhancement mechanism for text sentiment classification
2. A survey on text classification from traditional to deep learning
3. Medical knowledge-enhanced prompt learning for diagnosis classification from clinical text
4. A. Akram, “An empirical study of AI generated text detection tools,” arXiv preprint arXiv:2310.01423, Oct. 2023.
5. E. Alsentzer et al., “Publicly available clinical BERT embeddings,” arXiv preprint arXiv:1904.03323, Apr. 2019.
6. V. Verma et al., “Ghostbuster: Detecting text ghostwritten by large language models,” arXiv preprint arXiv:2305.15047, May 2023.
7. E. Mitchell et al., “DetectGPT: Zero-shot machine-generated text detection using probability curvature,” arXiv preprint arXiv:2301.11305, Jan. 2023.
8. Detecting AI-generated essays: The ChatGPT challenge
9. Using AI-based detectors to control AI-assisted plagiarism in ESL writing: ‘The terminator versus the machines’10.1186/s40468-023-00260-2 ↗
10. Feature analysis for detecting mobile application review generated by AI-based language model
11. Deepfake detection on social media: Leveraging deep learning and FastText embeddings for identifying machine-generated tweets10.1109/ACCESS.2023.3308515 ↗
12. A. F. Oketunji, “Evaluating the efficacy of hybrid deep learning models in distinguishing AI-generated text,” arXiv preprint arXiv:2311.15565, 2023.
13. R. Gaggar, A. Bhagchandani, and H. Oza, “Machine-generated text detection using deep learning,” arXiv preprint arXiv:2311.15425, 2023.
14. A. Gambetti and Q. Han, “AiGen-FoodReview: A multimodal dataset of machine-generated restaurant reviews and images on social media,” arXiv preprint arXiv:2401.08825, 2024.10.1609/icwsm.v18i1.31437 ↗
15. F. Harrag, M. Debbah, K. Darwish, and A. Abdelali, “BERT transformer model for detecting Arabic GPT2 auto-generated tweets,” arXiv preprint arXiv:2101.09345, 2021.
16. Differentiating chat generative pretrained transformer from humans: Detecting ChatGPT-generated text and human text using machine learning10.3390/math11153400 ↗
17. Detecting generated text and attributing language model source with fine-tuned models and semantic understandingunderstanding
18. Artificial intelligence chatbots will revolutionize how cancer patients access information: ChatGPT represents a paradigm-shift10.1093/jncics/pkad010 ↗
19. Text preprocessing for text mining in organizational research: Review and recommendations10.1177/1094428120971683 ↗
20. Domain-specific language model pretraining for biomedical natural language processing10.1145/3458754 ↗
21. B. Clavié and K. Gal, “EduBERT: Pretrained deep language models for learning analytics,” arXiv preprint arXiv:1912.00690, 2019.
22. An efficient focused crawler using LSTM-CNN based deep learning10.1007/s13198-022-01808-w ↗
23. Bi-LSTM model to increase accuracy in text classification: Combining Word2vec CNN and attention mechanism10.3390/app10175841 ↗
24. F. Li, M. Zhang, G. Fu, T. Qian, and D. Ji, “A Bi-LSTM-RNN model for relation classification using low-cost sequence features,” arXiv preprint arXiv:1608.07720, 2016.
25. Sentiment analysis using gated recurrent neural networks10.1007/s42979-020-0076-y ↗
26. Teeth category classification via seven-layer deep convolutional neural network with max pooling and global average pooling10.1002/ima.22337 ↗
27. ACR-SA: Attention-based deep model through two-channel CNN and Bi-RNN for sentiment analysis10.7717/peerj-cs.877 ↗
28. Research on text classification based on convolutional neural network
29. Computing numeric representations of words in a high-dimensional space
30. Distributed representations of words and phrases and their compositionality
31. Efficient estimation of word representations in vector space
32. Sentiment analysis in Turkish based on weighted word embeddings
33. “Duplichecker,” Accessed: Apr. 20, 2024. [Online]. Available: https://www.duplichecker.com/
34. “Sapling,” Accessed: Apr. 20, 2024. [Online]. Available: https://sapling.ai/ai-content-detector
35. “ZeroGPT,” Accessed: Apr. 20, 2024. [Online]. Available: https://www.zerogpt.com/
36. “Quillbot,” Accessed: Apr. 20, 2024. [Online]. Available: https://quillbot.com/ai-content-detector
37. “GPTZero,” Accessed: May 22, 2024. [Online]. Available: https://gptzero.me/