journal article·2022Open access

Historical Arabic Images Classification and Retrieval Using Siamese Deep Learning Model

Manal M. Khayyat, Lamiaa A. Elrefaei, Mashael M. Khayyat

Computers, Materials & Continua· Volume 72· Issue 1

Abstract

Classifying the visual features in images to retrieve a specific image is a significant problem within the computer vision field especially when dealing with historical faded colored images. Thus, there were lots of efforts trying to automate the classification operation and retrieve similar images accurately. To reach this goal, we developed a VGG19 deep convolutional neural network to extract the visual features from the images automatically. Then, the distances among the extracted features vectors are measured and a similarity score is generated using a Siamese deep neural network. The Siamese model built and trained at first from scratch but, it didn't generated high evaluation metrices. Thus, we re-built it from VGG19 pre-trained deep learning model to generate higher evaluation metrices. Afterward, three different distance metrics combined with the Sigmoid activation function are experimented looking for the most accurate method for measuring the similarities among the retrieved images. Reaching that the highest evaluation parameters generated using the Cosine distance metric. Moreover, the Graphics Processing Unit (GPU) utilized to run the code instead of running it on the Central Processing Unit (CPU). This step optimized the execution further since it expedited both the training and the retrieval time efficiently. After extensive experimentation, we reached satisfactory solution recording 0.98 and 0.99 F-score for the classification and for the retrieval, respectively.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Retrieval and Classification Techniques · Advanced Image and Video Retrieval Techniques · Remote-Sensing Image Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (21)

Show source-provided references
1. A survey of deep neural network architectures and their applications10.1016/j.neucom.2016.12.038 ↗
2. A deep Siamese convolution neural network for multi-class classification of Alzheimer disease10.3390/brainsci10020084 ↗
3. Siamese tracking network with informative enhanced loss10.1109/TMM.2020.2978636 ↗
4. On-site identification of counterfeit drugs based on near-infrared spectroscopy Siamese-network modeling10.1109/ACCESS.2020.3047683 ↗
5. A deep Siamese network for scene detection in broadcast videos
6. SiamRPN++: Evolution of Siamese visual tracking with very deep networks
7. Deep Siamese multi-scale convolutional network for change detection in multi-temporal VHR images
8. Siamese graph convolutional network for content based remote sensing image retrieval10.1016/j.cviu.2019.04.004 ↗
9. SiameseGAN: A generative model for denoising of spectral domain optical coherence tomography images10.1109/TMI.2020.3024097 ↗
10. Fine-tuning CNN image retrieval with no human annotation
11. A learning framework for shape retrieval based on multilayer perceptrons10.1016/j.patrec.2018.09.005 ↗
12. Siamese neural networks for one-shot image recognition
13. Siamese network of deep fisher-vector descriptors for image retrieval
14. Siamese-ResNet: Implementing loop closure detection based on siamese network
15. Image retrieval and pattern spotting using siamese neural network
16. Manuscripts image retrieval using deep learning incorporating a variety of fusion levels10.1109/ACCESS.2020.3010882 ↗
17. H. Lamba, “One shot learning with Siamese networks using Keras,” 21-Jan-2019 [Online] Medium. Available at: https://towardsdatascience.com/one-shot-learning-with-siamese-networks-using-keras-17f34e75bb3d, 2019, (accessed 04 Oct, 2020).
18. Learning effective binary descriptors via cross entropy
19. P. Singh, “Siamese network keras for image and text similarity,” 24-Aug-2019 [Online] Medium. Available at: https://medium.com/@prabhnoor0212/siamese-network-keras-31a3a8f37d04, 2019, (accessed 02 Feb, 2020).
20. Improved SMOTE algorithm to deal with imbalanced activity classes in smart homes10.1007/s11063-018-9940-3 ↗
21. Towards author recognition of ancient Arabic manuscripts using deep learning: A transfer learning approach10.12785/ijcds/090502 ↗