journal article·2022Open access

Low Complexity Encoder with Multilabel Classification and Image Captioning燤odel

Mahmoud Ragab, Abdullah Addas

Computers, Materials & Continua· Volume 72· Issue 3

Abstract

Due to the advanced development in the multimedia-on-demand traffic in different forms of audio, video, and images, has extremely moved on the vision of the Internet of Things (IoT) from scalar to Internet of Multimedia Things (IoMT). Since Unmanned Aerial Vehicles (UAVs) generates a massive quantity of the multimedia data, it becomes a part of IoMT, which are commonly employed in diverse application areas, especially for capturing remote sensing (RS) images. At the same time, the interpretation of the captured RS image also plays a crucial issue, which can be addressed by the multi-label classification and Computational Linguistics based image captioning techniques. To achieve this, this paper presents an efficient low complexity encoding technique with multi-label classification and image captioning for UAV based RS images. The presented model primarily involves the low complexity encoder using the Neighborhood Correlation Sequence (NCS) with a burrows wheeler transform (BWT) technique called LCE-BWT for encoding the RS images captured by the UAV. The application of NCS greatly reduces the computation complexity and requires fewer resources for image transmission. Secondly, deep learning (DL) based shallow convolutional neural network for RS image classification (SCNN-RSIC) technique is presented to determine the multiple class labels of the RS image, shows the novelty of the work. Finally, the Computational Linguistics based Bidirectional Encoder Representations from Transformers (BERT) technique is applied for image captioning, to provide a proficient textual description of the RS image. The performance of the presented technique is tested using the UCM dataset. The simulation outcome implied that the presented model has obtained effective compression performance, reconstructed image quality, classification results, and image captioning outcome.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Image and Video Retrieval Techniques · Multimodal Machine Learning Applications · Image Retrieval and Classification Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (26)

Show source-provided references
1. Drone networks: Communications, coordination, and sensing10.1016/j.adhoc.2017.09.001 ↗
2. From ground to aerial communication: Dissecting wlan 802.11 n for the drones
3. Acods: Adaptive computation offloading for drone surveillance system
4. UAV-enabled healthcare architecture: Issues and challenges10.1016/j.future.2019.01.028 ↗
5. Deep deterministic learning for pattern recognition of different cardiac diseases through the internet of medical things10.1007/s10916-018-1107-2 ↗
6. Chaos-based robust method of zero-watermarking for medical signals10.1016/j.future.2018.05.058 ↗
7. Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks10.1109/JSAC.2010.100412 ↗
8. Joint adoption of QoS schemes for MPEG streams10.1007/s11042-005-6849-4 ↗
9. Fast mode decision for HD scalable video coding via statistical content analysis10.1142/S021800141855011X ↗
10. A low complexity model for predicting slice loss distortion for prioritizing H.264/AVC video10.1007/s11042-014-2334-2 ↗
11. Low complexity watermarking scheme for scalable video coding
12. Slice-based parallelization in HEVC encoding: Realizing the potential through efficient load balancing
13. Compression of medical images using MRP with bidirectional prediction and histogram packing
14. Data partitioning technique for improved video prioritization10.3390/computers6030023 ↗
15. Efficient region-of-interest scalable video coding with adaptive bit-rate control10.1155/2013/281593 ↗
16. Highly reliable and low-complexity image compression scheme using neighborhood correlation sequence algorithm in WSN10.1109/TR.2020.2972567 ↗
17. A new lossless neighborhood indexing sequence (NIS) algorithm for data compression in wireless sensor networks10.1016/j.adhoc.2018.09.009 ↗
18. Lossless colour image compression using RCT for bi-level BWCA10.1007/s11760-015-0783-3 ↗
19. Shallow convolutional neural network for image classification10.1007/s42452-019-1903-4 ↗
20. J. Devlin, M. W. Chang, K. Lee and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805, 2018.
21. http://weegee.vision.ucmerced.edu/datasets/landuse.html.
22. Bag-of-visual-words and spatial extensions for land-use classification
23. A deep learning model based on multi-objective particle swarm optimization for scene classification in unmanned aerial vehicles10.1109/ACCESS.2020.3011502 ↗
24. Recurrently exploring class-wise attention in a hybrid convolutional and bidirectional LSTM network for multi-label aerial image classification10.1016/j.isprsjprs.2019.01.015 ↗
25. Concentric circle pooling in deep convolutional networks for remote sensing scene classification10.3390/rs10060934 ↗
26. Fine-tuned residual network-based features with latent variable support vector machine-based optimal scene classification model for unmanned aerial vehicles10.1109/ACCESS.2020.3004233 ↗