Multi-Scale Vision Transformer with Dynamic Multi-Loss Function for Medical Image Retrieval and Classification
Source abstract
Abstract
This paper introduces a novel method for medical image retrieval and classification by integrating a multi-scale encoding mechanism with Vision Transformer (ViT) architectures and a dynamic multi-loss function. The multi-scal... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Brain Tumor Detection and Classification · Image Processing Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. ChestX-ray8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. arXiv:1705.02315. 2017.10.1109/CVPR.2017.369 ↗
2. Harley AW, Ufkes A, Derpanis KG. Evaluation of deep convolutional nets for document image classification and retrieval. arXiv:1502.07058. 2015.10.1109/ICDAR.2015.7333910 ↗
3. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556. 2015.
4. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. arXiv:1409.4842. 2014.10.1109/CVPR.2015.7298594 ↗
5. Deep residual learning for image recognition
6. An image is worth 16x16 words: transformers for image recognition at scale
7. Echoes of images: multi-loss network for image retrieval in vision transformers10.1007/s11517-024-03055-6 ↗
8. SynthEnsemble: a fusion of CNN, vision transformer, and hybrid models for multi-label chest X-ray classification
9. Automatic polyp image segmentation and cancer prediction based on deep learning10.3389/fonc.2022.1087438 ↗
10. Fast&Focused-Net: enhancing small object encoding with VDP layer in deep neural networks10.1109/ACCESS.2024.3447888 ↗
11. Comparison of deep learning approaches for multi-label chest X-ray classification10.1038/s41598-019-42294-8 ↗
12. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions10.1038/sdata.2018.161 ↗
13. Codella N, Rotemberg V, Tschandl P, Celebi ME, Dusza S, Gutman D, et al. Skin lesion analysis toward melanoma detection 2018: a challenge hosted by the international skin imaging collaboration (ISIC). arXiv:1902.03368. 2019.
14. A convolutional attention mapping deep neural network for classification and localization of cardiomegaly on chest X-rays10.1038/s41598-023-32611-7 ↗
15. A multi-scale context aware attention model for medical image segmentation10.1109/JBHI.2022.3227540 ↗
16. Towards improved U-Net for efficient skin lesion segmentation10.1007/s11042-024-18334-5 ↗
17. Improved U-Net based on contour attention for efficient segmentation of skin lesion10.1007/s11042-023-16759-y ↗
18. Efficient skin lesion segmentation with boundary distillation10.1007/s11517-024-03095-y ↗
19. GSCEU-Net: an end-to-end lightweight skin lesion segmentation model with feature fusion based on U-Net enhancements10.3390/info14090486 ↗
20. GMIF: a gated multiscale input feature fusion scheme for scene text detection10.1109/ACCESS.2022.3203691 ↗
21. The cross-entropy method for combinatorial and continuous optimization10.1023/A:1010091220143 ↗
22. FaceNet: a unified embedding for face recognition and clustering
23. Dimensionality reduction by learning an invariant mapping
24. Hinton G, Vinyals O, Dean J. Distilling the knowledge in a neural network. arXiv:1503.02531. 2015.
25. Densely connected convolutional networks
26. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, et al. MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861. 2017.
27. Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size. arXiv:1602.07360. 2016.
28. Vision transformer architecture and applications in digital health: a tutorial and survey10.1186/s42492-023-00140-9 ↗
29. Implementing vision transformer for classifying 2D biomedical images10.1038/s41598-024-63094-9 ↗
30. UNet++: a nested U-Net architecture for medical image segmentation
31. H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes10.1109/TMI.2018.2845918 ↗
32. V-Net: fully convolutional neural networks for volumetric medical image segmentation
33. DGCU–Net: a new dual gradient-color deep convolutional neural network for efficient skin lesion segmentation10.1016/j.bspc.2022.103829 ↗
34. A hybrid preprocessor DE-ABC for efficient skin-lesion segmentation with improved contrast10.3390/diagnostics12112625 ↗
35. Rajpurkar P, Irvin J, Zhu K, Yang B, Mehta H, Duan T, et al. CheXNet: radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv:1711.05225. 2017.
36. ImageNet: a large-scale hierarchical image database