Enhanced Atrous Extractor and Self-Dynamic Gate Network for Superpixel Segmentation
Source abstract
Abstract
A superpixel is a group of pixels with similar low-level and mid-level properties, which can be seen as a basic unit in the pre-processing of remote sensing images. Therefore, superpixel segmentation can reduce the computation cost largely. However, all the deep-learning-based methods still suffer from the under-segmentation and low compactness problem of remote sensing images. To fix the problem, we propose EAGNet, an enhanced atrous extractor and self-dynamic gate network. The enhanced atrous extractor is used to extract the multi-scale superpixel feature with contextual information. The multi-scale superpixel feature with contextual information can solve the low compactness effectively. The self-dynamic gate network introduces the gating and dynamic mechanisms to inject detailed information, which solves the under-segmentation effectively. Massive experiments have shown that our EAGNet can achieve the state-of-the-art performance between k-means and deep-learning-based methods. Our methods achieved 97.61 in ASA and 18.85 in CO on the BSDS500. Furthermore, we also conduct the experiment on the remote sensing dataset to show the generalization of our EAGNet in remote sensing fields.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote-Sensing Image Classification · Advanced Image and Video Retrieval Techniques · Advanced Image Fusion Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer Science and Technology, Jilin University, Changchun 130012, China
School of Computer Science and Engineering, Changchun University of Technology, Changchun 130012, China
References (44)
Show source-provided references
1. ESCNet: An end-to-end superpixel-enhanced change detection network for very-high-resolution remote sensing images10.1109/TNNLS.2021.3089332 ↗
2. An effective superpixel-based graph convolutional network for small waterbody extraction from remotely sensed imagery
3. Superpixel tensor model for spatial–spectral classification of remote sensing images10.1109/TGRS.2019.2892516 ↗
4. Mixture-based superpixel segmentation and classification of SAR images10.1109/LGRS.2016.2605583 ↗
5. Fast multiscale superpixel segmentation for SAR imagery
6. Superpixel segmentation for polarimetric SAR imagery using local iterative clustering
7. Lang, F., Yang, J., Yan, S., and Qin, F. (2018). Superpixel segmentation of polarimetric synthetic aperture radar (sar) images based on generalized mean shift. Remote Sens., 10.10.3390/rs10101592 ↗
8. SLIC superpixel segmentation for polarimetric SAR images
9. Superpixel segmentation of polarimetric SAR images based on integrated distance measure and entropy rate method10.1109/JSTARS.2017.2708418 ↗
10. Liu, Y., Zhang, H., Cui, Z., Lei, K., Zuo, Y., Wang, J., Hu, X., and Qiu, H. (2023). Very High Resolution Images and Superpixel-Enhanced Deep Neural Forest Promote Urban Tree Canopy Detection. Remote Sens., 15.10.3390/rs15020519 ↗
11. Superpixel segmentation using Gaussian mixture model10.1109/TIP.2018.2836306 ↗
12. Real-time superpixel segmentation by DBSCAN clustering algorithm10.1109/TIP.2016.2616302 ↗
13. Content-adaptive superpixel segmentation10.1109/TIP.2018.2810541 ↗
14. Ren, C.Y., and Reid, I. (2011). gSLIC: A Real-Time Implementation of SLIC Superpixel Segmentation, University of Oxford, Department of Engineering. Technical Report.
15. SLIC superpixels compared to state-of-the-art superpixel methods10.1109/TPAMI.2012.120 ↗
16. Achanta, R., and Susstrunk, S. (2017, January 21–26). Superpixels and polygons using simple non-iterative clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.520 ↗
17. Li, Z., and Chen, J. (2015, January 7–12). Superpixel segmentation using linear spectral clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.
18. Jampani, V., Sun, D., Liu, M.Y., Yang, M.H., and Kautz, J. (2018, January 8–14). Superpixel sampling networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_22 ↗
19. Yang, F., Sun, Q., Jin, H., and Zhou, Z. (2020, January 13–19). Superpixel segmentation with fully convolutional networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01398 ↗
20. Dollár, P., and Zitnick, C.L. (2013, January 1–8). Structured forests for fast edge detection. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.231 ↗
21. Yang, Y., and Newsam, S. (2010, January 2–5). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.10.1145/1869790.1869829 ↗
22. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhei, X., Unterthinder, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
23. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
24. Wang, W., Xie, E., Li, X., Fan, D.-P., Song, K., Liang, D., Lu, T., Luo, P., and Shao, L. (2021, January 10–17). Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00061 ↗
25. Zhang, J., Peng, H., Wu, K., Liu, M., Xiao, B., Fu, J., and Yuan, L. (2022, January 18–24). Minivit: Compressing vision transformers with weight multiplexing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01183 ↗
26. Ding, M., Xiao, B., Codella, N., Luo, P., Wang, J., and Yuan, L. (2022, January 23–27). Davit: Dual attention vision transformers. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-20053-3_5 ↗
27. Koonce, B. (2021). EfficientNet: Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization, Apress.10.1007/978-1-4842-6168-2 ↗
28. Huang, Z., Xu, W., and Yu, K. (2015). Bidirectional LSTM-CRF models for sequence tagging. arXiv.
29. Bidirectional recurrent neural networks10.1109/78.650093 ↗
30. Dey, R., and Salem, F.M. (2017, January 6–9). Gate-variants of gated recurrent unit (GRU) neural networks. Proceedings of the 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS), Boston, MA, USA.10.1109/MWSCAS.2017.8053243 ↗
31. Pham, H.X., Bozcan, I., Sarabakha, A., Haddadin, S., and Kayacan, E. (October, January 27). Gatenet: An efficient deep neural network architecture for gate perception using fish-eye camera in autonomous drone racing. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9636207 ↗
32. Li, X., Zhao, H., Han, L., Tong, Y., and Yang, K. (2019). Gff: Gated fully fusion for semantic segmentation. arXiv.
33. Global semantic consistency network for image manipulation detection10.1109/LSP.2020.3026954 ↗
34. Contour detection and hierarchical image segmentation10.1109/TPAMI.2010.161 ↗
35. Towards better exploiting convolutional neural networks for remote sensing scene classification10.1016/j.patcog.2016.07.001 ↗
36. Deep learning based feature selection for remote sensing scene classification10.1109/LGRS.2015.2475299 ↗
37. Integrating multilayer features of convolutional neural networks for remote sensing scene classification10.1109/TGRS.2017.2711275 ↗
38. Deep learning in remote sensing applications: A meta-analysis and review10.1016/j.isprsjprs.2019.04.015 ↗
39. Scattering of GPS signals from the ocean with wind remote sensing application10.1109/36.841977 ↗
40. Classification and feature extraction for remote sensing images from urban areas based on morphological transformations10.1109/TGRS.2003.814625 ↗
41. Remote sensing feature selection by kernel dependence measures10.1109/LGRS.2010.2041896 ↗
42. Ruiz, L.A., Fdez-Sarría, A., and Recio, J.A. (2004, January 12–23). Texture feature extraction for classification of remote sensing data using wavelet decomposition: A comparative study. Proceedings of the 20th ISPRS Congress, Istanbul, Turkey.
43. A review of road extraction from remote sensing images
44. Remote sensing of urban areas10.1080/01431160512331316469 ↗