journal article·2023-12-29Open access

A High-Quality Hybrid Mapping Model Based on Averaging Dense Sampling Parameters

Fanxiao Yi, Weishi Li, Mengjie Huang, Yingchang Du, Lei Ye

Applied Sciences· Volume 14· Issue 1

Abstract

Navigation map generation based on remote sensing images is crucial in fields such as autonomous driving and geographic surveying. Style transfer is an effective method for obtaining a navigation map of the current environment. However, there is lack of robustness of the map-style transfer model, resulting in unsatisfactory quality of the generated navigation maps. To address these challenges, we average the parameters of generators sampled from different iterations with a dense sampling strategy in the Generative Adversarial Network (CycleGAN). The results demonstrate that the training efficiency of our method on the MNIST and generation quality on the Google Map dataset are significantly superior to traditional style transfer methods. Moreover, it performs well in multi-environment hybrid mapping. Our method improves the generalization ability of the model and converts existing navigation maps to other styles of maps precisely. It can better adapt to different types of urban layout and road planning, bringing innovative solutions for traffic management and navigation systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image and Video Retrieval Techniques · Automated Road and Building Extraction · Remote Sensing and LiDAR Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, China

References (47)

Show source-provided references
1. Huang, C., Mees, O., Zeng, A., and Burgard, W. (June, January 29). Visual language maps for robot navigation. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.10.1109/ICRA48891.2023.10160969 ↗
2. Huang, C., Mees, O., Zeng, A., and Burgard, W. (2023). Audio visual language maps for robot navigation. arXiv.10.1109/ICRA48891.2023.10160969 ↗
3. Research on the construction of a BIM-based model for cross-floor indoor navigation maps10.1201/9781003344209-49 ↗
4. A survey of deep learning techniques for autonomous driving10.1002/rob.21918 ↗
5. Jiang, Z., Zhang, X., and Wang, P. (2023). Grid-Map-Based Path Planning and Task Assignment for Multi-Type AGVs in a Distribution Warehouse. Mathematics, 11.10.3390/math11132802 ↗
6. Construction of brain area risk map for decision making using surgical navigation and motor evoked potential monitoring information10.1007/s11548-022-02752-7 ↗
7. Robot indoor navigation point cloud map generation algorithm based on visual sensing
8. Designing obstacle’s map of an unknown place using autonomous drone navigation and web services10.1108/IJPCC-07-2020-0085 ↗
9. Deep learning in remote sensing applications: A meta-analysis and review10.1016/j.isprsjprs.2019.04.015 ↗
10. Salvo, C., and Vitale, A. (2023). A Remote Sensing Method to Assess the Future Multi-Hazard Exposure of Urban Areas. Remote Sens., 15.10.3390/rs15174288 ↗
11. Wang, L., Gao, R., Li, C., Wang, J., Liu, Y., Hu, J., Li, B., Qiao, H., Feng, H., and Yue, J. (2023). Mapping Soybean Maturity and Biochemical Traits Using UAV-Based Hyperspectral Images. Remote Sens., 15.10.3390/rs15194807 ↗
12. Neural style transfer: A review10.1109/TVCG.2019.2921336 ↗
13. Wang, P., Li, Y., and Vasconcelos, N. (2021, January 20–25). Rethinking and improving the robustness of image style transfer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00019 ↗
14. Ayyalasomayajula, R., Arun, A., Wu, C., Sharma, S., Sethi, A.R., Vasisht, D., and Bharadia, D. (2020, January 21–25). Deep learning based wireless localization for indoor navigation. Proceedings of the 26th Annual International Conference on Mobile Computing and Networking, London, UK.10.1145/3372224.3380894 ↗
15. High-level interpretation of urban road maps fusing deep learning-based pixelwise scene segmentation and digital navigation maps
16. Golroudbari, A.A., and Sabour, M.H. (2023). Recent Advancements in Deep Learning Applications and Methods for Autonomous Navigation–A Comprehensive Review. arXiv.10.22541/au.168664884.43899660/v1 ↗
17. Lee, Y.W., Kim, J.S., and Park, K.R. (2022). Ocular Biometrics with Low-Resolution Images Based on Ocular Super-Resolution CycleGAN. Mathematics, 10.10.3390/math10203818 ↗
18. Xu, C., Shu, J., and Zhu, G. (2023). Multi-Feature Dynamic Fusion Cross-Domain Scene Classification Model Based on Lie Group Space. Remote Sens., 15.10.3390/rs15194790 ↗
19. Model fusion via optimal transport
20. Swad: Domain generalization by seeking flat minima
21. Deep learning in multimodal remote sensing data fusion: A comprehensive review
22. A review of remote sensing image fusion methods10.1016/j.inffus.2016.03.003 ↗
23. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
24. Texture synthesis using convolutional neural networks
25. Gatys, L.A., Ecker, A.S., and Bethge, M. (July, January 26). Image style transfer using convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
26. Johnson, J., Alahi, A., and Fei-Fei, L. (2016). Proceedings of the Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, 11–14 October 2016, Springer. Proceedings, Part II 14.
27. Luan, F., Paris, S., Shechtman, E., and Bala, K. (2017, January 21–26). Deep photo style transfer. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.740 ↗
28. Universal style transfer via feature transforms
29. Li, Y., Liu, M.Y., Li, X., Yang, M.H., and Kautz, J. (2018, January 8–14). A closed-form solution to photorealistic image stylization. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01219-9_28 ↗
30. Yoo, J., Uh, Y., Chun, S., Kang, B., and Ha, J.W. (November, January 27). Photorealistic style transfer via wavelet transforms. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
31. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
32. Li, B., Li, P., Liu, B., and Li, M. (2023). A High-Precision Underwater Target Detection Method Based on Cascade Neural Network and Edge Computing. (CN116758406A).
33. Izmailov, P., Podoprikhin, D., Garipov, T., Vetrov, D., and Wilson, A.G. (2018). Averaging weights leads to wider optima and better generalization. arXiv.
34. Son, D.M., Kwon, H.J., and Lee, S.H. (2023). Enhanced Night-to-Day Image Conversion Using CycleGAN-Based Base-Detail Paired Training. Mathematics, 11.10.3390/math11143102 ↗
35. Krstanović, L., Popović, B., Janev, M., and Brkljač, B. (2023). Feature Map Regularized CycleGAN for Domain Transfer. Mathematics, 11.10.3390/math11020372 ↗
36. Chen, H., Lundberg, S., and Lee, S.I. (2017). Checkpoint ensembles: Ensemble methods from a single training process. arXiv.
37. Guo, H., Jin, J., and Liu, B. (2023). Stochastic weight averaging revisited. Appl. Sci., 13.10.3390/app13052935 ↗
38. Loss surfaces, mode connectivity, and fast ensembling of dnns
39. Huang, G., Li, Y., Pleiss, G., Liu, Z., Hopcroft, J.E., and Weinberger, K.Q. (2017). Snapshot ensembles: Train 1, get m for free. arXiv.
40. Neklyudov, K., Molchanov, D., Ashukha, A., and Vetrov, D. (2018). Variance networks: When expectation does not meet your expectations. arXiv.
41. Mandt, S., Hoffman, M.D., and Blei, D.M. (2017). Stochastic gradient descent as approximate bayesian inference. arXiv.
42. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
43. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
44. A stochastic approximation method10.1214/aoms/1177729586 ↗
45. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
46. Quality assessment method for GAN based on modified metrics inception score and Fréchet inception distance10.1007/978-3-030-63322-6_8 ↗
47. Chong, M.J., and Forsyth, D. (2020, January 13–19). Effectively unbiased fid and inception score and where to find them. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00611 ↗