journal article·2025-10-17Open access

Loop-MapNet: A Multi-Modal HDMap Perception Framework with SDMap Dynamic Evolution and Priors

Yuxuan Tang, Jie Hu, Daode Zhang, Wencai Xu, Feiyu Zhao, Xinghao Cheng

Applied Sciences· Volume 15· Issue 20

Abstract

High-definition maps (HDMaps) are critical for safe autonomy on structured roads. Yet traditional production—relying on dedicated mapping fleets and manual quality control—is costly and slow, impeding large-scale, frequent updates. Recently, standard-definition maps (SDMaps) derived from remote sensing have been adopted as priors to support HDMap perception, lowering cost but struggling with subtle urban changes and localization drift. We propose Loop-MapNet, a self-evolving, multimodal, closed-loop mapping framework. Loop-MapNet effectively leverages surround-view images, LiDAR point clouds, and SDMaps; it fuses multi-scale vision via a weighted BiFPN, and couples PointPillars BEV and SDMap topology encoders for cross-modal sensing. A Transformer-based bidirectional adaptive cross-attention aligns SDMap with online perception, enabling robust fusion under heterogeneity. We further introduce a confidence-guided masked autoencoder (CG-MAE) that leverages confidence and probabilistic distillation to both capture implicit SDMap priors and enhance the detailed representation of low-confidence HDMap regions. With spatiotemporal consistency checks, Loop-MapNet incrementally updates SDMaps to form a perception–mapping–update loop, compensating remote-sensing latency and enabling online map optimization. On nuScenes, within 120 m, Loop-MapNet attains 61.05% mIoU, surpassing the best baseline by 0.77%. Under extreme localization errors, it maintains 60.46% mIoU, improving robustness by 2.77%; CG-MAE pre-training raises accuracy in low-confidence regions by 1.72%. These results demonstrate advantages in fusion and robustness, moving beyond one-way prior injection and enabling HDMap–SDMap co-evolution for closed-loop autonomy and rapid SDMap refresh from remote sensing.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Automated Road and Building Extraction · Remote Sensing and LiDAR Applications · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Automotive Engineering, Wuhan University of Technology, Luoshi Road, Wuhan 430070, China

Hubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Luoshi Road, Wuhan 430070, China

Hubei Collaborative Innovation Center for Automotive Components Technology, Wuhan University of Technology, Luoshi Road, Wuhan 430070, China

Hubei Research Center for New Energy & Intelligent Connected Vehicle, Wuhan University of Technology, Luoshi Road, Wuhan 430070, China

School of Mechanical Engineering, Hubei University of Technology, Nanli Road, Wuhan 430068, China

Funding

Major Program (JD) of Hubei Province · Innovative Group Project of Natural Science Foundation of Hubei Province · Digital Twin System for Factory Fishery Farming System

References (46)

Show source-provided references
1. Explainable deep adversarial reinforcement learning approach for robust autonomous driving10.1109/TIV.2024.3379367 ↗
2. Path planning algorithms in the autonomous driving system: A comprehensive review10.1016/j.robot.2024.104630 ↗
3. Xiao, Z., Yang, D., Wen, T., Jiang, K., and Yan, R. (2020). Monocular localization with vector HD map (MLVHM): A low-cost method for commercial IVs. Sensors, 20.10.3390/s20071870 ↗
4. A review of high-definition map creation methods for autonomous driving10.1016/j.engappai.2023.106125 ↗
5. High definition map for automated driving: Overview and analysis10.1017/S0373463319000638 ↗
6. Tang, K., Cao, X., Cao, Z., Zhou, T., Li, E., Liu, A., Zou, S., Liu, C., Mei, S., and Sizikova, E. (2023, January 7–14). THMA: Tencent HD map AI system for creating HD map annotations. Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, Washington, DC, USA.10.1609/aaai.v37i13.26848 ↗
7. Chen, S., Zhang, Y., Liao, B., Xie, J., Cheng, T., Sui, W., Zhang, Q., Huang, C., Liu, W., and Wang, X. (2023). VMA: Divide-and-conquer vectorized map annotation system for large-scale driving scene. arXiv.
8. Road extraction in remote sensing data: A survey
9. Hierarchical graph-based segmentation for extracting road networks from high-resolution satellite images10.1016/j.isprsjprs.2017.02.008 ↗
10. Zheng, S., Wang, J., Rizos, C., Ding, W., and El-Mowafy, A. (2023). SLAM for autonomous driving: Concept and analysis. Remote Sens., 15.10.3390/rs15041156 ↗
11. Batra, A., Singh, S., Pang, G., Basu, S., Jawahar, C., and Paluri, M. (2019, January 15–20). Improved road connectivity by joint learning of orientation and segmentation. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.01063 ↗
12. Li, J., Jia, P., Chen, J., Liu, J., He, L., and Li, K. (2024). Local Map Construction with SDMap: A Comprehensive Survey. arXiv.
13. Jiang, Z., Zhu, Z., Li, P., Gao, H.-A., Yuan, T., Shi, Y., Zhao, H., and Zhao, H. (2024). P-MapNet: Far-seeing map generator enhanced by both SDMap and HDMap priors. IEEE Robot. Autom. Lett.10.1109/LRA.2024.3447450 ↗
14. Multi-sensor fusion and cooperative perception for autonomous driving: A review
15. Liao, B., Chen, S., Wang, X., Cheng, T., Zhang, Q., Liu, W., and Huang, C. (2022). MapTR: Structured modeling and learning for online vectorized HD map construction. arXiv.
16. HDMapNet: An Online HD Map Construction and Evaluation Framework
17. Wu, H., Zhang, Z., Lin, S., Qin, T., Pan, J., Zhao, Q., Xu, C., and Yang, M. (2024, January 2–5). BLOS-BEV: Navigation map enhanced lane segmentation network, beyond line of sight. Proceedings of the 2024 IEEE Intelligent Vehicles Symposium (IV), Jeju Island, Republic of Korea.10.1109/IV55156.2024.10588482 ↗
18. MapTRv2: An end-to-end framework for online vectorized HD map construction10.1007/s11263-024-02235-z ↗
19. High-definition maps construction based on visual sensor: A comprehensive survey10.1109/TIV.2023.3336940 ↗
20. Zhu, X., Cao, X., Dong, Z., Zhou, C., Liu, Q., Li, W., and Wang, Y. (2023). NeMo: Neural map growing system for spatiotemporal fusion in bird’s-eye view and BDD-Map benchmark. arXiv.
21. Liu, Y., Yuan, T., Wang, Y., Wang, Y., and Zhao, H. (2023, January 23–29). VectorMapNet: End-to-end vectorized HD map learning. Proceedings of the 2023 International Conference on Machine Learning, Honolulu, HI, USA.
22. SuperFusion: A versatile image registration and fusion network with semantic awareness10.1109/JAS.2022.106082 ↗
23. Bastani, F., He, S., Abbar, S., Alizadeh, M., Balakrishnan, H., Chawla, S., Madden, S., and DeWitt, D. (2018, January 18–23). RoadTracer: Automatic extraction of road networks from aerial images. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00496 ↗
24. He, S., Bastani, F., Jagwani, S., Alizadeh, M., Balakrishnan, H., Chawla, S., Elshrif, M.M., Madden, S., and Sadeghi, A. (2020, January 23–28). Sat2Graph: Road graph extraction through graph-tensor encoding. Proceedings of the Computer Vision—ECCV 2020: 16th European Conference, Glasgow, UK.10.1007/978-3-030-58586-0_4 ↗
25. Van Etten, A., Lindenbaum, D., and Bacastow, T.M. (2018). SpaceNet: A remote sensing dataset and challenge series. arXiv.
26. Opportunities and challenges of foundation models for GeoAI
27. Qin, T., Zheng, Y., Chen, T., Chen, Y., and Su, Q. (June, January 30). A light-weight semantic map for visual localization towards autonomous driving. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China.10.1109/ICRA48506.2021.9561663 ↗
28. Chen, W., Shang, G., Ji, A., Zhou, C., Wang, X., Xu, C., Li, Z., and Hu, K. (2022). An overview on visual SLAM: From tradition to semantic. Remote Sens., 14.10.3390/rs14133010 ↗
29. The SLAM: An overview
30. Mooney, P., and Minghini, M. (2017). A review of OpenStreetMap data. Mapping and the Citizen Sensor, Ubiquity Press.
31. Zhang, H., Paz, D., Guo, Y., Das, A., Huang, X., Haug, K., Christensen, H.I., and Ren, L. (2024, January 14–18). Enhancing online road network perception and reasoning with standard definition maps. Proceedings of the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Abu Dhabi, United Arab Emirates.10.1109/IROS58592.2024.10801423 ↗
32. Plachetka, C., Maier, N., Fricke, J., Termohlen, J.-A., and Fingscheidt, T. (November, January 19). Terminology and analysis of map deviations in urban domains. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.10.1109/IV47402.2020.9304580 ↗
33. Xu, H., Xiao, Y., Li, W., and Hu, Y. (2025, January 22–25). Generating Synthetic Deviation Maps for Prior-Enhanced Vectorized HD Map Construction. Proceedings of the 2025 IEEE Intelligent Vehicles Symposium (IV), Cluj-Napoca, Romania.10.1109/IV64158.2025.11097394 ↗
34. Biagioni, J., and Eriksson, J. (2012, January 6–9). Map inference in the face of noise and disparity. Proceedings of the SIGSPATIAL ’12: Proceedings of the 20th International Conference on Advances in Geographic Information Systems, Redondo Beach, CA, USA.10.1145/2424321.2424333 ↗
35. Zhang, M., Zhang, Y., Zhang, L., Liu, C., and Khurshid, S. (2018, January 3–7). DeepRoad: GAN-based metamorphic testing and input validation for ADS. Proceedings of the 2018 33rd IEEE/ACM International Conference on Automated Software Engineering (ASE), Montpellier, France.10.1145/3238147.3238187 ↗
36. Xia, D., Zhang, W., Liu, X., Zhang, W., Gong, C., Tan, X., Huang, J., Yang, M., and Yang, D. (2025). LDMapNet-U: An End-to-End System for City-Scale Lane-Level Map Updating. arXiv.10.1145/3690624.3709383 ↗
37. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). EfficientDet: Scalable and efficient object detection. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
38. Philion, J., and Fidler, S. (2020, January 23–28). Lift, Splat, Shoot: Encoding images by implicitly unprojecting to 3D. Proceedings of the Computer Vision—ECCV 2020: 16th European Conference, Glasgow, UK.10.1007/978-3-030-58568-6_12 ↗
39. Koonce, B. (2021). EfficientNet. CNNs with Swift for TensorFlow, Apress.10.1007/978-1-4842-6168-2_10 ↗
40. Stereo inverse perspective mapping: Theory and applications10.1016/S0262-8856(97)00093-0 ↗
41. Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019, January 15–20). PointPillars: Fast encoders for object detection from point clouds. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.01298 ↗
42. Qi, C.R., Su, H., Mo, K., and Guibas, J.L. (2017, January 21–26). Guibas PointNet: Deep learning on point sets. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
43. Huang, J., Huang, G., Zhu, Z., Ye, Y., and Du, D. (2021). BEVDet: High-performance multi-camera 3D object detection in BEV. arXiv.
44. Targ, S., Almeida, D., and Lyman, K. (2016). ResNet in ResNet: Generalizing residual architectures. arXiv.
45. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
46. He, K., Chen, X., Xie, S., Li, Y., Dollar, P., and Girshick, R. (2022, January 18–24). Masked autoencoders are scalable vision learners. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01553 ↗