journal article·2025Open access

CerfeVPR: Cross-Environment Robust Feature Enhancement for Visual Place Recognition

Lingyun Xiang, Hang Fu, Chunfang Yang

Computers, Materials & Continua· Volume 84· Issue 1

Abstract

In the Visual Place Recognition (VPR) task, existing research has leveraged large-scale pre-trained models to improve the performance of place recognition. However, when there are significant environmental differences between query images and reference images, a large number of ineffective local features will interfere with the extraction of key landmark features, leading to the retrieval of visually similar but geographically different images. To address this perceptual aliasing problem caused by environmental condition changes, we propose a novel Visual Place Recognition method with Cross-Environment Robust Feature Enhancement (CerfeVPR). This method uses the GAN network to generate similar images of the original images under different environmental conditions, thereby enhancing the learning of robust features of the original images. This enables the global descriptor to effectively ignore appearance changes caused by environmental factors such as seasons and lighting, showing better place recognition accuracy than other methods. Meanwhile, we introduce a large kernel convolution adapter to fine tune the pre-trained model, obtaining a better image feature representation for subsequent robust feature learning. Then, we process the information of different local regions in the general features through a 3-layer pyramid scene parsing network and fuse it with a tag that retains global information to construct a multi-dimensional image feature representation. Based on this, we use the fused features of similar images to drive the robust feature learning of the original images and complete the feature matching between query images and retrieved images. Experiments on multiple commonly used datasets show that our method exhibits excellent performance. On average, CerfeVPR achieves the highest results, with all Recall@N values exceeding 90%. In particular, on the highly challenging Nordland dataset, the R@1 metric is improved by 4.6%, significantly outperforming other methods, which fully verifies the superiority of CerfeVPR in visual place recognition under complex environments.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (42)

Show source-provided references
1. Rethinking visual geo-localization for large-scale applications
2. Unifying deep local and global features for image search
3. A survey on deep visual place recognition10.1109/ACCESS.2021.3054937 ↗
4. Aggregating local descriptors into a compact image representation
5. On the performance of ConvNet features for place recognition
6. Convolutional neural network-based place recognition
7. Convolutional neural network-based image representation for visual loop closure detection
8. MixVPR: feature mixing for visual place recognition
9. EigenPlaces: training viewpoint robust models for visual place recognition
10. Patch-NetVLAD: multi-scale fusion of locally-global descriptors for place recognition
11. TransVPR: transformer-based place recognition with multi-level attention aggregation
12. NetVLAD: CNN architecture for weakly supervised place recognition10.1109/TPAMI.2017.2711011 ↗
13. Fine-tuning CNN image retrieval with no human annotation10.1109/TPAMI.2018.2846566 ↗
14. AnyLoc: towards universal visual place recognition10.1109/LRA.2023.3343602 ↗
15. Optimal transport aggregation for visual place recognition
16. CricaVPR: cross-image correlation-aware representation learning for visual place recognition
17. Parameter-efficient transfer learning for NLP
18. AdaptFormer: adapting vision transformers for scalable visual recognition
19. Multiple riemannian kernel hashing for large-scale image set classification and retrieval10.1109/TIP.2024.3419414 ↗
20. Generative adversarial networks10.1145/3422622 ↗
21. A real-time semantic segmentation method based on transformer for autonomous driving
22. Self-supervising fine-grained region similarities for large-scale image localization
23. Gsv-cities: toward appropriate supervised visual place recognition10.1016/j.neucom.2022.09.127 ↗
24. R2Former: unified retrieval and reranking transformer for place recognition
25. Deep homography estimation for visual place recognition
26. PlaceFormer: transformer-based visual place recognition using multi-scale patch selection and fusion10.1109/LRA.2024.3408075 ↗
27. Towards seamless adaptation of pre-trained models for visual place recognition
28. Oquab M, Darcet T, Moutakanni T, Vo H, Szafraniec M, Khalidov V, et al. Dinov2: learning robust visual features without supervision. arXiv:230407193. 2023.
29. Singan: learning a generative model from a single natural image
30. Unpaired image-to-image translation using cycle-consistent adversarial networks
31. Coverless image steganography based on generative adversarial network10.3390/math8091394 ↗
32. Robust and privacy-preserving feature extractor for perturbed images10.1016/j.patcog.2024.111202 ↗
33. A novel copy-move detection and location technique based on tamper detection and similarity feature fusion10.1504/IJAACS.2024.142523 ↗
34. Training region-based object detectors with online hard example mining
35. Multi-similarity loss with general pair weighting for deep metric learning
36. Mapillary street-level sequences: a dataset for lifelong place recognition
37. Visual place recognition with repetitive structures
38. Are we there yet? Challenging SeqSLAM on a 3000 km journey across all four seasons
39. Deep learning features at scale for visual place recognition
40. Adaptive-attentive geolocalization from few queries: a hybrid approach
41. Deep visual geo-localization benchmark
42. VPR-bench: an open-source visual place recognition evaluation framework with quantifiable viewpoint and appearance change10.1007/s11263-021-01469-5 ↗