Feature Point Matching Method Based on Consistent Edge Structures for Infrared and Visible Images
Source abstract
Abstract
Infrared and visible image match is an important research topic in the field of multi-modality image processing. Due to the difference of image contents like pixel intensities and gradients caused by disparate spectrums, it is a great challenge for infrared and visible image match in terms of the detection repeatability and the matching accuracy. To improve the matching performance, a feature detection and description method based on consistent edge structures of images (DDCE) is proposed in this paper. First, consistent edge structures are detected to obtain similar contents of infrared and visible images. Second, common feature points of infrared and visible images are extracted based on the consistent edge structures. Third, feature descriptions are established according to the edge structure attributes including edge length and edge orientation. Lastly, feature correspondences are calculated according to the distance of feature descriptions. Due to the utilization of consistent edge structures of infrared and visible images, the proposed DDCE method can improve the detection repeatability and the matching accuracy. DDCE is evaluated on two public datasets and are compared with several state-of-the-art methods. Experimental results demonstrate that DDCE can achieve superior performance against other methods for infrared and visible image match.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image and Video Retrieval Techniques · Infrared Target Detection Methodologies · Medical Image Segmentation Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Dalian University of Technology, No. 2 Linggong Road, Dalian 116024, China
Information Engineering College, Henan University of Science and Technology, No.263 Kaiyuan Avenue, Luoyang 471023, China
Funding
National Major Special Funding Project · 13th Five-Year Major Special Funding Project
References (44)
Show source-provided references
1. Morris, N.J.W., Avidan, S., and Matusik, W. (2007, January 17–22). Statistics of Infrared Images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383003 ↗
2. Abbas, A.K., and Leonhardt, S. (2014). Intelligent neonatal monitoring based on a virtual thermal sensor. BMC Med. Imaging, 14.10.1186/1471-2342-14-9 ↗
3. Beauvisage, A., Aouf, N., and Courtois, H. (2016, January 9–12). Multi-Spectral Visual Odometry for Unmanned Air Vehicles. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Budapest, Hungary.10.1109/SMC.2016.7844533 ↗
4. Khattak, S., Papachristos, C., and Alexis, K. (2019, January 2–8). Visual-Thermal Landmarks and Inertial Fusion for Navigation in Degraded Visual Environments. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.10.1109/AERO.2019.8741787 ↗
5. A Coarse-to-Fine Matching Algorithm for FLIR and Optical Satellite Image Registration10.1109/LGRS.2011.2176102 ↗
6. Vural, M.F., Yardimci, Y., and Temlzel, A. (2009, January 12–17). Registration of Multispectral Satellite Images with Orientation-Restricted SIFT. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa.10.1109/IGARSS.2009.5417801 ↗
7. Infrared and Visible Images Registration with Adaptable Local-global Feature Integration for Rail Inspection10.1016/j.infrared.2017.09.013 ↗
8. Zhao, B., Xu, T., Chen, Y., Li, T., and Sun, X. (2019). Automatic and Robust Infrared-Visible Image Sequence Registration via Spatio-Temporal Association. Sensors, 19.10.3390/s19050997 ↗
9. Schonberger, J.L., Hardmeier, H., and Sattler, T. (2017, January 21–26). Comparative Evaluation of Hand-crafted and Learned Local Features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.736 ↗
10. Kelman, A., Sofka, M., and Stewart, C.V. (2007, January 17–22). Keypoint Descriptors for Matching across Multiple Image Modalities and Non-linear Intensity Variations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.10.1109/CVPR.2007.383426 ↗
11. A Local Descriptor based Registration Method for Multispectral Remote Sensing Images with Non-linear Intensity Differences10.1016/j.isprsjprs.2014.01.009 ↗
12. Robust Registration of Multimodal Remote Sensing Images based on Structural Similarity10.1109/TGRS.2017.2656380 ↗
13. Distinctive Image Features from Scale-invariant Key-points10.1023/B:VISI.0000029664.99615.94 ↗
14. Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6–13). ORB: An Efficient Alternative to SIFT or SURF. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126544 ↗
15. Yi, K.M., Trulls, E., Lepetit, V., and Fua, P. (2016, January 11–14). Lift: Learned Invariant Feature transform. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46466-4_28 ↗
16. DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18–22). Superpoint: Self-supervised Interest Point Detection and Description. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00060 ↗
17. Feature Points for Multi-sensor Images10.1016/j.compeleceng.2017.04.032 ↗
18. LPPCO: A Novel Multimodal Medical Image Registration Using New Feature Descriptor Based on the Local Phase and Phase Congruency of Different Orientations10.1109/ACCESS.2018.2874023 ↗
19. Fu, Z., Qin, Q., Luo, B., Sun, H., and Wu, C. (2018). HOMPC: A Local Feature Descriptor Based on the Combination of Magnitude and Phase Congruency Information for Multi-Sensor Remote Sensing Images. Remote Sens., 10.10.3390/rs10081234 ↗
20. Robust and Fast Registration of Infrared and Visible Images for Electro-Optical Pod10.1109/TIE.2018.2833051 ↗
21. Real-time Multi-Modal Rigid Registration based on a Novel Symmetric-SIFT Descriptor10.1016/j.pnsc.2008.06.029 ↗
22. Rapid Multimodality Registration based on MM-SURF10.1016/j.neucom.2013.10.037 ↗
23. A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration10.1109/TBME.2010.2042169 ↗
24. A Robust Sift Descriptor for Multispectral Images10.1109/LSP.2014.2304073 ↗
25. Towards Feature Points based Image Matching between Satellite Imagery and Aerial Photographs of Agriculture land10.1016/j.compag.2016.05.005 ↗
26. Zeng, Q., Adu, J., Liu, J., Yang, J., Xu, Y., and Gong, M. (2019). Real-time Adaptive Visible and Infrared Image Registration based on Morphological Gradient and C_SIFT. J. Real Time Image Process.10.1007/s11554-019-00858-x ↗
27. Multispectral Image Feature Points10.3390/s120912661 ↗
28. Mouats, T., and Aouf, N. (2013, January 9–12). Multimodal Stereo Correspondence based on Phase Congruency and Edge Histogram Descriptor. Proceedings of the IEEE Proceedings of the 16th International Conference on Information Fusion, Istanbul, Turkey.
29. A Local Feature Descriptor based on Combination of Structure and Texture Information for Multispectral Image Matching10.1109/LGRS.2018.2867635 ↗
30. Ma, T., Ma, J., and Yu, K. (2019). A Local Feature Descriptor Based on Oriented Structure Maps with Guided Filtering for Multispectral Remote Sensing Image Matching. Remote Sens., 11.10.3390/rs11080951 ↗
31. Aguilera, C.A., Sappa, A.D., and Toledo, R. (2015, January 27–30). LGHD: A Feature Descriptor for Matching across Non-linear Intensity Variations. Proceedings of the IEEE International Conference on Image Processing, Quebec City, QC, Canada.10.1109/ICIP.2015.7350783 ↗
32. A Local Feature Descriptor based on Log-Gabor Filters for Keypoint Matching in Multispectral Images10.1109/LGRS.2017.2738632 ↗
33. Robust Visible-Infrared Image Matching by Exploiting Dominant Edge Orientations10.1016/j.patrec.2018.10.036 ↗
34. Li, J., Hu, Q., and Ai, M. (2018). RIFT: Multi-modal Image Matching Based on Radiation-Invariant Feature Transform. arXiv.
35. Liu, X., Ai, Y., Zhang, J., and Wang, Z. (2018). A Novel Affine and Contrast Invariant Descriptor for Infrared and Visible Image Registration. Remote Sens., 10.10.3390/rs10040658 ↗
36. Establishing Keypoint Matches on Multimodal Images with Bootstrap Strategy and Global Information10.1109/TIP.2017.2695885 ↗
37. Simplest Color Balance10.5201/ipol.2011.llmps-scb ↗
38. Laganière, R. (2017). OpenCV 3 Computer Vision Application Programming Cookbook, Packt Publishing Ltd.
39. A computational approach to edge detection10.1109/TPAMI.1986.4767851 ↗
40. A statistics-based approach to binary image registration with uncertainty analysis10.1109/TPAMI.2007.250603 ↗
41. Harris, C.G., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the 4th Alvey Vision Conference, Manchester, UK.
42. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognitio, San Diego, CA, USA.
43. Multimodal Image Matching based on Multimodality Robust Line Segment Descriptor10.1016/j.neucom.2015.11.025 ↗
44. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography10.1145/358669.358692 ↗