journal article·2022-12-08Open access

A Topology Based Automatic Registration Method for Infrared and Polarized Coupled Imaging

Aiqi Zhong, Qiang Fu, Danfei Huang, Kang Zong, Huilin Jiang

Applied Sciences· Volume 12· Issue 24

Abstract

In multi-source camera collaborative imaging research, it is known that the differences in size and resolution of the sensor chip, the angle of view and field of view when imaging, and the imaging characteristics of optical systems between cameras, makes image registration a topic that can never be avoided in data analysis and post-processing. Additionally, lacking common features between multi-source images means that the accurate registration of multi-modal images can only be completed manually. Aiming at the registration problem of the polarization parameter image and infrared image, this study takes advantage of the invariant feature of the imaging target topology and introduces the image texture-based segmentation method to obtain the target topology structure. Subsequently, the registration control points are extracted based on the target topology skeleton, which can break through the limitation of feature differences, improve the robustness of the algorithm to target transformation, and realize the automatic registration of multi-source images.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image and Video Retrieval Techniques · Robotics and Sensor-Based Localization · Image Retrieval and Classification Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China

National and Local Joint Engineering Research Center of Space Optoelectronics Technology, Changchun University of Science and Technology, Changchun 130022, China

Key Laboratory for Physical Electronics and Devices of the Ministry of Education and Shaanxi Key Laboratory of Information Photonic Technique, Xi’an Jiaotong University, Xi’an 710049, China

Funding

Changchun University of Science and Technology, China · National Natural Science Foundation of China · National Major Research Instruments

References (30)

Show source-provided references
1. Henry, C., Poudel, S., Lee, S.-W., and Jeong, H. (2020). Automatic Detection System of Deteriorated PV Modules Using Drone with Thermal Camera. Appl. Sci., 10.10.3390/app10113802 ↗
2. Detection of pedestrians in far-infrared automotive night vision using region-growing and clothing distortion compensation10.1016/j.infrared.2010.09.006 ↗
3. An infrared maritime target detection algorithm applicable to heavy sea fog10.1016/j.infrared.2015.01.031 ↗
4. Effects of environment variation of glycerol smoke particles on the persistence of linear and circular polarization10.1364/OE.395428 ↗
5. Fu, Q., Luo, K., Song, Y., Zhang, M., Zhang, S., Zhan, J., Duan, J., and Li, Y. (2022). Study of Sea Fog Environment Polarization Transmission Characteristics. Appl. Sci., 12.10.3390/app12178892 ↗
6. The Research of Long-Optical-Path Visible Laser Polarization Characteristics in Smoke Environment
7. First results from an uncooled LWIR polarimeter for cubesat deployment
8. Santamaría, J., Rivero-Cejudo, M.L., Martos-Fernández, M.A., and Roca, F. (2020). An Overview on the Latest Nature-Inspired and Metaheuristics-Based Image Registration Algorithms. Appl. Sci., 10.10.3390/app10061928 ↗
9. The Illumination Robustness of Phase Correlation for Image Alignment
10. Nonrigid Multimodality Image Registration
11. PET-CT image registration in the chest using free-form deformations10.1109/TMI.2003.809072 ↗
12. Xinyu, Z.H.U., Ziyi, W., Guogang, C.A.O., Ying, C., Yijie, W., Mengxue, L.I., Shunkun, L.I.U., and Hongdong, M.A.O. (2020, January 18–20). Chaotic Brain Storm Optimization Algorithm in Objective Space for Medical Image Registration. Proceedings of the 2020 5th International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Okinawa, Japan.10.1109/ICIIBMS50712.2020.9336423 ↗
13. Biomedical Image Registration Using Genetic Algorithm10.1007/978-81-322-2009-1_34 ↗
14. Multiobjective Discrete Particle Swarm Optimization for Multisensor Image Alignment10.1109/LGRS.2012.2230432 ↗
15. Infrared and visual image registration based on mutual information with a combined particle swarm optimization—Powell search algorithm10.1016/j.ijleo.2015.09.199 ↗
16. Li, Y., Huang, D., Qi, J., Chen, S., Sun, H., Liu, H., and Jia, H. (2020). Feature Point Registration Model of Farmland Surface and Its Application Based on a Monocular Camera. Sensors, 20.10.3390/s20133799 ↗
17. Speeded-Up Robust Features (SURF)10.1016/j.cviu.2007.09.014 ↗
18. Harris, C.G., and Stephens, M.J. A Combined Corner and Edge Detector. Proceedings of the Proceedings of Fourth Alvey Vision Conference, Manchester, UK, 31 August–2 September 1988.
19. Faster and better: A machine learning approach to corner detection10.1109/TPAMI.2008.275 ↗
20. Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6–13). BRISK: Binary Robust invariant scalable keypoints. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126542 ↗
21. Robust Wide Baseline Stereo from Maximally Stable Extremal Regions10.1016/j.imavis.2004.02.006 ↗
22. MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration10.1016/j.media.2012.05.008 ↗
23. A Threshold Selection Method from Gray-Level Histograms10.1109/TSMC.1979.4310076 ↗
24. Gao, M., Chen, H., Zheng, S., and Fang, B. (2016, January 25–28). A factorization based active contour model for texture segmentation. Proceedings of the IEEE International Conference on Image Processing, Phoenix, AZ, USA.10.1109/ICIP.2016.7533173 ↗
25. Skeletons of planar patterns10.1016/S0923-0459(96)80013-9 ↗
26. Skeleton-Based Gait Recognition via Robust Frame-Level Matching10.1109/TIFS.2019.2901823 ↗
27. Sample Fusion Network: An End-to-End Data Augmentation Network for Skeleton-Based Human Action Recognition
28. Interactive motion mapping for real-time character control10.1111/cgf.12325 ↗
29. Latent Fingerprint Matching
30. Serra, J. (1982). Image Analysis and Mathematical Morphology, Academic Press.