journal article·2022-12-11Open access

Review of Target Geo-Location Algorithms for Aerial Remote Sensing Cameras without Control Points

Yiming Cai, Yao Zhou, Hongwen Zhang, Yuli Xia, Peng Qiao, Junsuo Zhao

Applied Sciences· Volume 12· Issue 24

Abstract

Aerial cameras are one of the main devices for obtaining ground images in the air. Since the industrial community sets higher requirements of aerial cameras’ self-locating performance yearly using aerial cameras to locate ground targets has become a research hotspot in recent years. Based on the situation that no ground control point exists in target areas, the calculation principle of the aerial remote sensing image positioning algorithm has been analyzed by establishing different positioning models. Several error analysis models of the positioning algorithm based on the total differential method and the Monte Carlo method are established, and relevant factors that cause the positioning error are summarized. The last section proposes the optimization direction of aerial camera positioning algorithms in the future, which are verified by related simulation experiments. This paper provides a certain degree of guidelines in this area for researchers, who can quickly understand the current development and optimization direction of target geo-location algorithms of aerial remote sensing imagery.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Satellite Image Processing and Photogrammetry · Robotics and Sensor-Based Localization · Remote Sensing and LiDAR Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Space-Based Integrated Information System, Institute of Software, Chinese Academy of Sciences, Beijing 100190, China

Changchun Institute of Optics, Precision Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China

Funding

National Natural Science Foundation of China

References (100+)

Show source-provided references
1. Sun, H., Jia, H., Wang, L., Xu, F., and Liu, J. (2021). Systematic Error Correction for Geo-Location of Airborne Optoelectronic Platforms. Appl. Sci., 11.10.3390/app112211067 ↗
2. Yamamoto, Y., Ichii, K., Higuchi, A., and Takenaka, H. (2020). Geolocation Accuracy Assessment of Himawari-8/AHI Imagery for Application to Terrestrial Monitoring. Remote Sens., 12.10.3390/rs12091372 ↗
3. Dual spectral band reconnaissance systems for multiple platform10.1117/12.458855 ↗
4. RAPTOR (DB-110) reconnaissance system: In operation10.1117/12.454651 ↗
5. Two-step calibration method for extrinsic parameters of an airborne camera10.1364/AO.412305 ↗
6. Camera Calibration for Long-Distance Photogrammetry Using Unmanned Aerial Vehicles
7. Unmanned aerial remote sensing of coastal vegetation: A review10.1080/19475683.2022.2026476 ↗
8. He, F., Zhou, T., Xiong, W., Hasheminnasab, S.M., and Habib, A. (2018). Automated Aerial Triangulation for UAV-Based Mapping. Remote Sens., 10.10.3390/rs10121952 ↗
9. Vision-based real-time target localization for single-antenna GPS-guided UAV10.1109/TAES.2008.4667717 ↗
10. Cheng, X., Daqiang, H., and Wei, H. (2015, January 3–5). High Precision Passive Target Localization Based on Airborne Electro-optical Payload. Proceedings of the 14th International Conference on Optical Communications and Networks(ICOCN), Nanjing, China.
11. Application of GPS-supported aerotriangulation in large scale
12. Stich, E.J. (2013, January 12–14). Geo-pointing and threat location techniques for airborne border surveillance. Proceedings of the IEEE International Conference on Technologies for Homeland Security, Waltham, MA, USA.10.1109/THS.2013.6698989 ↗
13. Held, K.J., and Robinson, B.H. (1997, January 13). TIER II Plus airborne EO sensor LOS control and image geolocation. Proceedings of the 1997 IEEE Aerospace Conference, Snowmass, CO, USA.10.1109/AERO.1997.577989 ↗
14. Multi-targets real-time location technology for UAV reconnaissance
15. Wang, X., Liu, J., and Zhou, Q. (2017). Real-Time Multi-Target Localization from Unmanned Aerial Vehicles. Sensors, 17.10.3390/s17010033 ↗
16. Aerial Camera Geo-location Method Based on POS System10.3788/gzxb20184704.0412001 ↗
17. Geo-Location Al-grithm for TDI-CCD Aerial Panoramic Camera
18. Target positioning of UAV airborne optoelectronic platform based on nonlinear least squares
19. A Fast Algorithm for High Accuracy Airborne SAR Geolocation Based on Local Linear Approximation
20. Background-Free Ground Moving Target Imaging for Multi-PRF Airborne SAR10.1109/TGRS.2018.2870299 ↗
21. Ground slowly moving target detection and velocity estimation via high-speed platform dual-beam synthetic aperture radar10.1117/1.JRS.13.026516 ↗
22. Multiple-target localization based on electro-optical measurement platform
23. Jin, M., Bai, Y., Devys, E., and Di, L. (2020). Toward a Standardized Encoding of Remote Sensing Geo-Positioning Sensor Models. Remote Sens., 12.10.3390/rs12091530 ↗
24. Hao, R.X. (2014). Research on the Method of Localization Of Target Based on Laser Ranging Technology. [Master’s Thesis, Xi’an Technological University].
25. Target geo-location based on laser range finder for Airborne electro-optical imaging systems
26. Tan, L.G. (2012). Research of Target Automatic Positioning Technology in Airborne Photo-electricity Survey Equipment. Ph.D. Thesis, Changchun Institute Of Optics, Fine Mehcanics and Physics: Changchun, China, Chinese Academy of Sciences.
27. Merkle, N., Luo, W., Auer, S., Müller, R., and Urtasun, R. (2017). Exploiting Deep Matching and SAR Data for the Geo-Localization Accuracy Improvement of Optical Satellite Images. Remote Sens., 9.10.3390/rs9060586 ↗
28. Upadhyay, J., Rawat, A., and Deb, D. (2021). Multiple Drone Navigation and Formation Using Selective Target Tracking-Based Computer Vision. Electronics, 10.10.3390/electronics10172125 ↗
29. Method of passive location based on multi-platform collaborative detection by airborne infrared equipment10.5768/JAO202142.0301003 ↗
30. Geo-location for Ground Target with Multiple Observations Using Unmanned Aerial Vehicle
31. Vision-aware air-ground cooperative target localization for UAV and UGV10.1016/j.ast.2022.107525 ↗
32. Multi-UAV Cooperative Localization for Marine Targets Based on Weighted Subspace Fitting in SAGIN Environment10.1109/JIOT.2021.3066504 ↗
33. Multi-UAV cooper ative target positioning method based on distance meas-urement10.1051/jnwpu/20193720266 ↗
34. Qu, Y., Wu, J., and Zhang, Y. (2013). Cooperative localization based on the azimuth angles among multiple UAVs. International Conference on Unmanned Aircraft Systems, IEEE.10.1109/ICUAS.2013.6564765 ↗
35. Bai, G., Liu, J., Song, Y., and Zuo, Y. (2017). Two-UAV Intersection Localization System Based on the Airborne Optoelectronic Platform. Sensors, 17.10.3390/s17010098 ↗
36. An Improved Method for Two-UAV Trajectory Planning for Cooperative Target Locating Based on Airborne Visual Tracking Platform10.1587/transinf.2020EDL8139 ↗
37. Cooperative localization between small UAVs using a combination of heterogeneous sensors10.1016/j.ast.2012.07.002 ↗
38. Xiang, H.T. (2015). Double UAV cooperative localization and remote location error analysis. 5th International Conference on Advanced Design and Manufacturing Engineering (ICADME), Atlantis Press.
39. Target location of unmanned aerial vehicles based on the electro-optical stabilization and tracking platform10.1016/j.measurement.2019.07.076 ↗
40. Target Location Based on Stereo Imaging of Airborne Electro-Optical Camera10.3788/AOS201939.1112003 ↗
41. Development of UAV-Based Target Tracking and Recognition Systems10.1109/TITS.2019.2927838 ↗
42. Zhou, X., Chen, Y., Liu, Y., and Hu, J. (2021, January 27–31). A Novel Sensor Fusion Method Based on Invariant Extended Kalman Filter for Unmanned Aerial Vehicle. Proceedings of the 2021 IEEE International Conference on Robotics and Biomimetics (ROBIO), Sanya, China.10.1109/ROBIO54168.2021.9739235 ↗
43. Zhang, X., Yuan, G., Zhang, H., Qiao, C., Liu, Z., Ding, Y., and Liu, C. (2022). Precise Target Geo-Location of Long-Range Oblique Reconnaissance System for UAVs. Sensors, 22.10.3390/s22051903 ↗
44. Small Un manned Aerial Vehicle Target Location Method Based on Iterative Unscented Kalman Filtering
45. Gao, F., Ma, X., and Gu, J. (2014, January 2–5). An active target localization with monocular vision. Proceedings of the IEEE International Conference on Control & Automation, Gwangju, Republic of Korea.10.1109/ICCA.2014.6871125 ↗
46. Pricise target geolocation based on integeration of thermal video imagery and rtk GPS in UAVS10.5194/isprsarchives-XL-1-W5-333-2015 ↗
47. Pricise target geolocation and tracking based on UAV video imagery10.5194/isprs-archives-XLI-B6-243-2016 ↗
48. Vision-based Target Geo-location using a Fixed-wing Miniature Air Vehicle10.1007/s10846-006-9088-7 ↗
49. Helgesen, H.H., Leira, F.S., Johansen, T.A., and Fossen, T.I. (2017). Detection and Tracking of Floating Objects Using a UAV with Thermal Camera, Springer International Publishing AG 2017.10.1007/978-3-319-55372-6_14 ↗
50. Target orientation meas uring of airborne EO platform
51. Error analysis Of tar-get automatic positioning for airborne photoelectric Meas-uring device10.3788/OPE.20132112.3133 ↗
52. Liu, C., Liu, J., Song, Y., and Liang, H.A. (2017). Novel Sys-tem for Correction of Relative Angular Displacement be-tween Airborne Platform and UAV in Target Localization. Sensors, 17.10.3390/s17030510 ↗
53. Target localization and error analysis of air borne electro-optical platform
54. Wu, J., Xu, Y., Zhong, X., Sun, Z., and Yang, J. (2017). A Three-Dimensional Localization Method for Multistatic SAR Based on Numerical Range-Doppler Algorithm and Entropy Minimization. Remote Sens., 9.10.3390/rs9050470 ↗
55. Accuracy Analysis of Di rect Georeferencing by Airborne Position and Ori-entation System in Aerial Photogrammetry
56. Efficient Bias Estimation in Airborne Video Georegistration for Ground Target Tracking10.1109/TAES.2021.3074203 ↗
57. Geo-registration and Geo-location Using Two Airborne Video Sensors10.1109/TAES.2020.2995439 ↗
58. Analysis and study on influence factors of target geo-locating accuracy for electro-optical reconnaissance system10.5768/JAO201839.0101001 ↗
59. Xiu, J., Huang, P., Li, J., Zhang, H., and Li, Y. (2020). Line of Sight and Image Motion Compensation for Step and Stare Imaging System. Appl. Sci., 10.10.3390/app10207119 ↗
60. Wang, D., and Shu, H. (2022). Accuracy Analysis of Three-Dimensional Modeling of a Multi-Level UAV without Control Points. Buildings, 12.10.3390/buildings12050592 ↗
61. Liu, X., Lian, X., Yang, W., Wang, F., Han, Y., and Zhang, Y. (2022). Accuracy Assessment of a UAV Direct Georeferencing Method and Impact of the Configuration of Ground Control Points. Drones, 6.10.3390/drones6020030 ↗
62. Positioning Accuracy Analysis of Aerial Triangulation of UAV Images without Ground Control Points
63. Ground target geo-location based on digital elevation model for airborne wide-area reconnaissance system10.1117/1.JRS.12.016004 ↗
64. Ground target geo-location using imaging aerial camera With large inclined angle
65. Multitarget location capable of adapting to complex geomorphic environment for the airborne photoelectric reconnaissance system10.1117/1.JRS.14.036510 ↗
66. El Habchi, A., Moumen, Y., Zerrouk, I., Khiati, W., Berrich, J., and Bouchentouf, T. (2020, January 21–23). CGA: A New Approach to Estimate the Geolocation of a Ground Target from Drone Aerial Imagery. Proceedings of the 2020 Fourth International Conference On Intelligent Computing in Data Sciences (ICDS), Fez, Morocco.10.1109/ICDS50568.2020.9268749 ↗
67. Huang, C., Zhang, H., and Zhao, J. (2020). High-Efficiency Determination of Coastline by Combination of Tidal Level and Coastal Zone DEM from UAV Tilt Photogrammetry. Remote Sens., 12.10.3390/rs12142189 ↗
68. Cheng, B.T. (2010). A simulation of wide area surveillance (WAS) systems and algorithm for digital elevation model (DEM) extraction. Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications VII, SPIE.10.1117/12.850364 ↗
69. Three-dimensional panoramic terrain reconstruction from aerial imagery10.1117/1.JRS.7.073497 ↗
70. Graph-connected components for filtering urban LiDAR data10.1117/1.JRS.9.096075 ↗
71. External Validation of the ASTER GDEM2, GMTED2010 and CGIAR-CSI- SRTM v4.1 Free Access Digital Elevation Models (DEMs) in Tunisia and Algeria10.3390/rs6054600 ↗
72. Geolocation Of Multiple Tatgets From Airborne Video Without Terrain Data10.1007/s10846-010-9442-7 ↗
73. How Photogrammetric Software Works: A Perspective Based on UAV’s Exterior Orientation Parameters10.1007/s12524-020-01256-8 ↗
74. An efficient variable stepsize rational method for stiff, singular and singularly perturbed problems10.1016/j.aej.2022.03.014 ↗
75. Mixed-precision explicit stabilized Runge–Kutta methods for single- and multi-scale differential equations10.1016/j.jcp.2022.111349 ↗
76. A multiscale domain decomposition approach for parabolic equations using expanded mixed method10.1016/j.matcom.2022.02.010 ↗
77. A Novel Autofocus Framework for UAV SAR Imagery: Motion Error Extraction From Symmetric Triangular FMCW Differential Signal
78. Accuracy assessment of direct georeferencing UAV images with onboard global navigation satellite system and comparison of CORS/RTK surveying methods10.1088/1361-6501/abf25d ↗
79. Li, X., Qi, G., Guo, X., and Ma, S. (2020, January 20–22). Trajectory Tracking of a Quadrotor UAV based on High-Order Differential Feedback Control. Proceedings of the 2020 IEEE 9th Data Driven Control and Learning Systems Conference (DDCLS), Liuzhou, China.10.1109/DDCLS49620.2020.9275032 ↗
80. A pseudo-random sequence generation scheme based on RNS and permutation polynomials10.1007/s11432-017-9279-3 ↗
81. Long, Z., Xiang, Y., Lei, X., Li, Y., Hu, Z., and Dai, X. (2022). Integrated Indoor Positioning System of Greenhouse Robot Based on UWB/IMU/ODOM/LIDAR. Sensors, 22.10.3390/s22134819 ↗
82. Satellite replacement and task reallocation for multiple-payload fractionated Earth observation mission10.1016/j.actaastro.2022.04.014 ↗
83. Research on real-time reachability evaluation for reentry vehicles based on fuzzy learning10.1515/astro-2022-0026 ↗
84. Local averaged stratified sampling method10.1007/s40430-022-03589-6 ↗
85. Transport error estimation using residual Monte Carlo10.1016/j.jcp.2022.111306 ↗
86. Path Planning for the Dynamic UAV-Aided Wireless Systems Using Monte Carlo Tree Search10.1109/TVT.2022.3160746 ↗
87. Sun, Y., and Ma, O. (2022). Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning. Drones, 6.10.3390/drones6040087 ↗
88. Evaluation method of positioning accuracy based on circular probability error
89. Comprehensive assessment algorithm for calculating CEP of positioning accuracy10.1016/j.measurement.2013.08.062 ↗
90. Position determination using the DTV segment sync signal10.1007/s12555-011-0318-9 ↗
91. A hybrid cooperative navigation method for UAV swarm based on factor graph and Kalman filter10.1177/15501477211064758 ↗
92. Beam Tracking for UAV-Assisted FSO Links With a Four-Quadrant Detector10.1109/LCOMM.2021.3113699 ↗
93. Jenssen, R.O.R., and Jacobsen, S.K. (2021). Measurement of Snow Water Equivalent Using Drone-Mounted Ultra-Wide-Band Radar. Remote Sens., 13.10.3390/rs13132610 ↗
94. An approach for reflectance anisotropy retrieval from UAV-based oblique photogrammetry hyperspectral imagery
95. Multiagent Q-learning based UAV trajectory planning for effective situationalawareness
96. Distortion measurement and geolocation error correction for high altitude oblique imaging using airborne cameras10.1117/1.JRS.14.014510 ↗
97. Cai, Y., Ding, Y., Zhang, H., Xiu, J., and Liu, Z. (2020). Geo-Location Algorithm for Building Targets in Oblique Remote Sensing Images Based on Deep Learning and Height Estimation. Remote Sens., 12.10.3390/rs12152427 ↗
98. Online Ground Multitarget Geolocation Based on 3-D Map Construction Using a UAV Platform
99. Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera10.1109/ACCESS.2019.2929760 ↗
100. Multi-UAV cooperative system for search and rescue based on YOLOv510.1016/j.ijdrr.2022.102972 ↗