Sparse Indoor Camera Positioning with Fiducial Markers
Source abstract
Abstract
Accurately estimating the pose of large arrays of fixed indoor cameras presents a significant challenge in computer vision, especially since traditional methods predominantly rely on overlapping camera views. Existing approaches for positioning non-overlapping cameras are scarce and generally limited to simplistic scenarios dependent on specific environmental features, thereby leaving a significant gap in applications for large and complex settings. To bridge this gap, this paper introduces a novel methodology that effectively positions cameras with and without overlapping views in complex indoor scenarios. This approach leverages a subset of fiducial markers printed on regular paper, strategically placed and relocated across the environment and recorded by an additional mobile camera to progressively establish connections among all fixed cameras without necessitating overlapping views. Our method employs a comprehensive optimization process that minimizes the reprojection errors of observed markers while applying physical constraints such as camera and marker coplanarity and the use of a set of control points. To validate our approach, we have developed novel datasets specifically designed to assess the performance of our system in positioning cameras without overlapping fields of view. Demonstrating superior performance over existing techniques, our methodology establishes a new state-of-the-art for positioning cameras with and without overlapping views. This system not only expands the applicability of camera pose estimation technologies but also provides a practical solution for indoor settings without the need for overlapping views, supported by accessible resources, including code, datasets, and a tutorial to facilitate its deployment and adaptation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Indoor and Outdoor Localization Technologies · Robotics and Sensor-Based Localization · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Departamento de Informática y Análisis Numérico, Edificio Einstein, Campus de Rabanales, Universidad de Córdoba, 14071 Córdoba, Spain
Departamento de Teoría de la Señal y Comunicaciones y Sistemas Telemáticos y Computación, Campus de Fuenlabrada, Universidad Rey Juan Carlos, 28942 Fuenlabrada, Spain
Instituto Maimónides de Investigación en Biomedicina (IMIBIC), Avenida Menéndez Pidal s/n, 14004 Córdoba, Spain
Funding
Ministry of Science, Innovation, and Universities of Spain
References (41)
Show source-provided references
1. Yuan, S., Ge, Z., and Yang, L. (2023). Single-Camera Multi-View 6DoF pose estimation for robotic grasping. Front. Neurorobot., 17.10.3389/fnbot.2023.1136882 ↗
2. CubeSLAM: Monocular 3-D Object SLAM10.1109/TRO.2019.2909168 ↗
3. Moon, G., Chang, J.Y., and Lee, K.M. (November, January 27). Camera Distance-Aware Top-Down Approach for 3D Multi-Person Pose Estimation From a Single RGB Image. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.01023 ↗
4. Mapping and localization from planar markers10.1016/j.patcog.2017.08.010 ↗
5. García-Ruiz, P., Romero-Ramirez, F.J., Muñoz-Salinas, R., Marín-Jiménez, M.J., and Medina-Carnicer, R. (2024). Large-Scale Indoor Camera Positioning Using Fiducial Markers. Sensors, 24.10.3390/s24134303 ↗
6. Dai, C., Han, T., Luo, Y., Wang, M., Cai, G., Su, J., Gong, Z., and Liu, N. (2024). NMC3D: Non-Overlapping Multi-Camera Calibration Based on Sparse 3D Map. Sensors, 24.10.3390/s24165228 ↗
7. Multi-Camera 3D Object Detection for Autonomous Driving Using Deep Learning and Self-Attention Mechanism10.1109/ACCESS.2023.3288112 ↗
8. Nguyen, P., Quach, K.G., Nhan Duong, C., Le, N., Nguyen, X.B., and Luu, K. (2022, January 19–20). Multi-Camera Multiple 3D Object Tracking on the Move for Autonomous Vehicles. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), New Orleans, LA, USA.10.1109/CVPRW56347.2022.00289 ↗
9. Multi-camera multi-object tracking: A review of current trends and future advances10.1016/j.neucom.2023.126558 ↗
10. Zhang, C., Liu, Y., Wang, F., Xia, Y., and Zhang, W. (2018). VINS-MKF: A Tightly-Coupled Multi-Keyframe Visual-Inertial Odometry for Accurate and Robust State Estimation. Sensors, 18.10.3390/s18114036 ↗
11. Morar, A., Moldoveanu, A., Mocanu, I., Moldoveanu, F., Radoi, I.E., Asavei, V., Gradinaru, A., and Butean, A. (2020). A Comprehensive Survey of Indoor Localization Methods Based on Computer Vision. Sensors, 20.10.3390/s20092641 ↗
12. Spatial segment-aware clustering based dynamic rweeliability threshold determination (SSC-DRTD) for unsupervised person re-identification10.1016/j.eswa.2020.114502 ↗
13. A comprehensive survey of multi-view video summarization10.1016/j.patcog.2020.107567 ↗
14. Wang, J., Zhong, Y., Dai, Y., Birchfield, S., Zhang, K., Smolyanskiy, N., and Li, H. (2021, January 20–25). Deep Two-View Structure-From-Motion Revisited. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00884 ↗
15. DeepSFM: Robust Deep Iterative Refinement for Structure From Motion10.1109/TPAMI.2023.3307567 ↗
16. ReSLAM: Reusable SLAM with heterogeneous cameras10.1016/j.neucom.2023.126940 ↗
17. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM10.1109/TRO.2021.3075644 ↗
18. Ataer-Cansizoglu, E., Taguchi, Y., Ramalingam, S., and Miki, Y. (2014, January 8–11). Calibration of Non-overlapping Cameras Using an External SLAM System. Proceedings of the 2014 2nd International Conference on 3D Vision, Tokyo, Japan.10.1109/3DV.2014.106 ↗
19. Zhao, F., Tamaki, T., Kurita, T., Raytchev, B., and Kaneda, K. (2016, January 25–28). Marker based simple non-overlapping camera calibration. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7532544 ↗
20. Sugimoto, M., Suenaga, M., Watanabe, H., Nakamura, M., and Hashizume, H. (2023, January 25–28). Smartphone Indoor Positioning using Inertial and Ambient Light Sensors. Proceedings of the 2023 13th International Conference on Indoor Positioning and Indoor Navigation (IPIN), Nuremberg, Germany.10.1109/IPIN57070.2023.10332528 ↗
21. Rana, L., Dong, J., Cui, S., Li, J., Hwang, J., and Park, J. (2023, January 25–28). Indoor Positioning using DNN and RF Method Fingerprinting-based on Calibrated Wi-Fi RTT. Proceedings of the 2023 13th International Conference on Indoor Positioning and Indoor Navigation (IPIN), Nuremberg, Germany.10.1109/IPIN57070.2023.10332507 ↗
22. Ju, C., and Yoo, J. (2023, January 25–28). Machine Learning for Indoor Localization Without Ground-truth Locations. Proceedings of the 2023 13th International Conference on Indoor Positioning and Indoor Navigation (IPIN), Nuremberg, Germany.10.1109/IPIN57070.2023.10332468 ↗
23. Kumar, R.K., Ilie, A., Frahm, J.M., and Pollefeys, M. (2008, January 23–28). Simple calibration of non-overlapping cameras with a mirror. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.10.1109/CVPR.2008.4587676 ↗
24. Extrinsic camera calibration for non-overlapping cameras with Gray code projection10.1016/j.optlaseng.2020.106305 ↗
25. Development and calibration of an accurate 6-degree-of-freedom measurement system with total station10.1088/0957-0233/27/12/125103 ↗
26. Paraforos, D.S., Sharipov, G.M., Heiß, A., and Griepentrog, H.W. (2022). Position Accuracy Assessment of a UAV-Mounted Sequoia+ Multispectral Camera Using a Robotic Total Station. Agriculture, 12.10.3390/agriculture12060885 ↗
27. The interpretation of structure from motion
28. (2024, November 27). OpenDroneMap. Available online: https://www.opendronemap.org/.
29. Pix4D (2024, November 27). Pix4D Official Website. Available online: https://www.pix4d.com/.
30. Schönberger, J.L., and Frahm, J.M. (2016, January 27–30). Structure-from-Motion Revisited. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.445 ↗
31. 3D Gaussian Splatting for Real-Time Radiance Field Rendering10.1145/3592433 ↗
32. PolyCam (2024, November 27). Homepage. Available online: https://poly.cam.
33. Cao, Y., Ju, Y., and Xu, D. (2024). 3DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for 3D Object Detection. arXiv.
34. Automatic generation and detection of highly reliable fiducial markers under occlusion10.1016/j.patcog.2014.01.005 ↗
35. Infinitesimal Plane-Based Pose Estimation10.1007/s11263-014-0725-5 ↗
36. Madsen, K., Nielsen, H.B., and Tingleff, O. (2004). Methods for Non-Linear Least Squares Problems, Technical University of Denmark. [2nd ed.].
37. Kümmerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9–13). G2o: A General Framework for Graph Optimization. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.
38. Closed-Form Solution of Absolute Orientation Using Unit Quaternions10.1364/JOSAA.4.000629 ↗
39. Mitigating systematic error in topographic models for geomorphic change detection: Accuracy, precision and considerations beyond off-nadir imagery10.1002/esp.4878 ↗
40. DeepArUco++: Improved detection of square fiducial markers in challenging lighting conditions10.1016/j.imavis.2024.105313 ↗
41. UcoSLAM: Simultaneous localization and mapping by fusion of keypoints and squared planar markers10.1016/j.patcog.2019.107193 ↗