A Fast and Simple Method for Absolute Orientation Estimation Using a Single Vanishing Point
Source abstract
Abstract
Absolute orientation estimation is one of the key steps in computer vision, and n 2D–3D point correspondences can be used to obtain the absolute orientation, which is known as the perspective-n-point problem (PnP). The lowest number of point correspondences is three if there is no other information, and the corresponding algorithm is called the P3P solver. In practice, the real scene may consist of some geometric information, e.g., the vanishing point. When scenes contain parallel lines, they intersect at vanishing points. Hence, to reduce the number of point correspondences and increase the computational speed, we proposed a fast and simple method for absolute orientation estimation using a single vanishing point. First, the inertial measurement unit (IMU) was used to obtain the rotation of the camera around the Y-axis (i.e., roll angle), which could simplify the orientation estimation. Then, one vanishing point was used to estimate the coarse orientation because it contained direction information in both the camera frame and world frame. Finally, our proposed method used a non-linear optimization algorithm for solution refining. The experimental results show that compared with several state-of-the-art orientation estimation solvers, our proposed method had a better performance regarding numerical stability, noise sensitivity, and computational speed in synthetic data and real images.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Vision and Imaging · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Northwest Institute of Nuclear Technology, Xi’an 710024, China
References (58)
Show source-provided references
1. Das pothenotische Problem in erweiterter Gestalt nebst über seine Anwendungen in der Geodäsie
2. Lourakis, M., and Terzakis, G. (2021, January 10–15). A globally optimal method for the PnP problem with MRP rotation parameterization. Proceedings of the International Conference on Pattern Recognition, Milan, Italy.10.1109/ICPR48806.2021.9412405 ↗
3. A consistently fast and accurate algorithm for estimating camera pose from point correspondences10.1016/j.measurement.2020.108914 ↗
4. An efficient solution to the perspective-three-point pose problem10.1016/j.cviu.2017.10.005 ↗
5. Kneip, L., Scaramuzza, D., and Siegwart, R. (2011, January 20–25). A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.10.1109/CVPR.2011.5995464 ↗
6. Epnp: An accurate o (n) solution to the pnp problem10.1007/s11263-008-0152-6 ↗
7. ScPnP: A non-iterative scale compensation solution for PnP problems10.1016/j.imavis.2020.104085 ↗
8. Guo, K., Ye, H., Gu, J., and Chen, H. (2021). A Novel Method for Intrinsic and Extrinsic Parameters Estimation by Solving Perspective-Three-Point Problem with Known Camera Position. Appl. Sci., 11.10.3390/app11136014 ↗
9. Exterior orientation revisited: A robust method based on lq-norm10.14358/PERS.83.1.47 ↗
10. Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press. [2nd ed.].10.1017/CBO9780511811685 ↗
11. Schweighofer, G., and Pinz, A. (2008, January 1–4). Globally Optimal O (n) Solution to the PnP Problem for General Camera Models. Proceedings of the British Machine Vision Conference, Leeds, UK.10.5244/C.22.55 ↗
12. Zheng, E., and Wu, C. (2015, January 7–13). Structure from motion using structure-less resection. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.240 ↗
13. Camera calibration and pose estimation from planes10.1109/MIM.2015.7335834 ↗
14. Accurate 3-D reconstruction under IoT environments and its applications to augmented reality10.1109/TII.2020.3016393 ↗
15. Jiang, N., Lin, D., Do, M.N., and Lu, J. (2015, January 7–12). Direct structure estimation for 3D reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298881 ↗
16. A Complete, Accurate and Efficient Solution for the Perspective-N-Line Problem10.1109/LRA.2020.3047797 ↗
17. An efficient and globally optimal solution to perspective-n-line problem10.1016/j.cja.2021.01.028 ↗
18. Zhang, L., Xu, C., Lee, K.M., and Koch, R. (2012, January 5–9). Robust and efficient pose estimation from line correspondences. Proceedings of the Asian Conference on Computer Vision, Daejeon, Korea.
19. Guo, K., Ye, H., Chen, H., and Gao, X. (2022). A New Method for Absolute Pose Estimation with Unknown Focal Length and Radial Distortion. Sensors, 22.10.3390/s22051841 ↗
20. Bujnák, M. (2012). Algebraic Solutions to Absolute Pose Problems. [Ph. D. Thesis, Czech Technical University].
21. Camposeco, F., Cohen, A., Pollefeys, M., and Sattler, T. (2018, January 18–22). Hybrid camera pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00022 ↗
22. SfM with MRFs: Discrete-continuous optimization for large-scale structure from motion10.1109/TPAMI.2012.218 ↗
23. PnP problem revisited10.1007/s10851-005-3617-z ↗
24. Fast and robust absolute camera pose estimation with known focal length10.1007/s00521-017-3032-6 ↗
25. Zheng, Y., Kuang, Y., Sugimoto, S., Astrom, K., and Okutomi, M. (2013, January 1–8). Revisiting the pnp problem: A fast, general and optimal solution. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.291 ↗
26. Hesch, J.A., and Roumeliotis, S.I. (2011, January 6–13). A direct least-squares (DLS) method for PnP. Proceedings of the International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126266 ↗
27. Ke, T., and Roumeliotis, S.I. (2017, January 21–26). An efficient algebraic solution to the perspective-three-point problem. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.491 ↗
28. A stable direct solution of perspective-three-point problem10.1142/S0218001411008774 ↗
29. Complete solution classification for the perspective-three-point problem10.1109/TPAMI.2003.1217599 ↗
30. Bujnak, M., Kukelova, Z., and Pajdla, T. (2008, January 23–28). A general solution to the P4P problem for camera with unknown focal length. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA.10.1109/CVPR.2008.4587793 ↗
31. A new efficient and direct solution for pose estimation using quadrangular targets: Algorithm and evaluation10.1109/34.391388 ↗
32. Kukelova, Z., Bujnak, M., and Pajdla, T. (2013, January 1–8). Real-time solution to the absolute pose problem with unknown radial distortion and focal length. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.10.1109/ICCV.2013.350 ↗
33. Triggs, B. (1999, January 20–25). Camera pose and calibration from 4 or 5 known 3d points. Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece.10.1109/ICCV.1999.791231 ↗
34. Bujnak, M., Kukelova, Z., and Pajdla, T. (2010, January 8–12). New efficient solution to the absolute pose problem for camera with unknown focal length and radial distortion. Proceedings of the Asian Conference on Computer Vision, Queenstown, New Zealand.10.1007/978-3-642-19315-6_2 ↗
35. Huang, K., Ziauddin, S., Zand, M., and Greenspan, M. (2020, January 25–28). One shot radial distortion correction by direct linear transformation. Proceedings of the IEEE International Conference on Image Processing, Abu Dhabi, United Arab Emirates.10.1109/ICIP40778.2020.9190749 ↗
36. Zhao, Z., Ye, D., Zhang, X., Chen, G., and Zhang, B. (2016). Improved Direct Linear Transformation for Parameter Decoupling in Camera Calibration. Algorithms, 9.10.3390/a9020031 ↗
37. Guo, K., Ye, H., Zhao, Z., and Gu, J. (2021). An efficient closed form solution to the absolute orientation problem for camera with unknown focal length. Sensors, 21.10.3390/s21196480 ↗
38. D’Alfonso, L., Garone, E., Muraca, P., and Pugliese, P. (June, January 31). On the use of IMUs in the PnP Problem. Proceedings of the International Conference on Robotics and Automation, Hong Kong, China.
39. Kukelova, Z., Bujnak, M., and Pajdla, T. (2010, January 8–12). Closed-form solutions to minimal absolute pose problems with known vertical direction. Proceedings of the Asian Conference on Computer Vision, Queenstown, New Zealand.10.1007/978-3-642-19309-5_17 ↗
40. Absolute pose estimation from line correspondences using direct linear transformation10.1016/j.cviu.2017.05.002 ↗
41. Pose estimation from line correspondences: A complete analysis and a series of solutions10.1109/TPAMI.2016.2582162 ↗
42. Camera pose estimation from lines: A fast, robust and general method10.1007/s00138-019-01012-0 ↗
43. Camera pose estimation based on PnL with a known vertical direction10.1109/LRA.2019.2929982 ↗
44. Using vanishing points for camera calibration10.1007/BF00127813 ↗
45. Using vanishing points for camera calibration and coarse 3D reconstruction from a single image10.1007/PL00013394 ↗
46. Camera calibration from vanishing points in a vision system10.1016/j.optlastec.2007.09.001 ↗
47. Chang, H., and Tsai, F. (2017). Vanishing point extraction and refinement for robust camera calibration. Sensors, 18.10.3390/s18010063 ↗
48. Camera calibration combining images with two vanishing points
49. Orghidan, R., Salvi, J., Gordan, M., and Orza, B. (2012, January 9–12). Camera calibration using two or three vanishing points. Proceedings of the Federated Conference on Computer Science and Information Systems, Wroclaw, Poland.
50. (2022, May 31). Xsens. Available online: www.xsens.com.
51. Multi-view stereo: A tutorial10.1561/0600000052 ↗
52. Madsen, K., Nielsen, H.B., and Tingleff, O. (2004). Methods for Non-Linear Least Squares Problems, Technical University of Denmark. [2nd ed.]. Informatics and Mathematical Modelling.
53. A robust O (n) solution to the perspective-n-point problem10.1109/TPAMI.2012.41 ↗
54. (2022, March 27). South Survey. Available online: www.southsurvey.com/product-2170.html.
55. Review of stereo vision algorithms and their suitability for resource-limited systems10.1007/s11554-012-0313-2 ↗
56. Stereo vision for 3D measurement: Accuracy analysis, calibration and industrial applications10.1016/S0263-2241(96)00065-6 ↗
57. Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK.
58. Liu, J., Jakas, A., Al-Obaidi, A., and Liu, Y. (2009, January 15–18). A comparative study of different corner detection methods. Proceedings of the IEEE International Symposium on Computational Intelligence in Robotics and Automation, Daejeon, Korea.10.1109/CIRA.2009.5423153 ↗