Development and Assessment of a Sensor-Based Orientation and Positioning Approach for Decreasing Variation in Camera Viewpoints and Image Transformations at Construction Sites
Source abstract
Abstract
Image matching techniques offer valuable opportunities for the construction industry. Image matching, a fundamental process in computer vision, is required for different purposes such as object and scene recognition, video data mining, reconstruction of three-dimensional (3D) objects, etc. During the image matching process, two images that are randomly (i.e., from different position and orientation) captured from a scene are compared using image matching algorithms in order to identify their similarity. However, this process is very complex and error prone, because pictures that are randomly captured from a scene vary in viewpoints. Therefore, some main features in images such as position, orientation, and scale of objects are transformed. Sometimes, these image matching algorithms cannot correctly identify the similarity between these images. Logically, if these features remain unchanged during the picture capturing process, then image transformations are reduced, similarity increases, and consequently, the chances of algorithms successfully conducting the image matching process increase. One way to improve these chances is to hold the camera at a fixed viewpoint. However, in messy, dusty, and temporary locations such as construction sites, holding the camera at a fixed viewpoint is not always feasible. Is there any way to repeat and retrieve the camera’s viewpoints during different captures at locations such as construction sites? This study developed and evaluated an orientation and positioning approach that decreased the variation in camera viewpoints and image transformation on construction sites. The results showed that images captured while using this approach had less image transformation in contrast to images not captured using this approach.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Civil, Architectural & Environmental Engineering, Drexel University, Philadelphia, PA 19104, USA
Rinker School of Construction Management, University of Florida, Gainesville, FL 32611, USA
Funding
National Science Foundation
References (68)
Show source-provided references
1. Computer Vision: Algorithms and Applications
2. Forsyth, D.A., and Ponce, J. (2003). Computer Vision, A Modern Approach, Printice Hall.
3. Shapiro, L.G., and Stockman, G.C. (2001). Computer Vision: Theory and Applications, Prentice Hall.
4. Horn, B., Klaus, B., and Horn, P. (1986). Robot Vision, MIT Press.
5. Invariant matching method for different viewpoint angle images10.1364/AO.52.000096 ↗
6. Dai, X.L., and Lu, J. (July, January 28). An object-based approach to automated image matching. Proceedings of the IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS’99 (Cat. No. 99CH36293), Hamburg, Germany.
7. Karami, E., Prasad, S., and Shehata, M. (2015, January 14–15). Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Images. Proceedings of the 2015 Newfoundland Electrical and Computer Engineering Conference, St. John’s, NL, Canada.
8. Feature tracking and matching in video using programmable graphics hardware10.1007/s00138-007-0105-z ↗
9. Automatic panoramic image stitching using invariant features10.1007/s11263-006-0002-3 ↗
10. Szeliski, R., and Shum, H.-Y. (1997, January 3–8). Creating full view panoramic image mosaics and environment maps. Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, Los Angeles, CA, USA.10.1145/258734.258861 ↗
11. Image-based 3D reconstruction using helical nanobelts for localized rotations10.1111/j.1365-2818.2009.03313.x ↗
12. Image-based technologies for constructing as-is building information models for existing buildings10.1061/(ASCE)CP.1943-5487.0000652 ↗
13. Probabilistic visual learning for object representation10.1109/34.598227 ↗
14. Neural network-based face detection10.1109/34.655647 ↗
15. Pérez-Lorenzo, J., Vázquez-Martín, R., Marfil, R., Bandera, A., and Sandoval, F. (2007). Image Matching Based on Curvilinear Regions, IntechOpen.10.5772/4959 ↗
16. Rotation-invariant fast features for large-scale recognition and real-time tracking10.1016/j.image.2012.11.004 ↗
17. Detection and tracking of occluded people10.1007/s11263-013-0664-6 ↗
18. Kang, H., Efros, A.A., Hebert, M., and Kanade, T. (2009, January 20–25). Image matching in large scale indoor environment. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPR 2009, Miami, FL, USA.
19. Comparison of construction photograph and VR image in construction progress10.1016/j.autcon.2006.12.005 ↗
20. Jabari, S., and Zhang, Y. (2016). Building Change Detection Using Multi-Sensor and Multi-View- Angle Imagery, IOP Publishing. IOP Conference Series: Earth and Environmental Science.10.1088/1755-1315/34/1/012018 ↗
21. Integrating BIM and Panorama to Create a Semi-Augmented-Reality Experience of a Construction Site
22. Foroughi Sabzevar, M., Gheisari, M., and Lo, L.J. (2020). Improving Access to Design Information of Paper-Based Floor Plans Using Augmented Reality. Int. J. Constr. Educ. Res., 1–21.10.1080/15578771.2020.1717682 ↗
23. Belghit, H., Zenati-Henda, N., Bellabi, A., Benbelkacem, S., and Belhocine, M. (2012, January 10–12). Tracking color marker using projective transformation for augmented reality application. Proceedings of the 2012 International Conference on Multimedia Computing and Systems, Tangier, Morocco.10.1109/ICMCS.2012.6320245 ↗
24. Registration using natural features for augmented reality systems10.1109/TVCG.2006.79 ↗
25. Moravec, H.P. (1977, January 22–25). Techniques towards Automatic Visual Obstacle Avoidance. Proceedings of the International Joint Conference on Artificial Intelligence, Cambridge, MA, USA.
26. Harris, C.G., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK.
27. SUSAN—A new approach to low level image processing10.1023/A:1007963824710 ↗
28. Rosten, E., and Drummond, T. (2005, January 17–21). Fusing points and lines for high performance tracking. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, Washington, DC, USA.10.1109/ICCV.2005.104 ↗
29. Rosten, E., and Drummond, T. (2006, January 7–13). Machine learning for high-speed corner detection. Proceedings of the European Conference on Computer Vision, Graz, Austria.10.1007/11744023_34 ↗
30. Beaudet, P.R. (1978, January 7–10). Rotationally invariant image operators. Proceedings of the 4th International Joint Conference on Pattern Recognition, Tokyo, Japan.
31. Hessian-based affine adaptation of salient local image features10.1007/s10851-011-0317-8 ↗
32. Scale selection properties of generalized scale-space interest point detectors10.1007/s10851-012-0378-3 ↗
33. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
34. Scale & affine invariant interest point detectors10.1023/B:VISI.0000027790.02288.f2 ↗
35. Speeded-up robust features (SURF)10.1016/j.cviu.2007.09.014 ↗
36. Invariant Gabor-based interest points detector under geometric transformation10.1016/j.dsp.2013.10.011 ↗
37. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
38. ASIFT: A new framework for fully affine invariant image comparison10.1137/080732730 ↗
39. Yu, G., and Morel, J.-M. (2009, January 19–24). A fully affine invariant image comparison method. Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan.10.1109/ICASSP.2009.4959904 ↗
40. A novel algorithm for view and illumination invariant image matching
41. A comparative study of SIFT and its variants10.2478/msr-2013-0021 ↗
42. Dellinger, F., Delon, J., Gousseau, Y., Michel, J., and Tupin, F. (2014, January 13–18). Change detection for high resolution satellite images, based on SIFT descriptors and an a contrario approach. Proceedings of the 2014 IEEE Geoscience and Remote Sensing Symposium, Quebec City, QC, Canada.10.1109/IGARSS.2014.6946667 ↗
43. Karimi, H.A., and Hammad, A. (2004). Mobile augmented reality. Telegeoinformatics: Location-Based Computing and Services, CRC Press.
44. (2019, August 08). Sebastian Richard Hitting the Spot. Available online: http://spie.org/x26572.xml.
45. LaMarca, A., Chawathe, Y., Consolvo, S., Hightower, J., Smith, I., Scott, J., Sohn, T., Howard, J., Hughes, J., and Potter, F. (2005, January 8–13). Place lab: Device positioning using radio beacons in the wild. Proceedings of the International Conference on Pervasive Computing, Munich, Germany.10.1007/11428572_8 ↗
46. Evaluation of position tracking technologies for user localization in indoor construction environments10.1016/j.autcon.2008.10.011 ↗
47. Rolland, J.P., Davis, L.D., and Baillot, Y. (2001). A survey of tracking technologies for virtual environments. Fundamentals of Wearable Computers and Augmented Reality, CRC Press.
48. Bargh, M.S., and de Groote, R. (2008, January 19). Indoor localization based on response rate of bluetooth inquiries. Proceedings of the First ACM International Workshop on Mobile Entity Localization and Tracking in GPS-Less Environments, San Francisco, CA, USA.10.1145/1410012.1410024 ↗
49. The active badge location system
50. Bahl, P., and Padmanabhan, V.N. (2000, January 26–30). RADAR: An in-building RF-based user location and tracking system. Proceedings of the Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No. 00CH37064), Tel Aviv, Israel.
51. Karlekar, J., Zhou, S.Z.Y., Nakayama, Y., Lu, W., Chang Loh, Z., and Hii, D. (2010, January 19–23). Model-based localization and drift-free user tracking for outdoor augmented reality. Proceedings of the 2010 IEEE International Conference on Multimedia and Expo, ICME 2010, Singapore.10.1109/ICME.2010.5583850 ↗
52. A survey of active and passive indoor localisation systems10.1016/j.comcom.2012.06.004 ↗
53. Localization via ultra-wideband radios: A look at positioning aspects for future sensor networks10.1109/MSP.2005.1458289 ↗
54. (2017, August 08). Pozyx. Available online: https://www.pozyx.io/.
55. Popa, M., Ansari, J., Riihijarvi, J., and Mahonen, P. (April, January 31). Combining cricket system and inertial navigation for indoor human tracking. Proceedings of the 2008 IEEE Wireless Communications and Networking Conference, Las Vegas, NV, USA.10.1109/WCNC.2008.535 ↗
56. (2017, December 10). Microsoft. Available online: https://www.microsoft.com/en-us/surface.
57. (2020, March 01). Distance to Objects Using Single Vision Camera. Available online: https://www.youtube.com/watch?v=Z3KX0N56ZoA.
58. Soanes, C. (2003). Oxford Dictionary of English, Oxford University Press.
59. A taxonomy of mixed reality visual displays
60. A survey of augmented reality10.1162/pres.1997.6.4.355 ↗
61. Bergamasco, F., Albarelli, A., Rodola, E., and Torsello, A. (2011, January 20–25). Rune-tag: A high accuracy fiducial marker with strong occlusion resilience. Proceedings of the CVPR 2011, Providence, RI, USA.10.1109/CVPR.2011.5995544 ↗
62. Kan, T.-W., Teng, C.-H., and Chou, W.-S. (2009, January 14–15). Applying QR code in augmented reality applications. Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry, Yokohama, Japan.10.1145/1670252.1670305 ↗
63. Ruan, K., and Jeong, H. (2012, January 27–30). An augmented reality system using Qr code as marker in android smartphone. Proceedings of the 2012 Spring Congress on Engineering and Technology, Xi’an, China.10.1109/SCET.2012.6342109 ↗
64. Naimark, L., and Foxlin, E. (2002, January 1). Circular data matrix fiducial system and robust image processing for a wearable vision-inertial self-tracker. Proceedings of the Proceedings. International Symposium on Mixed and Augmented Reality, Darmstadt, Germany.
65. Han, S., Rhee, E.J., Choi, J., and Park, J.-I. (2011, January 11–12). User-created marker based on character recognition for intuitive augmented reality interacion. Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry, Hong Kong, China.10.1145/2087756.2087839 ↗
66. Exploring the Evolution of Mobile Augmented Reality for Future Entertainment Systems10.1145/2582179.2633427 ↗
67. Tateno, K., Kitahara, I., and Ohta, Y. (2007, January 10–14). A nested marker for augmented reality. Proceedings of the 2007 IEEE Virtual Reality Conference, Charlotte, NC, USA.10.1109/VR.2007.352495 ↗
68. Yan, Y. (2020, February 01). Available online: https://pdfs.semanticscholar.org/ded9/2aa404e29e9cc43a08958ca7363053972224.pdf.