journal article·2022Open access

Research on Multi-View Image Reconstruction Technology Based on Auto-Encoding Learning

Tao Zhang, Shaokui Gu, Jinxing Niu, Yi Cao

Computers, Materials & Continua· Volume 72· Issue 3

Abstract

Traditional three-dimensional (3D) image reconstruction method, which highly dependent on the environment and has poor reconstruction effect, is easy to lead to mismatch and poor real-time performance. The accuracy of feature extraction from multiple images affects the reliability and real-time performance of 3D reconstruction technology. To solve the problem, a multi-view image 3D reconstruction algorithm based on self-encoding convolutional neural network is proposed in this paper. The algorithm first extracts the feature information of multiple two-dimensional (2D) images based on scale and rotation invariance parameters of Scale-invariant feature transform (SIFT) operator. Secondly, self-encoding learning neural network is introduced into the feature refinement process to take full advantage of its feature extraction ability. Then, Fish-Net is used to replace the U-Net structure inside the self-encoding network to improve gradient propagation between U-Net structures, and Generative Adversarial Networks (GAN) loss function is used to replace mean square error (MSE) to better express image features, discarding useless features to obtain effective image features. Finally, an incremental structure from motion (SFM) algorithm is performed to calculate rotation matrix and translation vector of the camera, and the feature points are triangulated to obtain a sparse spatial point cloud, and meshlab software is used to display the results. Simulation experiments show that compared with the traditional method, the image feature extraction method proposed in this paper can significantly improve the rendering effect of 3D point cloud, with an accuracy rate of 92.5% and a reconstruction complete rate of 83.6%.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Image Processing Techniques and Applications · Advanced Vision and Imaging · Advanced Image and Video Retrieval Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (23)

Show source-provided references
1. Robust active stereo vision using Kullback-Leibler divergence10.1109/TPAMI.2011.162 ↗
2. Computation of aortic geometry using mr and ct 3d images10.32604/iasc.2022.020607 ↗
3. Deep-learning-empowered 3d reconstruction for dehazed images in iot-enhanced smart cities10.32604/cmc.2021.017410 ↗
4. Discrete-continuous depth estimation from a single image
5. A robust 3-D medical watermarking based on wavelet transform for data protection10.32604/csse.2022.022305 ↗
6. Plane net: Piece-wise planar reconstruction from a single RGB image
7. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
8. SURF: Speeded up robust features
9. ORB: An efficient alternative to SIFT or SURF
10. LIFT: Learned invariant feature transform
11. Improved digital image correlation method based on gray gradient regularization denoising
12. A multi-agent system for environmental monitoring using boolean networks and reinforcement learning10.32604/jcs.2020.010086 ↗
13. Encoder-decoder with atrous separable convolution for semantic image segmentation
14. Building extraction based on SE-unet
15. Semantic segmentation algorithm based on enhanced feature fusion decoder
16. Fast semantic segmentation based on dense layerand attention mechanism
17. Summary of self-encoding neural network theory and application
18. Multiple cloud storage mechanism based on blockchain in smart homes10.1016/j.future.2020.09.019 ↗
19. An unsupervised-learning-based approach for automated defect inspection on textured surfaces10.1109/TIM.2018.2795178 ↗
20. Survey of research on network attack detection based on GAN
21. Data query mechanism based on hash computing power of blockchain in internet of things
22. Robust reversible audio watermarking scheme for telemedicine and privacy protection10.32604/cmc.2022.022304 ↗
23. Z. Y. Hu, “Three-dimensional reconstruction data set [EB],” 2010. http://vision.ia.ac.cn/data.