Improved PMVS 3D reconstruction assisted by union camera-turntable calibration

3D reconstruction serves as a fundamental technology for comprehensively understanding and perceiving the physical world, with significant applications in computer vision fields such as industrial automation, autonomous navigation, and medical imaging. A critical challenge in monocular 3D reconstruction lies in the accurate and efficient estimation of camera intrinsic and extrinsic parameters, which are essential for determining precise positional information in each image. In this context, this paper proposes an improved PMVS (Patch-based Multi-view Stereo) 3D reconstruction assisted by union camera-turntable calibration, which can not only reduce manual effort and improve reconstruction efficiency but also capture rich surface details and accurate target localization, enabling the reconstruction of complex geometries. This study employs a cubic chessboard as a calibration object, replacing the traditional planar chessboard, which is positioned on a controllable turntable for calibration. This innovation allows for the determination of both intrinsic and extrinsic camera parameters from a single image while maintaining high accuracy. By integrating the rotary table, we can precisely control the inter-rotation angle to capture positional information and local texture from multiple perspectives. Furthermore, we utilize a transformer attention mechanism in place of conventional neural network (CNN) convolution to effectively capture global context and long-range dependencies within the images, thereby enhancing the quality of object surface reconstruction. Experimental results demonstrate that the proposed method significantly outperforms COLMAP and traditional PMVS 3D reconstruction techniques, yielding a 21.67% increase in the number of reconstructed point clouds and an ∼30% improvement in the structural similarity index (SSIM). In addition, this method reduces processing time by 24.67% while enhancing the visualization of complex surface reconstructions.