X-ray Image Generation for Robotic Radiography: a Case Study on Motion Blur in Drone-Based Wind Turbine Inspections
Source abstract
Abstract
Abstract Robotic X-ray imaging systems enable autonomous inspection of the internal integrity of critical infrastructure. However, these systems often suffer from vibrations and unwanted movements that cause motion blur in the resulting radiographs. The impact of this motion blur is often unknown until the first prototype is available and even then requires extensive experimental testing to assess. In addition, tests involving radiation are time-consuming, demand specialized equipment, and pose inherent safety risks. In this work, we propose using X-ray simulation as a tool to complement and replace real images during the development of robotic inspection systems. Our method extends an existing X-ray simulation framework (gVirtualXray) to generate motion-blurred images from any type of motion, which are then validated against experimental data. The approach is applicable to various robotic systems and we demonstrate its use for a decoupled two-drone inspection system for wind turbine blades. This is one of the most demanding applications due to the high degree of freedom of the system components and relatively long exposure times. The simulator provides insights into the motion blur sensitivity of the design, helping among others, to pinpoint the most significant degrees of freedom that affect image quality. Finally, we highlight the potential of the simulator for early estimation of performance limits, generation of training datasets for machine learning algorithms, and optimization of system design without the need for physical prototypes. Both the datasets and the software implementation are publicly available.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Advanced Neural Network Applications · Power Line Inspection Robots
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (38)
Show source-provided references
1. Gupta, M., Khan, M.A., Butola, R., Singari, R.M.: Advances in applications of non-destructive testing: a review. Advances in Materials and Processing Technologies 8(2), 2286–2307 (2022). https://doi.org/10.1080/2374068X.2021.190933210.1080/2374068X.2021.1909332 ↗
2. Hena, B., Wei, Z., Perron, L., Castanedo, C.I., Maldague, X.: Towards enhancing automated defect recognition (adr) in digital x-ray radiography applications: synthesizing training data through x-ray intensity distribution modeling for deep learning algorithms. Information 15(1), 16 (2023). https://doi.org/10.3390/info1501001610.3390/info15010016 ↗
3. Civera, M., Surace, C.: Non-destructive techniques for the condition and structural health monitoring of wind turbines: a literature review of the last 20 years. Sensors 22(4), 1627 (2022). https://doi.org/10.3390/s2204162710.3390/s22041627 ↗
4. Dahlstrom, R.: Robotic nde for industrial field inspections. Handbook of Nondestructive Evaluation 4, 1–22 (2021)
5. Du, W., Zhao, Y., Roy, R., Addepalli, S., Tinsley, L.: A review of miniaturised non-destructive testing technologies for in-situ inspections. Procedia Manufacturing 16, 16–23 (2018). https://doi.org/10.1016/j.promfg.2018.10.15210.1016/j.promfg.2018.10.152 ↗
6. Jianye, C., Yu, G., Liang, J., Qin, W., Zhu, K., Liu, T.: Research on X-Ray live inspection method for tensile clamps of transmission lines. In: 2022 7th Asia Conference on Power and Electrical Engineering (ACPEE), pp. 1441–1445.IEEE (2022). https://doi.org/10.1109/ACPEE53904.2022.978406110.1109/ACPEE53904.2022.9784061 ↗
7. Sattar, T.P., Marques, V., Anvo, R.N., Gallegos Garrido, G., Kaur, A.P., Routledge, P., Markham, K.: Climbing robot to perform radiography of wind blades. In: Robotics for Sustainable Future: CLAWAR 2021 24, pp. 165–176. Springer (2022). https://doi.org/10.1007/978-3-030-86294-7_1510.1007/978-3-030-86294-7_15 ↗
8. Zuo, F., Liu, J., Fu, M., Wang, L., Zhao, Z.: An x-ray-based multiexpert inspection method for automatic welding defect assessment in intelligent pipeline systems. IEEE/ASME Trans. Mechatron. (2024). https://doi.org/10.1109/TMECH.2024.340833710.1109/TMECH.2024.3408337 ↗
9. Wang, Z., Li, X., Hu, W.: A flexible towed aerial robot system for stable X-Ray inspection of power lines. In: 2023 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1–6.IEEE (2023). https://doi.org/10.1109/ROBIO58561.2023.1035479010.1109/ROBIO58561.2023.10354790 ↗
10. Lee, H., Hwang, Y.M., Lee, J., Kim, N.-W., Ko, S.-K.: A drone-driven x-ray image-based diagnosis of wind turbine blades for reliable operation of wind turbine. IEEE Access (2024). https://doi.org/10.1109/ACCESS.2024.338849410.1109/ACCESS.2024.3388494 ↗
11. Gao, Y., Song, G., Li, S., Zhen, F., Chen, D., Song, A.: Linespyx: a power line inspection robot based on digital radiography. IEEE Robotics and Automation Letters 5(3), 4759–4765 (2020). https://doi.org/10.1109/LRA.2020.300377210.1109/LRA.2020.3003772 ↗
12. Zhang, D., Watson, R., Dobie, G., MacLeod, C., Khan, A., Pierce, G.: Quantifying impacts on remote photogrammetric inspection using unmanned aerial vehicles. Eng. Struct. 209, 109940 (2020). https://doi.org/10.1016/j.engstruct.2019.10994010.1016/j.engstruct.2019.109940 ↗
13. Du, Q., Lin, J., Qu, F., Tian, L.: A deblurring methodology for motion-blurred x-ray images of transmission line tension clamps. Electrical Engineering 1–16 (2025)10.1007/s00202-024-02945-0 ↗
14. Pointon, J.L., Wen, T., Tugwell-Allsup, J., Sújar, A., Létang, J.M., Vidal, F.P.: Simulation of x-ray projections on gpu: benchmarking gvirtualxray with clinically realistic phantoms. Comput. Methods Programs Biomed. 234, 107500 (2023). https://doi.org/10.1016/j.cmpb.2023.10750010.1016/j.cmpb.2023.107500 ↗
15. Andriiashen, V., Liere, R., Leeuwen, T., Batenburg, K.J.: X-ray image generation as a method of performance prediction for real-time inspection: a case study. J. Nondestr. Eval. 43(3), 79 (2024). https://doi.org/10.1007/s10921-024-01091-810.1007/s10921-024-01091-8 ↗
16. WindpowerNL: Grant-Funded Project SpectX Revolutionizes Offshore Turbine Inspection (2023). https://windpowernl.com/2023/05/22/grant-funded-project-spectx-revolutionizes-offshore-turbine-inspection/
17. Nguyen, V.-G.: Digital radiography with a consumer camera: image denoising and deblurring. IEIE Transactions on Smart Processing & Computing 10(5), 398–406 (2021)10.5573/IEIESPC.2021.10.5.398 ↗
18. Chiu, M.-C., Wei, C.-J.: Integrating deblurgan and cnn to improve the accuracy of motion blur x-ray image classification. J. Nucl. Sci. Technol. 61(3), 403–416 (2024). https://doi.org/10.1080/00223131.2023.223610610.1080/00223131.2023.2236106 ↗
19. Tanaka, R., Nozaki, S., Goshima, F., Shiraishi, J.: Deep learning versus the human visual system for detecting motion blur in radiography. Journal of Medical Imaging 9(1), 015501–015501 (2022). https://doi.org/10.1117/1.JMI.9.1.01550110.1117/1.JMI.9.1.015501 ↗
20. Alvarez, J., Henderson, K., Aufderheide, M., Gallagher, B., Marcia, R., Jiang, M.: Overcoming data sparsity to enable deep learning for radiographic non-destructive testing. Technical report, Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States) (2023)
21. Van De Looverbosch, T., He, J., Tempelaere, A., Kelchtermans, K., Verboven, P., Tuytelaars, T., Sijbers, J., Nicolai, B.: Inline nondestructive internal disorder detection in pear fruit using explainable deep anomaly detection on x-ray images. Comput. Electron. Agric. 197, 106962 (2022). https://doi.org/10.1016/j.compag.2022.10696210.1016/j.compag.2022.106962 ↗
22. Vidal, F.P., Villard, P.-F.: Development and validation of real-time simulation of x-ray imaging with respiratory motion. Comput. Med. Imaging Graph. 49, 1–15 (2016). https://doi.org/10.1016/j.compmedimag.2015.12.00210.1016/j.compmedimag.2015.12.002 ↗
23. Vidal, F.P., Afshari, S., Ahmed, S., Albiol, A., Albiol, F., Béchet, É., Bellot, A.C., Bosse, S., Burkhard, S., Chahid, Y., et al.: X-ray simulations with gvxr in education, digital twining, experiment planning, and data analysis. Nucl. Instrum. Methods Phys. Res., Sect. B 568, 165804 (2025). https://doi.org/10.1016/j.nimb.2025.16580410.1016/j.nimb.2025.165804 ↗
24. Andriiashen, V., Liere, R., Leeuwen, T., Batenburg, K.J.: Quantifying the effect of x-ray scattering for data generation in real-time defect detection. J. Xray Sci. Technol. 32(4), 1099–1119 (2024). https://doi.org/10.3233/XST-23038910.3233/XST-230389 ↗
25. Neitzel, U.: Grids or air gaps for scatter reduction in digital radiography: a model calculation. Med. Phys. 19(2), 475–481 (1992). https://doi.org/10.1118/1.59683610.1118/1.596836 ↗
26. VCsecurity: Portable X-Ray detection Solution Catalogue. https://vc-security.net/media/attachments/2021/07/27/2021-vcsecurity-brochure_1by1_en.pdf. Accessed: 05/09/2024
27. Zaitsev, M., Maclaren, J., Herbst, M.: Motion artifacts in mri: a complex problem with many partial solutions. J. Magn. Reson. Imaging 42(4), 887–901 (2015). https://doi.org/10.1002/jmri.2485010.1002/jmri.24850 ↗
28. Voudoukis, N., Oikonomidis, S.: Inverse square law for light and radiation: A unifying educational approach. European Journal of Engineering and Technology Research 2(11), 23–27 (2017). https://doi.org/10.24018/ejeng.2017.2.11.51710.24018/ejeng.2017.2.11.517 ↗
29. Applus: Applus: Togheter Beyond Standards. https://www.applus.com/nl/nl/. Accessed: 09-10-2024
30. Hena, B., Wei, Z., Castanedo, C.I., Maldague, X.: Deep learning neural network performance on ndt digital x-ray radiography images: analyzing the impact of image quality parameters—an experimental study. Sensors 23(9), 4324 (2023). https://doi.org/10.3390/s2309432410.3390/s23094324 ↗
31. Wang, X., Wang, X., Han, L.: A novel parallel architecture for template matching based on zero-mean normalized cross-correlation. IEEE Access 7, 186626–186636 (2019). https://doi.org/10.1109/ACCESS.2019.296133410.1109/ACCESS.2019.2961334 ↗
32. Suzuki, K., Abe, H., MacMahon, H., Doi, K.: Image-processing technique for suppressing ribs in chest radiographs by means of massive training artificial neural network (mtann). IEEE Trans. Med. Imaging 25(4), 406–416 (2006). https://doi.org/10.1109/TMI.2006.87154910.1109/TMI.2006.871549 ↗
33. Wen, T., Mihail, R.P., Al-Maliki, S.F., Létang, J.-M., Vidal, F.P.: Registration of 3D triangular models to 2D X-Ray projections using black-box optimisation and X-Ray simulation. In: CGVC, pp. 105–113 (2019)
34. Ito, T., Ohtake, Y., Nagai, Y., Suzuki, H.: Thickness measurement of metal plate using CT projection images and nominal shape. In: 9th Conference on Industrial Computed Tomography (iCT 2019) (2019)
35. Frazier, P.I.: A tutorial on bayesian optimization. arXiv preprint arXiv:1807.02811 (2018). https://doi.org/10.48550/arXiv.1807.0281110.48550/arXiv.1807.02811 ↗
36. Avular: Avular Vertex One Drone Platform. https://www.avular.com/drones. Accessed: 09-11-2024
37. Friemann, J., Mikkelsen, L.P., Oddy, C., Fagerström, M.: Synthetic, automatically labelled training data for machine learning based x-ray ct image segmentation: Application to 3d-textile carbon fibre reinforced composites. Composites Part B: Engineering, 112656 (2025). https://doi.org/10.1016/j.compositesb.2025.11265610.1016/j.compositesb.2025.112656 ↗
38. Bosse, S., Lehmhus, D.: Automated detection of hidden damages and impurities in aluminum die casting materials and fibre-metal laminates using low-quality x-ray radiography, synthetic x-ray data augmentation by simulation, and machine learning. (2023). https://doi.org/10.48550/arXiv.2311.1204110.48550/arXiv.2311.12041 ↗