journal article·2025-12-02Open access

High-Frame-Rate Camera-Based Vibration Analysis for Health Monitoring of Industrial Robots Across Multiple Postures

Tuniyazi Abudoureheman, Hayato Otsubo, Feiyue Wang, Kohei Shimasaki, Idaku Ishii

Applied Sciences· Volume 15· Issue 23

Abstract

Accurate vibration measurement is crucial for maintaining the performance, reliability, and safety of automated manufacturing environments. Abnormal vibrations caused by faults in gears or bearings can degrade positional accuracy, reduce productivity, and, over time, significantly impair production efficiency and product quality. Such vibrations may also disrupt supply chains, cause financial losses, and pose safety risks to workers through collisions, falling objects, or other operational hazards. Conventional vibration measurement techniques, such as wired accelerometers and strain gauges, are typically limited to a few discrete measurement points. Achieving multi-point measurements requires numerous sensors, which increases installation complexity, wiring constraints, and setup time, making the process both time-consuming and costly. The integration of high-frame-rate (HFR) cameras with Digital Image Correlation (DIC) enables non-contact, multi-point, full-field vibration measurement of robot manipulators, effectively addressing these limitations. In this study, HFR cameras were employed to perform non-contact, full-field vibration measurements of industrial robots. The HFR camera recorded the robot’s vibrations at 1000 frames per second (fps), and the resulting video was decomposed into individual frames according to the frame rate. Each frame, with a resolution of 1920 × 1080 pixels, was divided into 128 × 128 pixel blocks with a 64-pixel stride, yielding 435 sub-images. This setup effectively simulates the operation of 435 virtual vibration sensors. By applying mask processing to these sub-images, eight key points representing critical robot components were selected for multi-point DIC displacement measurements, enabling effective assessment of vibration distribution and real-time vibration visualization across the entire manipulator. This approach allows simultaneous capture of displacements across all robot components without the need for physical sensors. The transfer function is defined in the frequency domain as the ratio between the output displacement of each robot component and the input excitation applied by the shaker mounted on the end-effector. The frequency–domain transfer functions were computed for multiple robot components, enabling accurate and full-field vibration analysis during operation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Structural Health Monitoring Techniques · Optical measurement and interference techniques · Image and Video Stabilization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Graduate School of Advanced Science and Engineering, Hiroshima University, Hiroshima 739-8527, Japan

Funding

JST SPRING

References (90)

Show source-provided references
1. An Intelligent Path Planning of Welding Robot Based on Multisensor Interaction10.1109/JSEN.2023.3252637 ↗
2. Yan, B., Fan, P., Lei, X., Liu, Z., and Yang, F. (2021). A Real-Time Apple Targets Detection Method for Picking Robot Based on Improved YOLOv5. Remote Sens., 13.10.3390/rs13091619 ↗
3. Optimization of Robot Posture and Workpiece Setup in Robotic Milling with Stiffness Threshold10.1109/TMECH.2021.3068599 ↗
4. Min, Y., Liu, X., Hu, G., Jin, G., Ma, Y., Bian, Y., Xie, Y., Hu, M., and Li, D. (2025). A Research Method to Investigate the Effect of Vibration Suppression on Thin-Walled Parts of Aluminum Alloy 6061 Based on Cutting Fluid Spraying (CFS). Machines, 13.10.3390/machines13070594 ↗
5. Intelligent Fault Diagnosis for Bearings of Industrial Robot Joints Under Varying Working Conditions Based on Deep Adversarial Domain Adaptation10.1109/TIM.2022.3158996 ↗
6. A Review of Planetary and Epicyclic Gear Dynamics and Vibrations Research10.1115/1.4027812 ↗
7. Sahu, G.N., Otto, A., and Ihlenfeldt, S. (2024). Improving Robotic Milling Performance through Active Damping of Low-Frequency Structural Modes. J. Manuf. Mater. Process., 8.10.3390/jmmp8040160 ↗
8. Qin, H., Li, Y., and Xiong, X. (2019). Workpiece Pose Optimization for Milling with Flexible-Joint Robots to Improve Quasi-Static Performance. Appl. Sci., 9.10.3390/app9061044 ↗
9. Optimal Motion Planning Under Dynamic Risk Region for Safe Human–Robot Cooperation10.1109/TMECH.2024.3408810 ↗
10. Inam, R., Raizer, K., Hata, A., Souza, R., Forsman, E., Cao, E., and Wang, S. (2018, January 4–7). Risk Assessment for Human-Robot Collaboration in an automated warehouse scenario. Proceedings of the 2018 IEEE 23rd International Conference on Emerging Technologies and Factory Automation (ETFA), Turin, Italy.10.1109/ETFA.2018.8502466 ↗
11. Collaborative robotics: New era of human-robot cooperation in the workplace10.1016/j.jsr.2020.06.013 ↗
12. Zhang, Y., Wu, J., Gao, B., Xia, L., Lu, C., Wang, H., and Cao, G. (2025). Fault Types and Diagnostic Methods of Manipulator Robots: A Review. Sensors, 25.10.3390/s25061716 ↗
13. An overview of time-based and condition-based maintenance in industrial application10.1016/j.cie.2012.02.002 ↗
14. Nguyen, T.D., Nguyen, T.H., Do, D.T.B., Pham, T.H., Liang, J.W., and Nguyen, P.D. (2025). Efficient and Explainable Bearing Condition Monitoring with Decision Tree-Based Feature Learning. Machines, 13.10.3390/machines13060467 ↗
15. A predictive maintenance approach in manufacturing systems via AI-based early failure detection10.1016/j.mfglet.2023.08.125 ↗
16. Harmonic Drive Gear Failures in Industrial Robots Applications: An Overview10.36001/phme.2021.v6i1.2849 ↗
17. Data-Driven Gearbox Failure Detection in Industrial Robots10.1109/TII.2019.2912809 ↗
18. Mohammed, A., Ghaithan, A., Al-Saleh, M., and Al-Ofi, K. (2020). Reliability-Based Preventive Maintenance Strategy of Truck Unloading Systems. Appl. Sci., 10.10.3390/app10196957 ↗
19. Fault Detection of Servo Motor Bearing Based on Speed Signal Under Variable-Speed Conditions
20. Aggogeri, F., Borboni, A., Merlo, A., Pellegrini, N., and Ricatto, R. (2016). Real-Time Performance of Mechatronic PZT Module Using Active Vibration Feedback Control. Sensors, 16.10.20944/preprints201608.0035.v1 ↗
21. A Hardware-Oriented Algorithm for Ultra-High-Speed Object Detection10.1109/JSEN.2019.2895294 ↗
22. Sharma, A., Shimasaki, K., Gu, Q., Chen, J., Aoyama, T., Takaki, T., Ishii, I., Tamura, K., and Tajima, K. (2016, January 13–15). Super high-speed vision platform for processing 1024 × 1024 images in real time at 12500 fps. Proceedings of the 2016 IEEE/SICE International Symposium on System Integration (SII), Sapporo, Japan.10.1109/SII.2016.7844055 ↗
23. Li, J., Shimasaki, K., Tuniyazi, A., Ishii, I., Ogihara, M., and Yoshiyama, M. (November, January 29). HFR Video-Based Hornet Detection Approach Using Wing-Beat Frequency Analysis. Proceedings of the 2023 IEEE SENSORS, Vienna, Austria.10.1109/SENSORS56945.2023.10324909 ↗
24. Real-Time Vibration Visualization Using GPU-Based High-Speed Vision10.20965/jrm.2022.p1011 ↗
25. Machinery Fault Diagnosis in Electric Motors Through Mechanical Vibration Monitoring Using Fiber Bragg Grating-Based Accelerometers10.1109/JSEN.2024.3400169 ↗
26. Vibration based condition monitoring and fault diagnosis of wind turbine planetary gearbox: A review10.1016/j.ymssp.2019.02.051 ↗
27. Wang, H., and Xie, J. (2025). Fault Diagnosis of Rolling Bearings Based on Acoustic Signals in Strong Noise Environments. Appl. Sci., 15.10.3390/app15031389 ↗
28. Vibration Mode and Motion Trajectory Simulations of an Articulated Robot by a Dynamic Model Considering Joint Bearing Stiffness10.20965/ijat.2021.p0631 ↗
29. An RFID-Enabled Wireless Strain Gauge Sensor for Static and Dynamic Structural Monitoring10.1109/JSEN.2016.2631259 ↗
30. Full-field modal identification using reliability-guided frequency-domain-based digital image correlation method based on multi-camera system10.1016/j.measurement.2023.112567 ↗
31. Vibration Suppression for Improving the Estimation of Kinematic Parameters on Industrial Robots
32. A Fault Diagnosis Method of Industrial Robot Rolling Bearing Based on Data Driven and Random Intuitive Fuzzy Decision10.1109/ACCESS.2019.2944974 ↗
33. Huang, X., Huang, H., and Wu, Z. (2023). Development of a Variable-Frequency Hammering Method Using Acoustic Features for Damage-Type Identification. Appl. Sci., 13.10.3390/app13031329 ↗
34. Edge Collaborative Compressed Sensing in Wireless Sensor Networks for Mechanical Vibration Monitoring10.1109/TII.2022.3222358 ↗
35. An international review of laser Doppler vibrometry: Making light work of vibration measurement10.1016/j.optlaseng.2016.10.023 ↗
36. Li, Y., Dieussaert, E., and Baets, R. (2022). Miniaturization of Laser Doppler Vibrometers—A Review. Sensors, 22.10.3390/s22134735 ↗
37. A Highly Accurate Calibration Method for Terrestrial Laser Doppler Velocimeter10.1109/TIM.2017.2685078 ↗
38. Dao, F., Zeng, Y., Zou, Y., Li, X., and Qian, J. (2021). Acoustic Vibration Approach for Detecting Faults in Hydroelectric Units: A Review. Energies, 14.10.3390/en14237840 ↗
39. Wang, Q., Zhang, Y., Cheng, S., Wang, X., Wu, S., and Liu, X. (2025). MEMS Acoustic Sensors: Charting the Path from Research to Real-World Applications. Micromachines, 16.10.3390/mi16010043 ↗
40. Nguyen, T.V., Okamoto, Y., Takeshita, T., Takei, Y., Okada, H., Nguyen, K., Phan, H.P., and Ichiki, M. (2022, January 9–13). Highly Sensitive Low-Frequency Acoustic Sensor Using Piezoresistive Cantilever. Proceedings of the 2022 IEEE 35th International Conference on Micro Electro Mechanical Systems Conference (MEMS), Tokyo, Japan.10.1109/MEMS51670.2022.9699524 ↗
41. Yeo, W., and Matsumoto, M. (2025). Fault Diagnosis Systems for Robots: Acoustic Sensing-Based Identification of Detached Components for Fault Localization. Appl. Sci., 15.10.3390/app15126564 ↗
42. Tanuska, P., Spendla, L., Kebisek, M., Duris, R., and Stremy, M. (2021). Smart Anomaly Detection and Prediction for Assembly Process Maintenance in Compliance with Industry 4.0. Sensors, 21.10.3390/s21072376 ↗
43. Wireless MEMS-Based Accelerometer Sensor Boards for Structural Vibration Monitoring: A Review10.1109/JSEN.2016.2630008 ↗
44. IoT connected device for vibration analysis and measurement10.1016/j.ohx.2020.e00109 ↗
45. Hasani, H., Freddi, F., Piazza, R., and Ceruffi, F. (2024). A Wireless Data Acquisition System Based on MEMS Accelerometers for Operational Modal Analysis of Bridges. Sensors, 24.10.3390/s24072121 ↗
46. Albarbar, A., Mekid, S., Starr, A., and Pietruszkiewicz, R. (2008). Suitability of MEMS Accelerometers for Condition Monitoring: An experimental study. Sensors, 8.10.3390/s8020784 ↗
47. Ozevin, D. (2020). MEMS Acoustic Emission Sensors. Appl. Sci., 10.10.3390/app10248966 ↗
48. Piezoelectric MEMS based acoustic sensors: A review10.1016/j.sna.2019.111756 ↗
49. Gemelli, A., Tambussi, M., Fusetto, S., Aprile, A., Moisello, E., Bonizzoni, E., and Malcovati, P. (2023). Recent Trends in Structures and Interfaces of MEMS Transducers for Audio Applications: A Review. Micromachines, 14.10.3390/mi14040847 ↗
50. Simple in-system control of microphone sensitivities in an array10.5194/jsss-13-81-2024 ↗
51. Wilmott, D., Alves, F., and Karunasiri, G. (2016). Bio-Inspired Miniature Direction Finding Acoustic Sensor. Sci. Rep., 6.10.1038/srep29957 ↗
52. Ivancic, J., and Alves, F. (2024). Directional Multi-Resonant Micro-Electromechanical System Acoustic Sensor for Low Frequency Detection. Sensors, 24.10.3390/s24092908 ↗
53. Frankovský, P., Delyová, I., Sivák, P., Bocko, J., Živčák, J., and Kicko, M. (2022). Modal Analysis Using Digital Image Correlation Technique. Materials, 15.10.3390/ma15165658 ↗
54. Wide-area Operation Monitoring of Conveyors Using a Panoramic Vibration Camera10.2355/isijinternational.ISIJINT-2021-182 ↗
55. Real-Time Vibration Source Tracking Using High-Speed Vision10.1109/JSEN.2016.2647690 ↗
56. Real-time defect detection and classification in robotic assembly lines: A machine learning framework10.1016/j.rcim.2025.103011 ↗
57. O’Donoughue, P., Gautier, F., Meteyer, E., Durand-Texte, T., Secail-Geraud, M., Foucart, F., Robin, O., Berry, A., Melon, M., and Pezerat, C. (2023). Comparison of three full-field optical measurement techniques applied to vibration analysis. Sci. Rep., 13.10.1038/s41598-023-30053-9 ↗
58. A comparative study of misalignment detection using a novel Wireless Sensor with conventional Wired Sensors10.1088/1742-6596/364/1/012049 ↗
59. Real-time three-dimensional vibration monitoring of rotating shafts using constant-density sinusoidal fringe pattern as tri-axial sensor10.1016/j.ymssp.2018.05.049 ↗
60. Vibration monitoring of rotating shafts using DIC and compressed sensing10.1016/j.optlastec.2024.112189 ↗
61. High-speed 3D digital image correlation vibration measurement: Recent advancements and noted limitations10.1016/j.ymssp.2016.04.014 ↗
62. Zettel, S., Norambuena, M., Dewald, R., and Böswald, M. (2023, January 9–13). Comparison of laser doppler vibrometry and digital image correlation measurement techniques for applications in vibroacoustics. Proceedings of the International Congress on Sound and Vibration (ICSV), Prague, Czech Republic.
63. Model-Based 3-D Vibration Measurement Using Stereo High-Frame-Rate Images10.1109/TIM.2025.3593568 ↗
64. A vibration recognition method based on deep learning and signal processing
65. Shimasaki, K., Jiang, M., Takaki, T., and Ishii, I. (2018, January 9–12). Real-time Multicopter Detection Using Pixel-level Digital Filters for Frame-Interpolated High-frame-rate Images. Proceedings of the 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Auckland, New Zealand.10.1109/AIM.2018.8452345 ↗
66. Jiang, M., Aoyama, T., Takaki, T., and Ishii, I. (2016, January 3–7). Vibration source localization for motion-blurred high-frame-rate videos. Proceedings of the 2016 IEEE International Conference on Robotics and Biomimetics (ROBIO), Qingdao, China.10.1109/ROBIO.2016.7866417 ↗
67. HFR-Video-Based Vibration Analysis of a Multi-Jointed Robot Manipulator10.20965/jrm.2025.p1205 ↗
68. Fedorova, D., Tlach, V., Kuric, I., Dodok, T., Zajačko, I., and Tucki, K. (2025). Technical Diagnostics of Industrial Robots Using Vibration Signals: Case Study on Detecting Base Unfastening. Appl. Sci., 15.10.3390/app15010270 ↗
69. Stiffness performance index based posture and feed orientation optimization in robotic milling process10.1016/j.rcim.2018.07.003 ↗
70. Vibration control of industrial robot arms by multi-mode time-varying input shaping10.1016/j.mechmachtheory.2020.104072 ↗
71. A Moment Approach to Positioning Accuracy Reliability Analysis for Industrial Robots10.1109/TR.2019.2919540 ↗
72. Posture Optimization in Robot Machining with Kinematic Redundancy for High-Precision Positioning10.20965/ijat.2023.p0494 ↗
73. Variable stiffness identification and configuration optimization of industrial robots for machining tasks10.1186/s10033-022-00778-1 ↗
74. D’Antona, A., Farsoni, S., Rizzi, J., and Bonfè, M. (2025). A Variable Stiffness System for Impact Analysis in Collaborative Robotics Applications with FPGA-Based Force and Pressure Data Acquisition. Sensors, 25.10.3390/s25133913 ↗
75. Stiffness-oriented posture optimization in robotic machining applications10.1016/j.rcim.2015.02.006 ↗
76. Vibration Analysis of a 5-DOF Long-Reach Robotic Arm10.3390/vibration5030034 ↗
77. Dynamic Behavior Analysis for a Six Axis Industrial Machining Robot10.4028/www.scientific.net/AMR.423.65 ↗
78. Birk, C., Kipfmüller, M., and Kotschenreuther, J. (2025). Dynamic Modeling and Analysis of Industrial Robots for Enhanced Manufacturing Precision. Actuators, 14.10.3390/act14070311 ↗
79. Bickel, V.T., Manconi, A., and Amann, F. (2018). Quantitative Assessment of Digital Image Correlation Methods to Detect and Monitor Surface Displacements of Large Slope Instabilities. Remote Sens., 10.10.3390/rs10060865 ↗
80. Lee, J., Jeong, S., Lee, Y.J., and Sim, S.H. (2019). Stress Estimation Using Digital Image Correlation with Compensation of Camera Motion-Induced Error. Sensors, 19.10.3390/s19245503 ↗
81. High Speed Image Correlation for Vibration Analysis10.1088/1742-6596/181/1/012064 ↗
82. Augmented-Resolution Digital image correlation algorithm for vibration measurements10.1016/j.measurement.2024.114565 ↗
83. Shahbaznia, M., Raissi Dehkordi, M., and Mirzaee, A. (2020). An Improved Time-Domain Damage Detection Method for Railway Bridges Subjected to Unknown Moving Loads. Period. Polytech. Civ. Eng.10.3311/PPci.15813 ↗
84. A wavelet neural network informed by time-domain signal preprocessing for bearing remaining useful life prediction10.1016/j.apm.2023.05.042 ↗
85. Degradation modeling for real-time estimation of residual lifetimes in dynamic environments10.1080/0740817X.2014.955153 ↗
86. Wehrle, E., Gufler, V., and Vidoni, R. (2020). Optimal In-Operation Redesign of Mechanical Systems Considering Vibrations—A New Methodology Based on Frequency-Band Constraint Formulation and Efficient Sensitivity Analysis. Machines, 8.10.3390/machines8010011 ↗
87. Kot, T., Bobovský, Z., Vysocký, A., Krys, V., Šafařík, J., and Ružarovský, R. (2021). Method for Robot Manipulator Joint Wear Reduction by Finding the Optimal Robot Placement in a Robotic Cell. Appl. Sci., 11.10.3390/app11125398 ↗
88. Rotor resonance avoidance by continuous adjustment of support stiffness10.1016/j.ijmecsci.2024.109092 ↗
89. Sun, J., Zhang, W., and Dong, X. (2020). Natural Frequency Prediction Method for 6R Machining Industrial Robot. Appl. Sci., 10.10.3390/app10228138 ↗
90. Xiu, C., Weng, Y., and Shi, W. (2023). Vision and Vibration Data Fusion-Based Structural Dynamic Displacement Measurement with Test Validation. Sensors, 23.10.3390/s23094547 ↗