journal article·2022Open access

A Computer Vision-Based Model for Automatic Motion Time Study

Jirasak Ji, Warut Pannakkong, Jirachai Buddhakulsomsiri

Computers, Materials & Continua· Volume 73· Issue 2

Abstract

Motion time study is employed by manufacturing industries to determine operation time. An accurate estimate of operation time is crucial for effective process improvement and production planning. Traditional motion time study is conducted by human analysts with stopwatches, which may be exposed to human errors. In this paper, an automated time study model based on computer vision is proposed. The model integrates a convolutional neural network, which analyzes a video of a manual operation to classify work elements in each video frame, with a time study model that automatically estimates the work element times. An experiment is conducted using a grayscale video and a color video of a manual assembly operation. The work element times from the model are statistically compared to the reference work element time values. The result shows no statistical difference among the time data, which clearly demonstrates the effectiveness of the proposed model.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Elevator Systems and Control · Hand Gesture Recognition Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (23)

Show source-provided references
1. An intelligent-internet of things (IoT) outbound logistics knowledge management system for handling temperature sensitive products10.4018/IJKSS.2018010102 ↗
2. Automation in construction computer vision for real-time extrusion quality monitoring and control in robotic construction10.1016/j.autcon.2019.01.022 ↗
3. An embedded machine vision system for an in-line quality check of assembly processes10.1016/j.promfg.2020.02.072 ↗
4. Computer vision algorithms for measurement and inspection of external screw threads10.1016/j.measurement.2016.12.034 ↗
5. Computer vision based fruit grading system for quality evaluation of tomato in agriculture industry10.1016/j.procs.2016.03.055 ↗
6. Computer vision based detection of external defects on tomatoes using deep learning10.1016/j.biosystemseng.2019.12.003 ↗
7. K. O’Shea and R. Nash, “An introduction to convolutional neural networks,” arXiv preprint arXiv: 1511.08458, 2015.
8. Assets management on electrical grid using faster-RCNN
9. Fine-grained vehicle type classification using lightweight convolutional neural network with feature optimization and joint learning strategy10.1007/s11042-020-09171-3 ↗
10. A multi-feature learning model with enhanced local attention for vehicle re-identification10.32604/cmc.2021.021627 ↗
11. Decision support for the implementation of industry 4.0 methods: Toolbox, assessment and implementation sequences for industry 4.010.1016/j.jmsy.2020.12.008 ↗
12. Motion time study with convolutional neural network
13. Deep learning for sensor-based activity recognition: A survey10.1016/j.patrec.2018.02.010 ↗
14. Huang · Intelligent Computing Methodologies · 2019 · 56810.1007/978-3-030-26766-7_52 ↗
15. Automated work efficiency analysis for smart manufacturing using human pose tracking and temporal action localization10.1016/j.jvcir.2020.102948 ↗
16. Real time human action recognition using triggered frame extraction and a typical CNN heuristic10.1016/j.patrec.2020.04.031 ↗
17. Action recognition using optimized deep autoencoder and CNN for surveillance data streams of non-stationary environments10.1016/j.future.2019.01.029 ↗
18. Deep learning in computer vision: A critical review of emerging techniques and application scenarios10.1016/j.mlwa.2021.100134 ↗
19. Goodfellow · Deep Learning · 2016
20. A. Rosebrock, “Video classification with Keras and deep learning,” 2019. [Online]. Available: https://www.pyimagesearch.com/2019/07/15/video-classification-with-keras-and-deep-learning.
21. L. Perez and J. Wang, “The effectiveness of data augmentation in image classification using deep learning,” arXiv preprint arXiv: 1712.04621, 2017.
22. Accelerating stochastic gradient descent using predictive variance reduction
23. A survey of optimization methods from a machine learning perspective10.1109/TCYB.2019.2950779 ↗