journal article·2019-01-30Open access

Shot Classification of Field Sports Videos Using AlexNet Convolutional Neural Network

Rabia A. Minhas, Ali Javed, Aun Irtaza, Muhammad Tariq Mahmood, Young Bok Joo

Applied Sciences· Volume 9· Issue 3

Abstract

Broadcasters produce enormous numbers of sport videos in cyberspace due to massive viewership and commercial benefits. Manual processing of such content for selecting the important game segments is a laborious activity; therefore, automatic video content analysis techniques are required to effectively handle the huge sports video repositories. The sports video content analysis techniques consider the shot classification as a fundamental step to enhance the probability of achieving better accuracy for various important tasks, i.e., video summarization, key-events selection, and to suppress the misclassification rates. Therefore, in this research work, we propose an effective shot classification method based on AlexNet Convolutional Neural Networks (AlexNet CNN) for field sports videos. The proposed method has an eight-layered network that consists of five convolutional layers and three fully connected layers to classify the shots into long, medium, close-up, and out-of-the-field shots. Through the response normalization and the dropout layers on the feature maps we boosted the overall training and validation performance evaluated over a diverse dataset of cricket and soccer videos. In comparison to Support Vector Machine (SVM), Extreme Learning Machine (ELM), K-Nearest Neighbors (KNN), and standard Convolution Neural Network (CNN), our model achieves the maximum accuracy of 94.07%. Performance comparison against baseline state-of-the-art shot classification approaches are also conducted to prove the superiority of the proposed approach.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Video Analysis and Summarization · Music and Audio Processing · Sports Analytics and Performance

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Software Engineering, University of Engineering and Technology, Taxila 47050, Pakistan

Department of Computer Science, University of Engineering and Technology, Taxila 47050, Pakistan

School of Computer Science and Engineering, Korea University of Technology and Education, 1600 Chungjeolno, Byeogchunmyun, Cheonan 31253, South Korea

Funding

National Research Foundation of Korea

References (33)

Show source-provided references
1. Choroś, K. (2017). Automatic playing field detection and dominant color extraction in sports video shots of different view types. Multimedia and Network Information Systems, Springer.10.1007/978-3-319-43982-2_4 ↗
2. Learning laparoscopic video shot classification for gynecological surgery10.1007/s11042-017-4699-5 ↗
3. Application of the temporal aggregation and pre-categorization of news video shots to reduce the time of content analysis10.3233/JIFS-169154 ↗
4. Wei, W.-L., Lin, J.-C., Liu, T.-L., Yang, Y.-H., Wang, H.-M., Tyan, H.-R., and Liao, H.-Y.M. (2017, January 5–9). Deep-net fusion to classify shots in concert videos. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.10.1109/ICASSP.2017.7952383 ↗
5. Automatic topics segmentation for TV news video10.1117/12.2268462 ↗
6. Chauhan, D., Patel, N.M., and Joshi, M. (2016, January 14–16). Automatic summarization of basketball sport video. Proceedings of the 2016 2nd International Conference on Next Generation Computing Technologies (NGCT), Dehradun, India.10.1109/NGCT.2016.7877496 ↗
7. Automatic analysis of broadcast football videos using contextual priors10.1007/s11760-016-0916-3 ↗
8. Chacon-Quesada, R., and Siles-Canales, F. (2017, January 10–12). Evaluation of Different Histogram Distances for Temporal Segmentation in Digital Videos of Football Matches from TV Broadcast. Proceedings of the 2017 International Conference and Workshop on Bioinspired Intelligence (IWOBI), Funchal, Portugal.10.1109/IWOBI.2017.7985543 ↗
9. Bhattacharyya’s distance measure as a precursor of genetic distance measures10.1007/BF02703410 ↗
10. Automatic soccer video analysis and summarization10.1109/TIP.2003.812758 ↗
11. Sharma, R.A., Sankar, K.P., and Jawahar, C.V. (2015, January 3–6). Fine-grain annotation of cricket videos. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.10.1109/ACPR.2015.7486538 ↗
12. Sigari, M.-H., Soltanian-Zadeh, H., Kiani, V., and Pourreza, A.-R. (2015, January 3–5). Counterattack detection in broadcast soccer videos using camera motion estimation. Proceedings of the 2015 International Symposium on Artificial Intelligence and Signal Processing (AISP), Mashhad, Iran.10.1109/AISP.2015.7123487 ↗
13. A unified framework for semantic shot classification in sports video10.1109/TMM.2005.858395 ↗
14. Joe, Y.-H.N., Hausknecht, M., Vijayanarasimhan, S., Vinyals, O., Monga, R., and Toderici, G. (2015, January 7–12). Beyond short snippets: Deep networks for video classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.
15. Karmaker, D., Chowdhury, A.Z.M.E., Miah, M.S.U., Imran, M.A., and Rahman, M.H. (2015, January 21–23). Cricket shot classification using motion vector. Proceedings of the 2015 Second International Conference on Computing Technology and Information Management (ICCTIM), Johor, Malaysia.10.1109/ICCTIM.2015.7224605 ↗
16. Real-time event classification in field sport videos10.1016/j.image.2015.04.005 ↗
17. Papachristou, K., Tefas, A., Nikolaidis, N., and Pitas, I. (2014, January 21–24). Stereoscopic video shot classification based on Weighted Linear Discriminant Analysis. Proceedings of the 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP), Reims, France.10.1109/MLSP.2014.6958932 ↗
18. Burney, A., and Syed, T.Q. (2016, January 19–21). Crowd video classification using convolutional neural networks. Proceedings of the 2016 International Conference on Frontiers of Information Technology (FIT), Islamabad, Pakistan.10.1109/FIT.2016.052 ↗
19. Abu-El-Haija, S., Kothari, N., Lee, J., Natsev, P., Toderici, G., Varadarajan, B., and Vijayanarasimhan, S. (arXiv, 2016). Youtube-8m: A large-scale video classification benchmark, arXiv.
20. Lee, J., Koh, Y., and Yang, J. (2017, January 18–21). A deep learning-based video classification system using multimodality correlation approach. Proceedings of the 2017 17th International Conference on Control, Automation and Systems (ICCAS), Jeju, Korea.10.23919/ICCAS.2017.8204286 ↗
21. Taxonomy of directing semantics for film shot classification10.1109/TCSVT.2009.2022705 ↗
22. Kumar, A., Garg, J., and Mukerjee, A. (2014, January 5–7). Cricket activity detection. Proceedings of the 2014 First International Image Processing, Applications and Systems Conference (IPAS), Sfax, Tunisia.10.1109/IPAS.2014.7043264 ↗
23. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, Neural Information Processing System Foundations Inc.
24. Event detection and summarization in soccer videos using Bayesian network and copula10.1109/TCSVT.2013.2243640 ↗
25. Bagheri-Khaligh, A., Raziperchikolaei, R., and Moghaddam, M.E. (2012, January 22–24). A new method for shot classification in soccer sports video based on SVM classifier. Proceedings of the 2012 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI), Santa Fe, NM, USA.10.1109/SSIAI.2012.6202465 ↗
26. Real-time field sports scene classification using colour and frequency space decompositions10.1007/s11554-014-0437-7 ↗
27. (2019, July 01). Rabia and Ali Javed. Available online: https://datadryad.org/handle/10255/2/submit/58131f06892432862112314b2c7134460f387284.continue?processonly=true?processonly=true.
28. Local tetra patterns: A new feature descriptor for content-based image retrieval10.1109/TIP.2012.2188809 ↗
29. Robust Biometric Recognition from Palm Depth Images for Gloved Hands10.1109/THMS.2015.2453203 ↗
30. Soccer Video Structure Analysis by Parallel Feature Fusion Network and Hidden-to-Observable Transferring Markov Model10.1109/ACCESS.2017.2769140 ↗
31. Tien, M.-C., Chen, H.-T., Chen, Y.-W., Hsiao, M.-H., and Lee, S.-Y. (2007, January 15–20). Shot classification of basketball videos and its application in shooting position extraction. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2007), Honolulu, HI, USA.10.1109/ICASSP.2007.366100 ↗
32. Bayesian network-based customized highlight generation for broadcast soccer videos10.1109/TBC.2015.2424011 ↗
33. Automatic summarization of soccer highlights using audio-visual descriptors10.1186/s40064-015-1065-9 ↗