journal article·2025Open access

Enhancing Classroom Behavior Recognition with Lightweight Multi-Scale Feature Fusion

Chuanchuan Wang, Ahmad Sufril Azlan Mohamed, Xiao Yang, Hao Zhang, Xiang Li, Mohd Halim Bin Mohd Noor

Computers, Materials & Continua· Volume 85· Issue 1

Abstract

Classroom behavior recognition is a hot research topic, which plays a vital role in assessing and improving the quality of classroom teaching. However, existing classroom behavior recognition methods have challenges for high recognition accuracy with datasets with problems such as scenes with blurred pictures, and inconsistent objects. To address this challenge, we proposed an effective, lightweight object detector method called the RFNet model (YOLO-FR). The YOLO-FR is a lightweight and effective model. Specifically, for efficient multi-scale feature extraction, effective feature pyramid shared convolutional (FPSC) was designed to improve the feature extract performance by leveraging convolutional layers with varying dilation rates from the input image in the backbone. Secondly, to address the problem of multi-scale variability in the scene, we design the Rep Ghost fusion Cross Stage Partial and Efficient Layer Aggregation Network (RGCSPELAN) to improve the network performance further and reduce the amount of computation and the number of parameters. In addition, by conducting experimental valuation on the SCB dataset3 and STBD-08 dataset. Experimental results indicate that, compared to the baseline model, the RFNet model has increased mean accuracy precision (mAP@50) from 69.6% to 71.0% on the SCB dataset3 and from 91.8% to 93.1% on the STBD-08 dataset. The RFNet approach has effectiveness precision at 68.6%, surpassing the baseline method (YOLOv11) at 3.3% and archieve the minimal size (4.9 M) on the SCB dataset3. Finally, comparing it with other algorithms, it accurately detects student behavior in complex classroom environments results confirmed that RFNet is well-suited for real-time and efficiently recognizing classroom behaviors.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: IoT-based Smart Home Systems · Speech and Audio Processing · Hand Gesture Recognition Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (26)

Show source-provided references
1. CSSA-YOLO: cross-scale spatiotemporal attention network for fine-grained behavior recognition in classroom environments10.3390/s25103132 ↗
2. Multi-object behaviour recognition based on object detection cascaded image classification in classroom scenes10.1007/s10489-024-05409-x ↗
3. Multi-scale single-stage pose detection with adaptive sample training in the classroom scene10.1016/j.knosys.2021.107008 ↗
4. Classroom behavior detection based on improved YOLOv5 algorithm combining multi-scale feature fusion and attention mechanism10.3390/app12136790 ↗
5. CBPH-net: a small object detector for behavior recognition in classroom scenarios
6. Student behavior recognition for interaction detection in the classroom environment10.1016/j.imavis.2023.104726 ↗
7. Sun · Adv Neural Info Proc Sys · 2021 · 2021(DB1) · 1
8. Multi-object behavior recognition based on object detection for dense crowds10.1016/j.eswa.2024.123397 ↗
9. Jocher G, Qiu J, Chaurasia A. Ultralytics YOLO (Version 8.0.0) [Computer software]. 2023 [cited 2025 Jun 18]. Available from: https://github.com/ultralytics/ultralytics.
10. Analysis of art classroom teaching behavior based on intelligent image recognition
11. The recognition of teacher behavior based on multimodal information fusion10.1155/2020/8269683 ↗
12. A local-global estimator based on large kernel CNN and transformer for human pose estimation and running pose measurement
13. You only look once: unified, real-time object detection
14. Ssd: single shot multibox detector
15. Tracking individuals in classroom videos via post-processing OpenPose data.
16. Pose detection in complex classroom environment based on improved Faster R-CNN10.1049/iet-ipr.2018.5905 ↗
17. Faster R-CNN: towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
18. YOLOv5 enhanced learning behavior recognition and analysis in smart classroom with multiple students
19. An efficient model for student behavior recognition in classroom
20. Li C, Li L, Jiang H, Weng K, Geng Y, Li L, et al. YOLOv6: a single-stage object detection framework for industrial applications. arXiv: 2209.02976,2022.
21. Jocher G. YOLO by Ultralytics. 2023 [cited 2025 Jun 18]. Available from: https://github.com/ultralytics/ultralytics.
22. Wang A, Chen H, Liu L, Chen K, Lin Z, Han J et al. YOLOv10: real-time end-to-end object detection. arXiv:2405.14458, 2024.10.52202/079017-3429 ↗
23. Ghostnet: more features from cheap operations
24. Student classroom behavior detection based on YOLOv7+ BRA and multi-model fusion
25. Detrs beat yolos on real-time object detection
26. ShadowFPN-YOLO: a real-time NMS-free detector for remote sensing ship detection10.1109/ACCESS.2025.3554018 ↗