journal article·2025-06-29Open access

MSFNet: A Multi-Source Fusion-Based Method with Enhanced Hierarchical Spectral Semantic Perception for Wheat Disease Region Classification

Wenxu Jia, Ziyang Guo, Wenjing Zhang, Haixi Zhang, Bin Liu

Applied Sciences· Volume 15· Issue 13

Abstract

Wheat diseases threaten yield and food security, highlighting the need for rapid, accurate diagnosis in precision agriculture. However, current remote sensing methods often lack hierarchical spectral semantic perception or rely on single-source data and simple fusion, limiting diagnostic performance. To address these challenges, this study proposed MSFNet, a novel multi-source fusion network with enhanced hierarchical spectral semantic perception, to achieve the precise regional classification of wheat diseases. Specifically, a multi-source fusion module (MSFM) was developed, employing a dual-branch architecture to simultaneously enhance spatial–spectral semantics and comprehensively explore complementary cross-modal features, thereby enabling the effective integration of critical information from both modalities. Furthermore, a hierarchical spectral semantic fusion module (HSSFM) was developed, which employs a pyramid architecture integrated with attention mechanisms to fuse hierarchical spectral semantics, thereby significantly enhancing the model’s hierarchical feature representation capacity. To support this research, we constructed a new multispectral remote sensing dataset, MSWDD2024, tailored for wheat disease region diagnosis. Experimental evaluations on MSWDD2024 demonstrated that MSFNet achieved 95.4% accuracy, 95.6% precision, and 95.6% recall, surpassing ResNet18 by 6.0%, 6.0%, and 5.8%, respectively, and outperforming RGB-only models by over 12% across all metrics. Moreover, MSFNet consistently exceeded the performance of existing state-of-the-art methods. These results confirm the superior effectiveness of MSFNet in remote sensing-based wheat disease diagnosis, offering a promising solution for robust and accurate monitoring in precision agriculture.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Spectroscopy and Chemometric Analyses · Smart Agriculture and AI · Advanced Chemical Sensor Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Information Engineering, Northwest A&F University, Xianyang 712100, China

Key Laboratory of Agricultural Internet of Things, Ministry of Agriculture and Rural Affairs, Xianyang 712100, China

Shaanxi Key Laboratory of Agricultural Information Perception and Intelligent Service, Xianyang 712100, China

Funding

National Natural Science Foundation of China · National Natural Science Foundation of China Youth Project · Shaanxi’s Key Research and Development Program · Xianyang’s Key Research and Development Program · Technology Innovation Leading Program of Shaanxi · Xi’an Key Technology Research Projects for Key Agricultural Industry Chains · Chinese College Students’ Innovative Entrepreneurial Training Plan Program

References (44)

Show source-provided references
1. Wheat yield losses from pests and pathogens in China10.1016/j.agee.2021.107821 ↗
2. Grain weight response to foliar diseases control in wheat (Triticum aestivum L.)10.1016/j.fcr.2010.11.004 ↗
3. Imagenet classification with deep convolutional neural networks
4. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
5. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
6. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
7. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18–22). Shufflenet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00716 ↗
8. Mitra, A., Vangipuram, S.L.T., Bapatla, A.K., Bathalapalli, V.K.V.V., Mohanty, S.P., Kougianos, E., and Ray, C. (2022). Everything You wanted to Know about Smart Agriculture. arXiv.
9. Leaf and spike wheat disease detection & classification using an improved deep convolutional architecture10.1016/j.imu.2021.100642 ↗
10. Nachtigall, L.G., Araujo, R.M., and Nachtigall, G.R. (2016, January 6–8). Classification of Apple Tree Disorders Using Convolutional Neural Networks. Proceedings of the 2016 IEEE 28th International Conference on Tools with Artificial Intelligence, San Jose, CA, USA.10.1109/ICTAI.2016.0078 ↗
11. Shoaib, M., Shah, B., Ei-Sappagh, S., Ali, A., Ullah, A., Alenezi, F., Gechev, T., Hussain, T., and Ali, F. (2023). An advanced deep learning models-based plant disease detection: A review of recent research. Front. Plant Sci., 14.10.3389/fpls.2023.1282443 ↗
12. MEAN-SSD: A novel real-time detector for apple leaf diseases using improved light-weight convolutional neural networks10.1016/j.compag.2021.106379 ↗
13. An improved YOLOv5 model based on visual attention mechanism: Application to recognition of tomato virus disease10.1016/j.compag.2022.106780 ↗
14. Tsouros, D.C., Bibi, S., and Sarigiannidis, P.G. (2019). A Review on UAV-Based Applications for Precision Agriculture. Information, 10.10.3390/info10110349 ↗
15. Velusamy, P., Rajendran, S., Mahendran, R.K., Naseer, S., Shafiq, M., and Choi, J.G. (2022). Unmanned Aerial Vehicles in Precision Agriculture: Applications and Challenges. Energies, 15.10.3390/en15010217 ↗
16. Yield estimation in cotton using UAV-based multi-sensor imagery10.1016/j.biosystemseng.2020.02.014 ↗
17. Fu, Z., Jiang, J., Gao, Y., Krienke, B., Wang, M., Zhong, K., Cao, Q., Tian, Y., Zhu, Y., and Cao, W. (2020). Wheat Growth Monitoring and Yield Estimation based on Multi-Rotor Unmanned Aerial Vehicle. Remote Sens., 12.10.3390/rs12030508 ↗
18. Deep convolutional neural networks for rice grain yield estimation at the ripening stage using UAV-based remotely sensed images10.1016/j.fcr.2019.02.022 ↗
19. Advances in diagnosis of crop diseases, pests and weeds by UAV remote sensing
20. Shahi, T.B., Xu, C.Y., Neupane, A., and Guo, W. (2023). Recent Advances in Crop Disease Detection Using UAV and Deep Learning Techniques. Remote Sens., 15.10.3390/rs15092450 ↗
21. Kouadio, L., El Jarroudi, M., Belabess, Z., Laasli, S.E., Roni, M.Z.K., Amine, I.D.I., Mokhtari, N., Mokrini, F., Junk, J., and Lahlali, R. (2023). A Review on UAV-Based Applications for Plant Disease Detection and Monitoring. Remote Sens., 15.10.3390/rs15174273 ↗
22. Zhang, H., Wang, L., Tian, T., and Yin, J. (2021). A review of unmanned aerial vehicle low-altitude remote sensing (UAV-LARS) use in agricultural monitoring in China. Remote Sens., 13.10.3390/rs13061221 ↗
23. Single-plant broccoli growth monitoring using deep learning with UAV imagery10.1016/j.compag.2023.107739 ↗
24. Zhao, J., Zhang, X., Gao, C., Qiu, X., Tian, Y., Zhu, Y., and Cao, W. (2019). Rapid Mosaicking of Unmanned Aerial Vehicle (UAV) Images for Crop Growth Monitoring Using the SIFT Algorithm. Remote Sens., 11.10.3390/rs11101226 ↗
25. Fernández, C.I., Leblon, B., Haddadi, A., Wang, K., and Wang, J. (2020). Potato Late Blight Detection at the Leaf and Canopy Levels Based in the Red and Red-Edge Spectral Regions. Remote Sens., 12.10.3390/rs12081292 ↗
26. Selection of a spectral index for detection of orange spotting disease in oil palm (Elaeis guineensis Jacq.) using red edge and neural network techniques10.1007/s12524-018-0926-4 ↗
27. Moghadam, P., Ward, D., Goan, E., Jayawardena, S., Sikka, P., and Hernandez, E. (December, January 29). Plant disease detection using hyperspectral imaging. Proceedings of the 2017 International Conference on Digital Image Computing: Techniques and Applications, Sydney, Australia.10.1109/DICTA.2017.8227476 ↗
28. Neupane, K., and Baysal-Gurel, F. (2021). Automatic Identification and Monitoring of Plant Diseases Using Unmanned Aerial Vehicles: A Review. Remote Sens., 13.10.3390/rs13193841 ↗
29. Duarte, A., Borralho, N., Cabral, P., and Caetano, M. (2022). Recent Advances in Forest Insect Pests and Diseases Monitoring Using UAV-Based Data: A Systematic Review. Forests, 13.10.3390/f13060911 ↗
30. Li, H., Tan, B., Sun, L., Liu, H., Zhang, H., and Liu, B. (2024). Multi-Source Image Fusion Based Regional Classification Method for Apple Diseases and Pests. Appl. Sci., 14.10.3390/app14177695 ↗
31. Detecting wheat yellow dwarf disease by employing a Dual-Branch multiscale model from UAV multispectral images10.1016/j.compag.2025.109898 ↗
32. De Silva, M., and Brown, D. (2023). Multispectral Plant Disease Detection with Vision Transformer–Convolutional Neural Network Hybrid Approaches. Sensors, 23.10.3390/s23208531 ↗
33. Significant remote sensing vegetation indices: A review of developments and applications10.1155/2017/1353691 ↗
34. Meena, S.V., Dhaka, V.S., and Sinwar, D. (2020, January 6–8). Exploring the role of Vegetation indices in Plant diseases Identification. Proceedings of the 2020 Sixth International Conference on Parallel, Distributed and Grid Computing, Waknaghat, India.10.1109/PDGC50313.2020.9315814 ↗
35. Estimation of vegetation water content and photosynthetic tissue area from spectral reflectance: A comparison of indices based on liquid water and chlorophyll absorption features10.1016/S0034-4257(02)00151-7 ↗
36. A review of visible and near-infrared (Vis-NIR) spectroscopy application in plant stress detection10.1016/j.sna.2022.113468 ↗
37. Multi-sensor spectral synergies for crop stress detection and monitoring in the optical domain: A review10.1016/j.rse.2022.113198 ↗
38. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
39. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
40. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
41. Ma, N., Zhang, X., Zheng, H.T., and Sun, J. (2018, January 8–14). Shufflenet v2: Practical guidelines for efficient cnn architecture design. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
42. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
43. Xie, S., Girshick, R., Dollár, P., Tu, Z., and He, K. (2017, January 21–26). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.634 ↗
44. Tan, M., and Le, Q. (2021, January 18–24). Efficientnetv2: Smaller models and faster training. Proceedings of the International Conference on Machine Learning, PMLR, Virtual Event.