journal article·2021-03-04Open access

Deep Malaria Parasite Detection in Thin Blood Smear Microscopic Images

Asma Maqsood, Muhammad Shahid Farid, Muhammad Hassan Khan, Marcin Grzegorzek

Applied Sciences· Volume 11· Issue 5

Abstract

Malaria is a disease activated by a type of microscopic parasite transmitted from infected female mosquito bites to humans. Malaria is a fatal disease that is endemic in many regions of the world. Quick diagnosis of this disease will be very valuable for patients, as traditional methods require tedious work for its detection. Recently, some automated methods have been proposed that exploit hand-crafted feature extraction techniques however, their accuracies are not reliable. Deep learning approaches modernize the world with their superior performance. Convolutional Neural Networks (CNN) are vastly scalable for image classification tasks that extract features through hidden layers of the model without any handcrafting. The detection of malaria-infected red blood cells from segmented microscopic blood images using convolutional neural networks can assist in quick diagnosis, and this will be useful for regions with fewer healthcare experts. The contributions of this paper are two-fold. First, we evaluate the performance of different existing deep learning models for efficient malaria detection. Second, we propose a customized CNN model that outperforms all observed deep learning models. It exploits the bilateral filtering and image augmentation techniques for highlighting features of red blood cells before training the model. Due to image augmentation techniques, the customized CNN model is generalized and avoids over-fitting. All experimental evaluations are performed on the benchmark NIH Malaria Dataset, and the results reveal that the proposed algorithm is 96.82% accurate in detecting malaria from the microscopic blood smears.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Imaging for Blood Diseases · Mosquito-borne diseases and control · Cell Image Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Punjab University College of Information Technology, University of the Punjab, Lahore 54000, Pakistan

Institute of Medical Informatics, University of Lübeck, Ratzeburger Allee 160, 23538 Lübeck, Germany

References (81)

Show source-provided references
1. World Health Organization (2016). Malaria Microscopy Quality Assurance Manual-Version 2, World Health Organization.
2. Rapid diagnostic tests for malaria parasites10.1128/CMR.15.1.66-78.2002 ↗
3. Bosco, A.B., Nankabirwa, J.I., Yeka, A., Nsobya, S., Gresty, K., Anderson, K., Mbaka, P., Prosser, C., Smith, D., and Opigo, J. (2021). Limitations of rapid diagnostic tests in malaria surveys in areas with varied transmission intensity in Uganda 2017–2019: Implications for selection and use of HRP2 RDTs. PLoS ONE, 15.10.1371/journal.pone.0244457 ↗
4. Adverse neuropsychiatric effects of antimalarial drugs10.1080/14740338.2016.1175428 ↗
5. Frean, J. (2010). Microscopic determination of malaria parasite load: Role of image analysis. Microsc. Sci. Technol. Appl. Educ., 862–866.
6. Moon, S., Lee, S., Kim, H., Freitas-Junior, L.H., Kang, M., Ayong, L., and Hansen, M.A.E. (2013). An Image Analysis Algorithm for Malaria Parasite Stage Classification and Viability Quantification. PLoS ONE, 8.10.1371/journal.pone.0061812 ↗
7. A web-accessible framework for automated storage with compression and textural classification of malaria parasite images
8. A review on automated diagnosis of malaria parasite in microscopic blood smears images10.1007/s11042-017-4495-2 ↗
9. Image analysis and machine learning for detecting malaria10.1016/j.trsl.2017.12.004 ↗
10. Manzo, M., and Pellino, S. (2020). Bucket of Deep Transfer Learning Features and Classification Models for Melanoma Detection. J. Imaging, 6.10.3390/jimaging6120129 ↗
11. Automatic detection of Plasmodium parasites from microscopic blood images10.1007/s12639-019-01163-x ↗
12. Machine learning approach for automated screening of malaria parasite using light microscopic images10.1016/j.micron.2012.11.002 ↗
13. Analysis of infected blood cell images using morphological operators10.1016/S0262-8856(01)00092-0 ↗
14. Digital image analysis for automatic enumeration of malaria parasites using morphological operations10.1016/j.eswa.2014.11.037 ↗
15. Tek, F.B., Dempster, A.G., and Kale, I. (2006, January 4–7). Malaria parasite detection in peripheral blood images. Proceedings of the British Machine Vision Conference 2006, Edinburgh, UK.10.5244/C.20.36 ↗
16. A semi-automatic method for quantification and classification of erythrocytes infected with malaria parasites in microscopic images10.1016/j.jbi.2008.11.005 ↗
17. Savkare, S.S., and Narote, S.P. (2015, January 15–17). Automated system for malaria parasite identification. Proceedings of the 2015 International Conference on Communication, Information & Computing Technology (ICCICT), Mumbai, India.10.1109/ICCICT.2015.7045660 ↗
18. Rakshit, P., and Bhowmik, K. (2013, January 9–11). Detection of presence of parasites in human RBC in case of diagnosing malaria using image processing. Proceedings of the IEEE Second International Conference on Image Information Processing (ICIIP-2013), Shimla, India.10.1109/ICIIP.2013.6707610 ↗
19. Automated and unsupervised detection of malarial parasites in microscopic images10.1186/1475-2875-10-364 ↗
20. Contour detection and hierarchical image segmentation10.1109/TPAMI.2010.161 ↗
21. Automatic system for classification of erythrocytes infected with malaria and identification of parasite’s life stage10.1016/j.protcy.2012.10.048 ↗
22. Segmentation based approach to detect parasites and RBCs in blood cell images
23. A combined algorithm for malaria detection from thick smear blood slides
24. Ghosh, M., Das, D., Chakraborty, C., and Ray, A.K. (2011, January 3–5). Plasmodium vivax segmentation using modified fuzzy divergence. Proceedings of the 2011 International Conference on Image Information Processing, Shimla, India.10.1109/ICIIP.2011.6108873 ↗
25. Automated colour segmentation of malaria parasite with fuzzy and fractal methods
26. Zhang, Z., Ong, L.L.S., Fang, K., Matthew, A., Dauwels, J., Dao, M., and Asada, H. (2016, January 16–20). Image classification of unlabeled malaria parasites in red blood cells. Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.10.1109/EMBC.2016.7591599 ↗
27. Aimi Salihah, A.N., Yusoff, M., and Zeehaida, M. (2013). Colour image segmentation approach for detection of malaria parasites using various colour models and k-means clustering. WSEAS Trans. Biol. Biomed, 10.
28. Structural and textural classification of erythrocytes in anaemic cases: A scanning electron microscopic study10.1016/j.micron.2012.09.003 ↗
29. Malaria infected erythrocyte classification based on the histogram features using microscopic images of thin blood smear10.17485/ijst/2016/v9i47/106827 ↗
30. Mandal, S., Kumar, A., Chatterjee, J., Manjunatha, M., and Ray, A.K. (2010, January 17–19). Segmentation of blood smear images using normalized cuts for detection of malarial parasites. Proceedings of the Annual IEEE India Conference (INDICON), Kolkata, India.10.1109/INDCON.2010.5712739 ↗
31. Kareem, S., Kale, I., and Morling, R.C.S. (2012, January 28–30). Automated P. falciparum Detection System for Post-Treatment Malaria Diagnosis Using Modified Annular Ring Ratio Method. Proceedings of the 2012 UKSim 14th International Conference on Computer Modelling and Simulation, Cambridge, UK.10.1109/UKSim.2012.108 ↗
32. Kareem, S., Kale, I., and Morling, R.C.S. (2012, January 2–5). Automated malaria parasite detection in thin blood films: A hybrid illumination and color constancy insensitive, morphological approach. Proceedings of the 2012 IEEE Asia Pacific Conference on Circuits and Systems, Kaohsiung, Taiwan.10.1109/APCCAS.2012.6419016 ↗
33. Detection of plasmodium parasites from images of thin blood smears10.4236/ojcd.2013.34034 ↗
34. Abdul Nasir, A.S., Mashor, M.Y., and Mohamed, Z. (2012, January 17–19). Segmentation based approach for detection of malaria parasites using moving k-means clustering. Proceedings of the 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences, Langkawi, Malaysia.10.1109/IECBES.2012.6498073 ↗
35. Das, D., Ghosh, M., Chakraborty, C., Maiti, A.K., and Pal, M. (2011, January 3–5). Probabilistic prediction of malaria using morphological and textural information. Proceedings of the 2011 International Conference on Image Information Processing, Shimla, India.10.1109/ICIIP.2011.6108879 ↗
36. Linder, N., Turkki, R., Walliander, M., Mårtensson, A., Diwan, V., Rahtu, E., Pietikäinen, M., Lundin, M., and Lundin, J. (2014). A malaria diagnostic tool based on computer vision screening and visualization of Plasmodium falciparum candidate areas in digitized blood smears. PLoS ONE, 9.10.1371/journal.pone.0104855 ↗
37. Muralidharan, V., Dong, Y., and David Pan, W. (2016, January 24–27). A comparison of feature selection methods for machine learning based automatic malarial cell recognition in wholeslide images. Proceedings of the 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), Las Vegas, NV, USA.10.1109/BHI.2016.7455873 ↗
38. Suwalka, I., Sanadhya, A., Mathur, A., and Chouhan, M.S. (2012, January 22–24). Identify malaria parasite using pattern recognition technique. Proceedings of the 2012 International Conference on Computing, Communication and Applications, Dindigul, India.10.1109/ICCCA.2012.6179129 ↗
39. Malaria disease identification and analysis using image processing
40. Automatic detection of malaria parasite from blood images
41. Improved technique for detection of malaria parasites within the blood cell images
42. Enhanced identification of malaria parasite using different classification algorithms in thick film blood images
43. Blood smear image based malaria parasite and infected-erythrocyte detection and segmentation10.1007/s10916-015-0280-9 ↗
44. Malaria parasite detection and cell counting for human and mouse using thin blood smear microscopy10.1117/1.JMI.5.4.044506 ↗
45. Dong, Y., Jiang, Z., Shen, H., David Pan, W., Williams, L.A., Reddy, V.V.B., Benjamin, W.H., and Bryan, A.W. (2017, January 16–19). Evaluations of deep convolutional neural networks for automatic identification of malaria infected cells. Proceedings of the 2017 IEEE EMBS International Conference on Biomedical Health Informatics (BHI), Orlando, FL, USA.10.1109/BHI.2017.7897215 ↗
46. Quinn, J.A., Nakasi, R., Mugagga, P.K., Byanyima, P., Lubega, W., and Andama, A. (2016, January 19–20). Deep convolutional neural networks for microscopy-based point of care diagnostics. Proceedings of the Machine Learning for Healthcare Conference, Los Angeles, CA, USA.
47. Microscopy cell counting and detection with fully convolutional regression networks10.1080/21681163.2016.1149104 ↗
48. Convolutional neural network-based malaria diagnosis from focus stack of blood smear images acquired using custom-built slide scanner10.1002/jbio.201700003 ↗
49. Liang, Z., Powell, A., Ersoy, I., Poostchi, M., Silamut, K., Palaniappan, K., Guo, P., Hossain, M.A., Sameer, A., and Maude, R.J. (2016, January 15–18). CNN-based image analysis for malaria diagnosis. Proceedings of the 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Shenzhen, China.10.1109/BIBM.2016.7822567 ↗
50. Pattanaik, P.A., Wang, Z., and Horain, P. (2019, January 28–30). Deep CNN frameworks comparison for malaria diagnosis. Proceedings of the IMVIP 2019 Irish Machine Vision and Image Processing Conference, Dublin, Ireland.
51. Hung, J., and Carpenter, A. (2017, January 21–26). Applying faster R-CNN for object detection on malaria images. Proceedings of the IEEE Conf. Comput. Vis. Pattern Recognit. Workshop (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.112 ↗
52. Pan, W.D., Dong, Y., and Wu, D. (2018). Classification of malaria-infected cells using deep convolutional neural networks. Machine Learning—Advanced Techniques and Emerging Applications, Intech Open.10.5772/intechopen.72426 ↗
53. Deep learning approach to detect malaria from microscopic images10.1007/s11042-019-7162-y ↗
54. Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images10.7717/peerj.4568 ↗
55. Sánchez, C.S. (2015). Deep Learning for Identifying Malaria Parasites in Images. [Master’s Thesis, University of Edinburgh].
56. Malaria parasite detection from peripheral blood smear images using deep belief networks10.1109/ACCESS.2017.2705642 ↗
57. Rahman, A., Zunair, H., Rahman, M.S., Yuki, J.Q., Biswas, S., Alam, M.A., Alam, N.B., and Mahdy, M. (2019). Improving Malaria Parasite Detection from Red Blood Cell using Deep Convolutional Neural Networks. arXiv.
58. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
59. An analysis of convolutional neural networks for image classification10.1016/j.procs.2018.05.198 ↗
60. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
61. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
62. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
63. Imagenet large scale visual recognition challenge10.1007/s11263-015-0816-y ↗
64. Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
65. Zhu, Y., and Newsam, S. (2017, January 17–20). DenseNet for dense flow. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.10.1109/ICIP.2017.8296389 ↗
66. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
67. Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4–9). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.11231 ↗
68. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conf. Comput. Vis. Pattern Recognit (CVPRW), Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
69. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
70. Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv.
71. Tomasi, C., and Manduchi, R. (1998, January 4–7). Bilateral Filtering for Gray and Color Images. Proceedings of the Sixth International Conference on Computer Vision (ICCV ’98), Bombay, India.
72. Dropout: A simple way to prevent neural networks from overfitting
73. Wang, J., and Perez, L. (2017). The effectiveness of data augmentation in image classification using deep learning. arXiv.
74. Chollet, F. (Keras Blog, 2016). Building powerful image classification models using very little data, Keras Blog.
75. A coefficient of agreement for nominal scales10.1177/001316446002000104 ↗
76. An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
77. Comparison of the predicted and observed secondary structure of T4 phage lysozyme10.1016/0005-2795(75)90109-9 ↗
78. The truth of the F-measure
79. DOST: A distributed object segmentation tool10.1007/s11042-017-5546-4 ↗
80. Chicco, D., and Jurman, G. (2020). Machine learning can predict survival of patients with heart failure from serum creatinine and ejection fraction alone. BMC Med. Inform. Decis. Mak., 20.10.1186/s12911-020-1023-5 ↗
81. Gradient-based learning applied to document recognition10.1109/5.726791 ↗