journal article·2023-08Open access

Robustness of machine learning to color, size change, normalization, and image enhancement on micrograph datasets with large sample differences

Xiaolong Pei, Yu hong Zhao, Liwen Chen, Qingwei Guo, Zhiqiang Duan, Yue Pan, Hua Hou

Materials & Design· Volume 232

Abstract

Appropriate image preprocessing could improve machine learning performance, but the robustness of machine learning to preprocessing methods in micrograph datasets with significant sample differences remains unexplored. Here we collected hundreds of optical micrographs varied in color, contrast, size and brightness and tensile strength from published literature. After preprocessing including color transformation, size adjustment, normalization and image enhancement, classification model of whether it was texture or not and tensile strength prediction model were established using transfer learning and VGG16 model. Our results showed comparable accuracy between classification models using grayscale and color micrographs. Based on grayscale images, classification model utilizing center cropping achieved an average accuracy 1.09% higher than model employing scaling, while coefficient of determination (R2) of regression model showed an average increase of 0.0404. The combination of cropping and dividing by 255 was preferable for classification model, yielding an accuracy of 90.79%. Similarly, the combination of cropping and min–max normalization had a better effect on regression model, yielding R2 of 0.2167. Histogram equalization emerged as the optimal technique for improving classification model, yielding 2.63% increase in accuracy compared to models without image enhancement. For regression models, gamma correction exhibited the highest improvement effect, with an R2 of 0.2681.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Single-cell and spatial transcriptomics · Image Enhancement Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (51)

Show source-provided references
1. Semi-supervised learning approaches to class assignment in ambiguous microstructures10.1016/j.actamat.2020.01.046 ↗
2. A generic high-throughput microstructure classification and quantification method for regular SEM images of complex steel microstructures combining EBSD labeling and deep learning10.1016/j.jmst.2021.04.009 ↗
3. Adaptive characterization of microstructure dataset using a two stage machine learning approach10.1016/j.commatsci.2020.109593 ↗
4. An improved 3D microstructure reconstruction approach for porous media10.1016/j.actamat.2022.118472 ↗
5. Understanding and design of metallic alloys guided by phase-field simulations10.1038/s41524-023-01038-z ↗
6. A deep learning-aided prediction approach for creep rupture time of Fe–Cr–Ni heat-resistant alloys by integrating textual and visual features10.1016/j.jmrt.2022.02.099 ↗
7. Deep-layers-assisted machine learning for accurate image segmentation of complex materials10.1016/j.matchar.2022.112175 ↗
8. A new method for classifying and segmenting material microstructure based on machine learning
9. Automated segmentation of martensite-austenite islands in bainitic steel10.1016/j.matchar.2022.112091 ↗
10. A study of real-world micrograph data quality and machine learning model robustness10.1038/s41524-021-00616-3 ↗
11. A methodology of steel microstructure recognition using SEM images by machine learning based on textural analysis10.1016/j.mtcomm.2020.101514 ↗
12. Microstructure cluster analysis with transfer learning and unsupervised learning10.1007/s40192-018-0116-9 ↗
13. Preprocessing for image classification by convolutional neural networks
14. Effect of preprocessing on performance of neural networks for microscopy image classification
15. Enlarging smaller images before inputting into convolutional neural network: zero-padding vs. interpolation10.1186/s40537-019-0263-7 ↗
16. Comparative analysis of image binarization methods for crack identification in concrete structures10.1016/j.cemconres.2017.04.018 ↗
17. Survey of contrast enhancement techniques based on histogram equalization
18. Automatic steel labeling on certain microstructural constituents with image processing and machine learning tools10.1080/14686996.2019.1610668 ↗
19. Computer vision and machine learning for autonomous characterization of AM powder feedstocks10.1007/s11837-016-2226-1 ↗
20. Material phase classification by means of Support Vector Machines10.1016/j.commatsci.2018.02.054 ↗
21. Pre-training on Grayscale ImageNet Improves Medical Image Classification
22. Investigating the impact of data normalization on classification performance10.1016/j.asoc.2019.105524 ↗
23. Objective microstructure classification by support vector machine (SVM) using a combination of morphological parameters and textural features for low carbon steels10.1016/j.commatsci.2019.01.006 ↗
24. Comparative analysis of color- and grayscale-based feature descriptions for image recognition10.1134/S1054661813030115 ↗
25. Learning to resize images for computer vision tasks
26. Digital image noise removal based on collaborative filtering approach and singular value decomposition10.1007/s11042-022-12774-7 ↗
27. A comparative study of medical image enhancement algorithms and quality assessment metrics on COVID-19 CT images10.1007/s11760-022-02214-2 ↗
28. Effect of image sharpening on radiographic image quality10.1016/j.prosdent.2018.03.034 ↗
29. S. Singh, R. Singh. Comparison of various edge detection techniques. INDIACom. (2015):393-396.
30. A comparative study of edge detection techniques in digital images
31. Comparison of Korean facial expression classification performance between deep learning based image filters10.33097/JNCTA.2022.06.05.767 ↗
32. Optimized deep networks for the classification of nanoparticles in scanning electron microscopy imaging10.1016/j.commatsci.2023.112135 ↗
33. Tool wear classification based on convolutional neural network and time series images during high precision turning of copper10.1016/j.wear.2023.204692 ↗
34. K. Simonyan, A. Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556 (2014).doi: 10.48550/arXiv.1409.1556.
35. Accelerated prediction of Vickers hardness of Co- and Ni-based superalloys from microstructure and composition using advanced image processing techniques and machine learning10.1016/j.actamat.2020.06.042 ↗
36. Z. Duan, X. Pei, Q. Guo, H. Hou, Y. Zhao. Multi-modal hybrid input simulation process for the design of a new Al-Si-Mg system alloy. Acta Phys. Sin.-Ch Ed, 72, 028101(2023) doi: 10.7498/aps.72.20221736.10.7498/aps.72.20221736 ↗
37. H. M. Bui, M. Lech, E. Cheng, K. Neville, I. S. Burnett. Using grayscale images for object recognition with convolutional-recursive neural network. ICCE. IEEE. (2016) 321-325. doi: 10.1109/CCE.2016.7562656.10.1109/CCE.2016.7562656 ↗
38. A. Singh, A. Bay, A. Mirabile. Assessing The Importance Of Colours For CNNs In Object Recognition. arXiv preprint arXiv:201206917 (2020).doi: 10.48550/arXiv.2012.06917.
39. Correlation between the mechanical properties and the <110> texture in a hot-rolled near β titanium alloy10.1016/j.jmst.2021.04.048 ↗
40. Deformation-induced dynamic precipitation of 14H-LPSO structure and its effect on dynamic recrystallization in hot-extruded Mg-Y-Zn alloys10.1016/j.ijplas.2023.103573 ↗
41. Effect of the morphology of long-period stacking ordered phase on mechanical properties and corrosion behavior of cast Mg-Zn-Y-Ti alloy10.1016/j.jallcom.2018.06.056 ↗
42. Improving mechanical and wear properties of multiphase M50 steel by tailoring bainite morphology10.1016/j.jmrt.2023.01.080 ↗
43. Microstructure and properties of graphene nanoplatelets reinforced AZ91D matrix composites prepared by electromagnetic stirring casting10.1016/j.jmrt.2022.11.033 ↗
44. Reinforced AZ91D magnesium alloy with thixomolding process facilitated dispersion of graphene nanoplatelets and enhanced interfacial interactions10.1016/j.msea.2021.140793 ↗
45. K. B. D. Raad, K. A. V. Garderen, M. Smits, S. R. V. D. Voort, F. Incekara, E. H. G. Oei, et al. The effect of preprocessing on convolutional neural networks for medical image segmentation. ISBI, IEEE. (2021) 655-658. doi: 10.1109/ISBI48211.2021.9433952.10.1109/ISBI48211.2021.9433952 ↗
46. S. Patel, K. P. Bharath, S. Balaji, R. K. Muthu. Comparative study on histogram equalization techniques for medical image enhancement. Soft computing for problem solving. (2020):657-669. doi: 10.1007/978-981-15-0035-0_54.10.1007/978-981-15-0035-0_54 ↗
47. Adaptive histogram equalization and its variations10.1016/S0734-189X(87)80186-X ↗
48. An optimization-based approach to gamma correction parameter estimation for low-light image enhancement10.1007/s11042-021-10614-8 ↗
49. Automatic contrast-limited adaptive histogram equalization with dual gamma correction10.1109/ACCESS.2018.2797872 ↗
50. Ş. Öztürk, B. Akdemir. Effects of histopathological image pre-processing on convolutional neural networks. Procedia Comp. Sci. 132 (2018) 396-403. doi: 10.1016/j.procs.2018.05.166.10.1016/j.procs.2018.05.166 ↗
51. E. Avşar. Effects of image preprocessing on the performance of convolutional neural networks for pneumonia detection. INISTA. (2021):1-5. doi: 10.1109/INISTA52262.2021.9548351.10.1109/INISTA52262.2021.9548351 ↗