journal article·2020-12Open access

Computer Vision Approaches for Segmentation of Nanoscale Precipitates in Nickel-Based Superalloy IN718

Nishan M. Senanayake, Jennifer L. W. Carter

Abstract

Abstract Extracting accurate volume fraction and size measurements ofγ″ andγ′ precipitates in iron-based superalloys from micrographs is challenging and conventionally involves manual image processing due to their smaller size, and similar crystal structures and chemistries. The co-precipitation of composite particles further complicates automated segmentation. In this work, different types of traditional machine learning approaches and a convolutional neural network (CNN) were compared to a non-machine learning approach, for the segmentation of the composite particles ofγ″ andγ′ precipitates. The objective was to optimize metrics of segmentation accuracy and the required computational resources. The data set contains 47 experimentally generated scanning electron micrographs of IN718 alloy samples, computationally increased to 188 images (900 × 900 px). All algorithms are containerized using singularity, publicly available, and can be modified without dependencies. The CNN and the random forest models achieve 95% and 94% accuracy, respectively, on the test images with better computational efficiency than the non-machine learning algorithm. The CNN tested accurately over a range of imaging conditions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hydrogen embrittlement and corrosion behaviors in metals · Nuclear Physics and Applications · Additive Manufacturing Materials and Processes

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. Strondl A, Palm M, Gnauk J, Frommeyer G (2011) Microstructure and mechanical properties of nickel based superalloy IN718 produced by rapid prototyping with electron beam melting (EBM). Mater Sci Technol 27(5):876–88310.1179/026708309X12468927349451 ↗
2. Amato KN, Gaytan SM, Murr LE, Martinez E, Shindo PW, Hernandez J, Medina F (2012) Microstructures and mechanical behavior of Inconel 718 fabricated by selective laser melting. Acta Mater 60(5):2229–223910.1016/j.actamat.2011.12.032 ↗
3. Cozar R, Pineau A (1973) Morphology of y’ and y” precipitates and thermal stability of inconel 718 type alloys. Metall Transac 4(1):47–5910.1007/BF02649604 ↗
4. Brooks JW, Bridges PJ (1988) Metallurgical stability of Inconel alloy 718. Superalloys 88:33–42
5. Oblak JM, Paulonis DF, Duvall DS (1974) Coherency strengthening in Ni base alloys hardened by DO 22 γ′ precipitates. Metall Transac 5:1–14310.1007/BF02642938 ↗
6. Senanayake NM, Mukhopadhyay S, Carter JLW (2020) High-throughput approaches to establish quantitative process–structure–property correlations in Ni-base superalloys. In: Superalloys 2020. Springer, Cham. https://doi.org/10.1007/978-3-030-51834-9_6610.1007/978-3-030-51834-9_66 ↗
7. Kulawik K, Buffat PA, Kruk A, Wusatowska-Sarnek AM, Czyrska-Filemonowicz A (2015) Imaging and characterization of γ′ and γ ″nanoparticles in Inconel 718 by EDX elemental mapping and FIB–SEM tomography. Mater Charact 100:74–8010.1016/j.matchar.2014.12.012 ↗
8. Dubiel B, Kruk A, Stepniowska E, Cempura G, Geiger D, Formanek P, Czyrska-Filemonowicz A (2009) TEM, HRTEM, electron holography and electron tomography studies of γ′ and γ ''nanoparticles in Inconel 718 superalloy. J Microsc 236(2):149–15710.1111/j.1365-2818.2009.03283.x ↗
9. Xie X, Dong J, Wang G, You W, Du J, Zhao C, Loria E (2005) The effect of Nb, Ti, Al on precipitation and strengthening behavior of 718 type superalloys. Superalloys 718:625–706
10. Sarosi PM, Viswanathan GB, Whitis D, Mills MJ (2005) Imaging and characterization of fine γ′ precipitates in a commercial nickel-base superalloy. Ultramicroscopy 103(1):83–9310.1016/j.ultramic.2004.11.014 ↗
11. Semiatin SL, Kim SL, Zhang F, Tiley JS (2015) An investigation of high-temperature precipitation in powder-metallurgy, gamma/gamma-prime nickel-base superalloys. Metall Mater Transac A 46(4):1715–173010.1007/s11661-015-2748-0 ↗
12. Gabb TP et al. (2016) Comparison of γ-γ′ phase coarsening responses of three powder metal disk superalloys. p. 44
13. Smith TM, Bonacuse P, Sosa J, Kulis M, Evans L (2018) A quantifiable and automated volume fraction characterization technique for secondary and tertiary γ′ precipitates in Ni-based superalloys. Mater Charact 140:86–9410.1016/j.matchar.2018.03.051 ↗
14. Blavette D, Cadel E, Deconihout B (2000) The role of the atom probe in the study of nickel-based superalloys. Mater Charact 44(1–2):133–157.https://doi.org/10.1016/S1044-5803(99)00050-910.1016/S1044-5803(99)00050-9 ↗
15. Phillips PJ, McAllister D, Gao Y, Lv D, Williams REA, Peterson B, Mills MJ (2012) Nano γ′/γ ″composite precipitates in Alloy 718. Appl Phys Lett 100(21):21191310.1063/1.4721456 ↗
16. Smith TM, Senanayake NM, Sudbrack CK, Bonacuse P, Rogers RB, Chao P, Carter J (2019) Characterization of nanoscale precipitates in superalloy 718 using high resolution SEM imaging. Mater Charact 148:178–18710.1016/j.matchar.2018.12.018 ↗
17. Carter JL, Verma AK, Senanayake NM (2020) Harnessing legacy data to educate data-enabled structural materials engineers. MRS Adv 5(7):319–32710.1557/adv.2020.132 ↗
18. Dong H, Yang G, Liu F, Mo Y, Guo Y (2017) Automatic brain tumor detection and segmentation using U-Net based fully convolutional networks. Annual conference on medical image understanding and analysis. Springer, Cham, pp 506–517
19. Wen S, Kurc TM, Hou L, Saltz JH, Gupta RR, Batiste R, Zhu W (2018) Comparison of different classifiers with active learning to support quality control in nucleus segmentation in pathology images. AMIA Summits Transl Sci Proceed 2018:227
20. Rodriguez-Galiano V, Sanchez-Castillo M, Chica-Olmo M, Chica-Rivas MJOG (2015) Machine learning predictive models for mineral prospectivity: an evaluation of neural networks, random forest, regression trees and support vector machines. Ore Geol Rev 71:804–81810.1016/j.oregeorev.2015.01.001 ↗
21. Breiman L (2001) Random forests. Mach Learn 45(1):5–3210.1023/A:1010933404324 ↗
22. Archer KJ, Kimes RV (2008) Empirical characterization of random forest variable importance measures. Comput Stat Data Anal 52(4):2249–226010.1016/j.csda.2007.08.015 ↗
23. Suykens JA, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–30010.1023/A:1018628609742 ↗
24. Ma J, Sheridan RP, Liaw A, Dahl GE, Svetnik V (2015) Deep neural nets as a method for quantitative structure–activity relationships. J Chem Inf Model 55(2):263–27410.1021/ci500747n ↗
25. Simard PY, Steinkraus D, Platt JC (2003) Best practices for convolutional neural networks applied to visual document analysis. Icdar 3:2003
26. Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 234–241
27. Tan C, Sun F, Kong T, Zhang W, Yang C, Liu C (2018) A survey on deep transfer learning. International conference on artificial neural networks. Springer, Cham, pp 270–279
28. Tang A, Tam R, Cadrin-Chênevert A, Guest W, Chong J, Barfett J, Poudrette MG (2018) Canadian association of radiologists white paper on artificial intelligence in radiology. Can Assoc Radiol J 69(2):120–13510.1016/j.carj.2018.02.002 ↗
29. Li W, Chen C, Zhang M, Li H, Du Q (2018) Data augmentation for hyperspectral image classification with deep CNN IEEE. Geosci Remote Sens Lett 16(4):593–59710.1109/LGRS.2018.2878773 ↗
30. Zafari S, Eerola T, Sampo J, Kälviäinen H, Haario H (2015) Segmentation of overlapping elliptical objects in silhouette images IEEE. Trans Image Process 24(12):5942–595210.1109/TIP.2015.2492828 ↗
31. Loy G, Zelinsky A (2003) Fast radial symmetry for detecting points of interest IEEE. Trans Pattern Anal Mach Intell 25(8):959–97310.1109/TPAMI.2003.1217601 ↗
32. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Vanderplas J (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830
33. Culjak I, Abram D, Pribanic T, Dzapo H, Cifrek M (2012) A brief introduction to OpenCV. In: 2012 proceedings of the 35th international convention MIPRO (pp. 1725–1730). IEEE
34. Souza A, Oliveira LB, Hollatz S, Feldman M, Olukotun K, Holton JM, Nardi L (2019) Deepfreak: learning crystallography diffraction patterns with automated machine learning. arXiv preprint arXiv 1904:11834
35. Kamarainen JK (2012) Gabor features in image analysis. In: 2012 3rd international conference on image processing theory, tools and applications (IPTA) (pp. 13–14). IEEE10.1109/IPTA.2012.6469502 ↗
36. Choras RS (2007) Image feature extraction techniques and their applications for CBIR and biometrics systems. Int J Biol Biomed Eng 1(1):6–16
37. Alkaabi S, Deravi F (2004) Candidate pruning for fast corner detection. Electron Lett 40(1):18–1910.1049/el:20040023 ↗
38. Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: An efficient alternative to SIFT or SURF. In: 2011 International conference on computer vision (pp. 2564–2571). IEEE10.1109/ICCV.2011.6126544 ↗
39. Krig S (2016) Computer vision metrics. Springer, Berlin, Germany, pp 187–24610.1007/978-3-319-33762-3_6 ↗
40. Paper D, Paper D (2020) Scikit-learn classifier tuning from simple training sets. Hands-on Scikit-learn for machine learning applications: data science fundamentals with Python. Apress, Berkeley, pp 137–16310.1007/978-1-4842-5373-1_5 ↗
41. Acharjya PP, Das R, Ghoshal D (2012) Study and comparison of different edge detectors for image segmentation. Glob J Comput Sci Technol
42. Kramer O (2016) Scikit-learn. Machine learning for evolution strategies. Springer, Cham, pp 45–53
43. Targ S, Almeida D, Lyman K (2016) Resnet in resnet: generalizing residual architectures. arXiv preprint arXiv 1603:08029
44. Howard J, Gugger S (2020) Fastai: a layered API for deep learning. Information 11l:2–10810.3390/info11020108 ↗
45. Cortes C, Mohri M, Rostamizadeh A (2012) L2 regularization for learning kernels. arXiv Preprint arXiv 1205:2653
46. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958
47. Rognvaldsson TS (1998) A simple trick for estimating the weight decay parameter. Neural networks: tricks of the trade Springer, Berlin, Heidelberg, pp 71–9210.1007/3-540-49430-8_4 ↗
48. Zhang Z, Sabuncu M (2018) Generalized cross entropy loss for training deep neural networks with noisy labels. Adv Neural Inf Process Syst 31:8778–8788. https://papers.nips.cc/paper/2018/file/f2925f97bc13ad2852a7a551802feea0-Paper.pdf
49. Goodfellow I, Bengio Y, Courville A (2016) Deep feedforward networks. Deep learning. 168–227
50. Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv Preprint arXiv 1412:6980
51. Tieleman T, Hinton G (2012) Lecture magnitude. Neural Netw Mach Learn 4(2):26–31
52. Agarap AF (2018) Deep learning using rectified linear units (relu). arXiv Preprint arXiv 1803:08375
53. Binguitcha-Fare AA, Sharma P (2019) Crops and weeds classification using convolutional neural networks via optimization of transfer learning parameters. Int J Eng Adv Technol (IJEAT) 8(5):2249–8958
54. Bickel S, Brückner M, Scheffer T (2007) Discriminative learning for differing training and test distributions. In: proceedings of the 24th international conference on Machine learning, pp 81–8810.1145/1273496.1273507 ↗
55. Smith LN (2018) A disciplined approach to neural network hyper-parameters: part 1-learning rate, batch size, momentum, and weight decay. arXiv Preprint arXiv 1803:09820
56. Kurtzer GM, Sochat V, Bauer MW (2017) Singularity: scientific containers for mobility of computers. PLoS One 12(5):e017745910.1371/journal.pone.0177459 ↗
57. Clark A (2015) Pillow (PIL fork) documentation