Phase Identification in Synchrotron X-ray Diffraction Patterns of Ti–6Al–4V Using Computer Vision and Deep Learning
Source abstract
Abstract
X-ray diffraction patterns contain information about the atomistic structure and microstructure (defect population) of materials, extracting detailed information from diffraction patterns is complex, demanding and relies on prior knowledge. We hypothesize that deep-learning techniques can help to perform an effective and accurate analysis with high throughput rates. To demonstrate this concept, we applied a novel deep learning framework to determine the evolution of the (upbeta )-phase volume fraction in a Ti–6Al–4V alloy during heat-treatment from video sequences of 2D diffraction patterns recorded in transmission and with highly monochromatic radiation in a synchrotron beamline. In particular, we studied the impact of network design on prediction reliability and computational performance. Networks of different architectures were trained using 3008 experimental 2D patterns. A well-tuned model was found to reproduce the phase fractions of another experimental data set, consisting of 1100 diffraction patterns, with a mean-square error as small as (2.6 imes 10-4). The average prediction error of (upbeta )-phase volume fraction was within (1.6 imes 10-2) (in each diffraction pattern) of the values obtained by conventional methods. Our work demonstrates that convolutional neural networks can evaluate high energy X-ray diffraction patterns with a remarkable level of reliability. Furthermore, it demonstrates the significance of network design on the reliability of predictions and computational performance. The most complex models do not necessarily result in highest accuracy and may even fail to learn from the data.
Source: expertdata · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Machine Learning in Materials Science · X-ray Diffraction in Crystallography · Nuclear Physics and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (49)
Show source-provided references
1. Malinov S, Sha W, Guo Z, Tang CC, Long AE (2002) Synchrotron X-ray diffraction study of the phase transformations in titanium alloys. Mater Charact 48(4):279–295. https://doi.org/10.1016/S1044-5803(02)00286-310.1016/S1044-5803(02)00286-3 ↗
2. Chauhan A (2014) Powder XRD technique and its applications in science and technology. J Anal Bioanal Tech. https://doi.org/10.4172/2155-9872.100021210.4172/2155-9872.1000212 ↗
3. Rodriguez-Navarro C, Kudlacz K, Ruiz-Agudo E (2012) The mechanism of thermal decomposition of dolomite: new insights from 2D-XRD and TEM analyses. Am Miner 97(1):38–51. https://doi.org/10.2138/am.2011.381310.2138/am.2011.3813 ↗
4. Mahony NO, Campbell S, Carvalho A, Harapanahalli S, Velasco-Hernandez G, Krpalkova L, Riordan D, Walsh J (2020) Deep learning versus traditional computer vision, vol 943. https://doi.org/10.1007/978-3-030-17795-9, arXiv:1910.13796. Accessed 27 April 202310.1007/978-3-030-17795-9 ↗
5. Deng L, Yu D (2014) Deep learning: methods and applications. Found Trends® Sig Process 7(3–4):197–38710.1561/2000000039 ↗
6. Choudhary K, DeCost B, Chen C, Jain A, Tavazza F, Cohn R, Park CW, Choudhary A, Agrawal A, Billinge SJL, Holm E, Ong SP, Wolverton C (2022) Recent advances and applications of deep learning methods in materials science. npj Comput Mater 8(1):1–2610.1038/s41524-022-00734-6 ↗
7. Oviedo F, Ren Z, Sun S, Settens C, Liu Z, Hartono NTP, Ramasamy S, DeCost BL, Tian SIP, Romano G, Gilad Kusne A, Buonassisi T (2019) Fast and interpretable classification of small X-ray diffraction datasets using data augmentation and deep neural networks. npj Comput Mater 5(1):1–9. https://doi.org/10.1038/s41524-019-0196-x10.1038/s41524-019-0196-x ↗
8. Lu M et al (2023) Image processing pipeline for fluoroelastomer crystallite detection in atomic force microscopy images. Integr Mater Manuf Innov. https://doi.org/10.1007/s40192-023-00320-810.1007/s40192-023-00320-8 ↗
9. Ross KC, Petrus JA, McDonald AM (2014) An empirical assessment of two-dimensional (2D) Debye-Scherrer-type image-plate X-ray diffraction data collapsed into a 1D diffractogram. Powder Diffr 29(4):337–345. https://doi.org/10.1017/S088571561400048710.1017/S0885715614000487 ↗
10. Xiong Y, Xie Y, Du G, Su H (2002) From 2D framework to Quasi-1D nanomaterial: preparation, characterization, and formation mechanism of Cu3SnS4 nanorods. Inorg Chem 41(11):2953–2959. https://doi.org/10.1021/ic020024210.1021/ic0200242 ↗
11. Potluri S, Fasih A, Vutukuru LK, Machot FA, Kyamakya K (2011) CNN based high performance computing for real time image processing on GPU. In: Proceedings of the joint INDS’11 & ISTET’11, pp 1–7 . https://doi.org/10.1109/INDS.2011.602478110.1109/INDS.2011.6024781 ↗
12. Demir-Kavuk O, Kamada M, Akutsu T, Knapp E-W (2011) Prediction using step-wise L1, L2 regularization and feature selection for small data sets with large number of features. BMC Bioinform. 12:412. https://doi.org/10.1186/1471-2105-12-41210.1186/1471-2105-12-412 ↗
13. Ismail A, Ahmad SA, Soh AC, Hassan K, Harith HH (2019) Improving convolutional neural network (CNN) architecture (miniVGGNet) with batch normalization and learning rate decay factor for image classification. Int J Integr Eng 11(4):51–5910.30880/ijie.2019.11.04.006 ↗
14. Yu T, Zhu H (2020) Hyper-parameter optimization: a review of algorithms and applications. arXiv:2003.05689. Accessed 27 April 2023
15. Brown DW, Anghel V, Balogh L, Clausen B, Johnson NS, Martinez RM, Pagan DC, Rafailov G, Ravkov L, Strantza M, Zepeda-Alarcon E (2021) Evolution of the microstructure of laser powder bed fusion Ti-6Al-4V during post-build heat treatment. Metall Mater Trans A 52(12):5165–5181. https://doi.org/10.1007/s11661-021-06455-710.1007/s11661-021-06455-7 ↗
16. Roehling JD, Smith WL, Roehling TT, Vrancken B, Guss GM, McKeown JT, Hill MR, Matthews MJ (2019) Reducing residual stress by selective large-area diode surface heating during laser powder bed fusion additive manufacturing. Addit Manuf 28:228–235. https://doi.org/10.1016/j.addma.2019.05.00910.1016/j.addma.2019.05.009 ↗
17. Strantza M, Ganeriwala RK, Clausen B, Phan TQ, Levine LE, Pagan DC, Ruff JPC, King WE, Johnson NS, Martinez RM, Anghel V, Rafailov G, Brown DW (2021) Effect of the scanning strategy on the formation of residual stresses in additively manufactured Ti-6Al-4V. Addit Manuf 45:102003. https://doi.org/10.1016/j.addma.2021.10200310.1016/j.addma.2021.102003 ↗
18. Tripathi PK, Karewar S, Lo Y-C, Bhowmick S (2021) Role of interface morphology on the martensitic transformation in pure Fe. Materialia 16:101085. https://doi.org/10.1016/j.mtla.2021.10108510.1016/j.mtla.2021.101085 ↗
19. Tripathi PK, Maurya SK, Bhowmick S (2018) Role of disconnections in mobility of the austenite-ferrite interphase boundary in Fe. Phys Rev Mater 2(11):113403. https://doi.org/10.1103/PhysRevMaterials.2.11340310.1103/PhysRevMaterials.2.113403 ↗
20. Toby BH, Von Dreele RB (2013) GSAS-II: the genesis of a modern open-source all purpose crystallography software package. J Appl Crystallogr 46(2):544–549. https://doi.org/10.1107/S002188981300353110.1107/S0021889813003531 ↗
21. Vallcorba O, Rius J (2019) d2Dplot: 2D X-ray diffraction data processing and analysis for through-the-substrate microdiffraction. J Appl Crystallogr 52(2):478–484. https://doi.org/10.1107/S160057671900219X10.1107/S160057671900219X ↗
22. Bosse S, Maniry D, Wiegand T, Samek W (2016) A deep neural network for image quality assessment. In: 2016 IEEE international conference on image processing (ICIP), pp 3773–3777. https://doi.org/10.1109/ICIP.2016.753306510.1109/ICIP.2016.7533065 ↗
23. Chauhan R, Ghanshala KK, Joshi RC (2018) Convolutional neural network (CNN) for image detection and recognition. In: 2018 first international conference on secure cyber computing and communication (ICSCCC), pp 278–282 . https://doi.org/10.1109/ICSCCC.2018.870331610.1109/ICSCCC.2018.8703316 ↗
24. Alzubaidi L, Zhang J, Humaidi AJ, Al-Dujaili A, Duan Y, Al-Shamma O, Santamaría J, Fadhel MA, Al-Amidie M, Farhan L (2021) Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. J Big Data 8(1):53. https://doi.org/10.1186/s40537-021-00444-810.1186/s40537-021-00444-8 ↗
25. Christlein V, Spranger L, Seuret M, Nicolaou A, Král P, Maier A(2019) Deep generalized max pooling. In: 2019 international conference on document analysis and recognition (ICDAR), pp 1090–1096 . https://doi.org/10.1109/ICDAR.2019.0017710.1109/ICDAR.2019.00177 ↗
26. Nagi J, Ducatelle F, Di Caro GA, Cireşan D, Meier U, Giusti A, Nagi F, Schmidhuber J, Gambardella LM (2011) Max-pooling convolutional neural networks for vision-based hand gesture recognition. In: 2011 IEEE international conference on signal and image processing applications (ICSIPA), pp 342– 347 https://doi.org/10.1109/ICSIPA.2011.614416410.1109/ICSIPA.2011.6144164 ↗
27. Basha SHS, Dubey SR, Pulabaigari V, Mukherjee S (2020) Impact of fully connected layers on performance of convolutional neural networks for image classification. Neurocomputing 378:112–119. https://doi.org/10.1016/j.neucom.2019.10.00810.1016/j.neucom.2019.10.008 ↗
28. Agarap AF (2019) Deep learning using rectified linear units (ReLU). https://doi.org/10.48550/arXiv.1803.08375, arXiv:1803.08375. Accessed 25 Oct 202310.48550/arXiv.1803.08375 ↗
29. Taud H, Mas JF (2018) Multilayer perceptron MLP. In: Camacho Olmedo MT, Paegelow M, Mas J-F, Escobar F (eds) Geomatic approaches for modeling land change scenarios lecture notes in geoinformation and cartography. Springer, Cham, pp 451–455. https://doi.org/10.1007/978-3-319-60801-3_2710.1007/978-3-319-60801-3_27 ↗
30. Zhang C, Yao M, Chen W, Zhang S, Chen D, Wu Y (2021) Gradient descent optimization in deep learning model training based on multistage and method combination strategy. Secur Commun Netw 2021:9956773. https://doi.org/10.1155/2021/995677310.1155/2021/9956773 ↗
31. Haji SH, Abdulazeez AM (2021) Comparison of optimization techniques based on gradient descent algorithm: a review. PalArch’s J Archaeol Egypt Egyptol 18(4):2715–2743
32. Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M, Kudlur M, Levenberg J, Monga R, Moore S, Murray DG, Steiner B, Tucker P, Vasudevan V, Warden P, Wicke M. Yu Y, Zheng X (2016) TensorFlow: A system for large-scale machine learning. In: Proceedings of the 12th USENIX symposium on operating systems design and implementation, vol 16, pp. 265– 283. USENIX Association, Savannah, GA. https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadi, arXiv:1603.04467. Accessed 2019-01-26
33. TensorFlow Developers (2023). TensorFlow Zenodo. https://doi.org/10.5281/zenodo.825697910.5281/zenodo.8256979 ↗
34. Nihar A, Ciardi T, Chawla R, Chaudhary V, Wu Y, French RH (2023) Accelerating time to science using CRADLE: a framework for materials data science, presented at the 30th IEEE International Conference on High Performance Computing, Data, & Analytics, IEEE, Goa, India. https://doi.org/10.1109/HiPC58850.2023.0004110.1109/HiPC58850.2023.00041 ↗
35. Passos D, Mishra P (2022) A tutorial on automatic hyperparameter tuning of deep spectral modelling for regression and classification tasks. Chemom Intell Lab Syst 223:104520. https://doi.org/10.1016/j.chemolab.2022.10452010.1016/j.chemolab.2022.104520 ↗
36. Kimura GY, Lucio DR, Britto Jr, AS, Menotti D (2020) CNN Hyperparameter tuning applied to iris liveness detection. https://doi.org/10.48550/arXiv.2003.0083310.48550/arXiv.2003.00833 ↗
37. Prechelt L (1998) Early stopping—but when? In: Orr GB, Müller K-R (eds) Neural networks: tricks of the trade. Lecture notes in computer science. Springer, Berlin, Heidelberg, pp 55–69. https://doi.org/10.1007/3-540-49430-8_310.1007/3-540-49430-8_3 ↗
38. Arifin F, Annisa T, Ma’arof M (2019) Variations in the number of layers and the number of neurons in artificial neural networks: case study of pattern recognition. J Phys Conf Ser 1413:012016. https://doi.org/10.1088/1742-6596/1413/1/01201610.1088/1742-6596/1413/1/012016 ↗
39. Ying X (2019) An overview of overfitting and its solutions. J Phys Conf Ser 1168(2):022022. https://doi.org/10.1088/1742-6596/1168/2/02202210.1088/1742-6596/1168/2/022022 ↗
40. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958. http://jmlr.org/papers/v15/srivastava14a.html
41. Wu H, Gu X (2015) Towards dropout training for convolutional neural networks. Neural Netw 71:1–10. https://doi.org/10.1016/j.neunet.2015.07.00710.1016/j.neunet.2015.07.007 ↗
42. Farhadi Z , Bevrani H, Feizi-Derakhshi M-R (2022) Combining regularization and dropout techniques for deep convolutional neural network. In: 2022 global energy conference (GEC), pp 335– 339. https://doi.org/10.1109/GEC55014.2022.998665710.1109/GEC55014.2022.9986657 ↗
43. Wu Y, Liu L, Bae J, Chow K-H, Iyengar A, Pu C, Wei W, Yu L, Zhang Q (2019) Demystifying learning rate policies for high accuracy training of deep neural networks. arXiv:1908.06477. Accessed 25 Oct 202310.1109/BigData47090.2019.9006104 ↗
44. Yoo AB, Jette MA, Grondona M (2003) SLURM: simple Linux utility for resource management. In: Feitelson D, Rudolph L, Schwiegelshohn U (eds) Job scheduling strategies for parallel processing. Lecture notes in computer science. Springer, Berlin, Heidelberg, pp 44–60. https://doi.org/10.1007/10968987_310.1007/10968987_3 ↗
45. Campos V, Sastre F, Yagües M, Bellver M, Giró-i-Nieto X, Torres J (2017) Distributed training strategies for a computer vision deep learning algorithm on a distributed GPU cluster. Procedia Comput Sci 108:315–324. https://doi.org/10.1016/j.procs.2017.05.07410.1016/j.procs.2017.05.074 ↗
46. Azulay A, Weiss Y (2019) Why do deep convolutional networks generalize so poorly to small image transformations?. https://doi.org/10.48550/arXiv.1805.12177, arXiv:1805.12177. Accessed 27 April 202310.48550/arXiv.1805.12177 ↗
47. Zhang R (2019) Making convolutional networks shift-invariant again. https://doi.org/10.48550/arXiv.1904.11486, arXiv:1904.11486. Accessed 21 Aug 202310.48550/arXiv.1904.11486 ↗
48. Kayhan OS, Gemert JCV (2020) On translation invariance in cnns: convolutional layers can exploit absolute spatial location, pp 14274–14285. https://openaccess.thecvf.com/content_CVPR_2020/html/Kayhan_On_Translation_Invariance_in_CNNs_Convolutional_Layers_Can_Exploit_Absolute_CVPR_2020_paper.html Accessed 28 April 2023
49. Furat O, Wang M, Neumann M, Petrich L, Weber M, Krill CE, Schmidt V (2019) Machine learning techniques for the segmentation of tomographic image data of functional materials. Front Mater. https://doi.org/10.3389/fmats.2019.0014510.3389/fmats.2019.00145 ↗