Multi-objective process parameter optimization using a hybrid reinforcement/machine learning model in metal additive manufacturing
Source abstract
Abstract
Abstract Additive manufacturing enables the production of complex geometries and lightweight structures. However, producing defect-free components fundamentally depends on the careful optimization of process parameters that influence critical factors, such as melt pool depth, in laser powder bed fusion (L-PBF), an important class of metal additive manufacturing methods. Hence, for the first time, this paper presents a novel data-driven framework that integrates machine learning (ML) with reinforcement learning (RL) to optimize process parameters, ensuring the desired melt pool characteristics while meeting multi-objective design criteria. Experimental data from the literature were extracted to train several ML models, with Gaussian process regression (GPR) featuring a Matérn kernel proved to be the most accurate predictor. This model served as the digital twin of the L-PBF process and was integrated with a Q -learning-based RL agent to derive the optimal process parameters. The GPR model achieved a high prediction accuracy (root mean squared error (RMSE): 34 µm, the coefficient of determination R 2 : 96.05%) for L-PBF Ti6Al4V alloy using minimal training data. Integrating a Q -learning framework with ML demonstrated superior performance in deriving process parameters that achieved the target melt pool depth while minimizing the normalized enthalpy, directly impacting the formation of the keyhole defect.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Additive Manufacturing Materials and Processes · Additive Manufacturing and 3D Printing Technologies · Machine Learning in Materials Science
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (70)
Show source-provided references
1. DebRoy T, Mukherjee T, Milewski JO et al (2019) Scientific, technological and economic issues in metal printing and their solutions. Nat Mater 18(10):1026–1032. https://doi.org/10.1038/s41563-019-0408-210.1038/s41563-019-0408-2 ↗
2. Saboori A, Aversa A, Marchese G et al (2019) Application of directed energy deposition-based additive manufacturing in repair. Appl Sci 9(16):3316. https://doi.org/10.3390/app916331610.3390/app9163316 ↗
3. Frazier WE (2014) Metal additive manufacturing: a review. J Mater Eng Perform 23(6):1917–1928. https://doi.org/10.1007/s11665-014-0958-z10.1007/s11665-014-0958-z ↗
4. Mosallanejad MH, Abdi A, Karpasand et al (2023) Additive manufacturing of titanium alloys: processability, properties, and applications. Adv Eng Mater 25:2301122. https://doi.org/10.1002/adem.20230112210.1002/adem.202301122 ↗
5. King WE, Anderson AT, Ferencz RM et al (2015) Laser powder bed fusion additive manufacturing of metals; physics, computational, and materials challenges. Appl Phys Rev 2(4):041304. https://doi.org/10.1063/1.493780910.1063/1.4937809 ↗
6. Wei HL, Mukherjee T, Zhang W et al (2021) Mechanistic models for additive manufacturing of metallic components. Prog Mater Sci 116:100703. https://doi.org/10.1016/j.pmatsci.2020.10070310.1016/j.pmatsci.2020.100703 ↗
7. Mosallanejad MH, Niroumand B, Aversa A et al (2021) In-situ alloying in laser-based additive manufacturing processes: a critical review. J Alloys Compd 872:159567. https://doi.org/10.1016/j.jallcom.2021.15956710.1016/j.jallcom.2021.159567 ↗
8. Dadkhah M, Tulliani JM, Saboori A et al (2023) Additive manufacturing of ceramics: advances, challenges, and outlook. J Eur Ceram Soc 43(15):6635–6664. https://doi.org/10.1016/j.jeurceramsoc.2023.07.03310.1016/j.jeurceramsoc.2023.07.033 ↗
9. Behjat A, Shamanian M, Sadeghi F et al (2024) Additive manufacturing of a novel in-situ alloyed AISI316L-Cu stainless steel: microstructure and antibacterial properties. Mater Lett 355:135363. https://doi.org/10.1016/j.matlet.2023.13536310.1016/j.matlet.2023.135363 ↗
10. Dadkhah M, Mosallanejad MH, Iuliano L et al (2021) A comprehensive overview on the latest progress in the additive manufacturing of metal matrix composites: potential, challenges, and feasible solutions. Acta Metall Sin (Eng Lett) 34(9):1173–1200. https://doi.org/10.1007/s40195-021-01249-710.1007/s40195-021-01249-7 ↗
11. Galati M, Defanti S, Saboori A et al (2022) An investigation on the processing conditions of Ti-6Al-2Sn-4Zr-2Mo by electron beam powder bed fusion: microstructure, defect distribution, mechanical properties and dimensional accuracy. Addit Manuf 50:102564. https://doi.org/10.1016/j.addma.2021.10256410.1016/j.addma.2021.102564 ↗
12. Zhang Y, Wu L, Guo X et al (2018) Additive manufacturing of metallic materials: a review. J Mater Eng Perform 27(1):1–13. https://doi.org/10.1007/s11665-017-2747-y10.1007/s11665-017-2747-y ↗
13. Behjat A, Shamanian M, Taherizadeh A et al (2022) Enhanced surface properties and bioactivity of additively manufactured 316L stainless steel using different post-treatments. Mater Today Proc 70:188–19410.1016/j.matpr.2022.09.019 ↗
14. Khairallah SA, Anderson AT, Rubenchik A et al (2016) Laser powder-bed fusion additive manufacturing: physics of complex melt flow and formation mechanisms of pores, spatter, and denudation zones. Acta Mater 108:36-45. https://doi.org/10.1016/j.actamat.2016.02.01410.1016/j.actamat.2016.02.014 ↗
15. King WE, Barth HD, Castillo VM et al (2014) Observation of keyhole-mode laser melting in laser powder-bed fusion additive manufacturing. J Mater Process Technol 214(12):2915–292510.1016/j.jmatprotec.2014.06.005 ↗
16. Gong H, Rafi K, Gu H et al (2014) Analysis of defect generation in Ti-6Al-4V parts made using powder bed fusion additive manufacturing processes. Addit Manuf 1:87–98. https://doi.org/10.1016/j.addma.2014.08.00210.1016/j.addma.2014.08.002 ↗
17. Mower TM, Long MJ (2016) Mechanical behavior of additive manufactured, powder-bed laser-fused materials. Mater Sci Eng A 651:198–21310.1016/j.msea.2015.10.068 ↗
18. Sames WJ, List FA, Pannala S et al (2016) The metallurgy and processing science of metal additive manufacturing. Int Mater Rev 61(5):315–36010.1080/09506608.2015.1116649 ↗
19. Viale V, Stavridis J, Salmi A et al (2022) Optimisation of downskin parameters to produce metallic parts via laser powder bed fusion process: an overview. Int J Adv Manuf Technol 123(7):2159–218210.1007/s00170-022-10314-z ↗
20. Taghian M, Mosallanejad MH, Lannunziata E et al (2023) Laser powder bed fusion of metallic components: latest progress in productivity, quality, and cost perspectives. J Mater Res Technol 27:6484–650010.1016/j.jmrt.2023.11.049 ↗
21. Marler RT, Arora JS (2004) Survey of multi-objective optimization methods for engineering. Struct Multidiscip Optim 26(6):369–395. https://doi.org/10.1007/s00158-003-0368-610.1007/s00158-003-0368-6 ↗
22. Deb K, Jain H (2013) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans Evol Comput 18(4):577–60110.1109/TEVC.2013.2281535 ↗
23. Chia HY, Wu J, Wang X et al (2022) Process parameter optimization of metal additive manufacturing: a review and outlook. J Mater Inform 2:16. https://doi.org/10.20517/jmi.2022.1810.20517/jmi.2022.18 ↗
24. Moradi A, Tajalli S, Mosallanejad MH et al (2025) Intelligent laser-based metal additive manufacturing: a review on machine learning for process optimization and property prediction. Int J Adv Manuf Technol 136(2):527–560. https://doi.org/10.1007/s00170-024-14858-010.1007/s00170-024-14858-0 ↗
25. Schleder GR, Padilha AC, Acosta CM et al (2019) From DFT to machine learning: recent approaches to materials science—a review. J Phys Mater 2(3):032001. https://doi.org/10.1088/2515-7639/ab084b10.1088/2515-7639/ab084b ↗
26. Kamath C (2016) Data mining and statistical inference in selective laser melting. Int J Adv Manuf Technol 86(5):1659–167710.1007/s00170-015-8289-2 ↗
27. Mosallanejad MH, Gashmard H, Javanbakht M et al (2024) A novel feature engineering approach for predicting melt pool depth during LPBF by machine learning models. Addit Manuf Lett 10:100214. https://doi.org/10.1016/j.addlet.2024.10021410.1016/j.addlet.2024.100214 ↗
28. Wang C, Tan XP, Tor SB et al (2020) Machine learning in additive manufacturing: state-of-the-art and perspectives. Addit Manuf 36:101538. https://doi.org/10.1016/j.addma.2020.10153810.1016/j.addma.2020.101538 ↗
29. DebRoy T, Mukherjee T, Wei HL et al (2021) Metallurgy, mechanistic models and machine learning in metal printing. Nat Rev Mater 6(1):48–68. https://doi.org/10.1038/s41578-020-00236-110.1038/s41578-020-00236-1 ↗
30. Meng L, McWilliams B, Jarosinski W et al (2020) Machine learning in additive manufacturing: a review. JOM 72(6):2363–2377. https://doi.org/10.1007/s11837-020-04155-y10.1007/s11837-020-04155-y ↗
31. Himanen L, Geurts A, Foster AS et al (2019) Data-driven materials science: status, challenges, and perspectives. Adv Sci 6(21):1900808. https://doi.org/10.1002/advs.20190080810.1002/advs.201900808 ↗
32. Wang AYT, Murdock RJ, Kauwe SK et al (2020) Machine learning for materials scientists: an introductory guide toward best practices. Chem Mater 32(12):4954–496510.1021/acs.chemmater.0c01907 ↗
33. He P, Liu Q, Kruzic JJ et al (2022) Machine-learning assisted additive manufacturing of a TiCN reinforced AlSi10Mg composite with tailorable mechanical properties. Mater Lett 307:131018. https://doi.org/10.1016/j.matlet.2021.13101810.1016/j.matlet.2021.131018 ↗
34. Barrionuevo GO, Walczak M, Ramos-Grez J et al (2023) Microhardness and wear resistance in materials manufactured by laser powder bed fusion: machine learning approach for property prediction. CIRP J Manuf Sci Technol 43:106–114. https://doi.org/10.1016/j.cirpj.2023.03.00210.1016/j.cirpj.2023.03.002 ↗
35. Minkowitz L, Arneitz S, Effertz PS et al (2023) Laser-powder bed fusion process optimisation of AlSi10Mg using extra trees regression. Mater Des 227:111718. https://doi.org/10.1016/j.matdes.2023.11171810.1016/j.matdes.2023.111718 ↗
36. Theeda S, Jagdale SH, Ravichander BB et al (2023) Optimization of process parameters in laser powder bed fusion of SS 316L parts using artificial neural networks. Metals 13(5):842. https://doi.org/10.3390/met1305084210.3390/met13050842 ↗
37. Hassanin H, Zweiri Y, Finet L et al (2021) Laser powder bed fusion of Ti-6Al-2Sn-4Zr-6Mo alloy and properties prediction using deep learning approaches. Mater 14:2056. https://doi.org/10.3390/ma1408205610.3390/ma14082056 ↗
38. Eshkabilov S, Ara I, Azarmi F (2022) A comprehensive investigation on application of machine learning for optimization of process parameters of laser powder bed fusion-processed 316L stainless steel. Int J Adv Manuf Technol 123(7):2733–2756. https://doi.org/10.1007/s00170-022-10331-y10.1007/s00170-022-10331-y ↗
39. Muhammad W, Kang J, Ibragimova O et al (2023) Experimental investigation and development of a deep learning framework to predict process-induced surface roughness in additively manufactured aluminum alloys. Weld World 67(4):897–921. https://doi.org/10.1007/s40194-022-01445-810.1007/s40194-022-01445-8 ↗
40. Lee CH, Kühn U, Lee SC et al (2021) Optimizing laser powder bed fusion of Ti-5Al-5V-5Mo-3Cr by artificial intelligence. J Alloys Compd 862:158018. https://doi.org/10.1016/j.jallcom.2020.15801810.1016/j.jallcom.2020.158018 ↗
41. Chen C, Wong SJL, Raghavan S et al (2022) Design of experiments informed deep learning for modeling of directed energy deposition process with a small-size experimental dataset. Mater Des 222:111098. https://doi.org/10.1016/j.matdes.2022.11109810.1016/j.matdes.2022.111098 ↗
42. Zhu X, Jiang F, Guo C et al (2023) Prediction of melt pool shape in additive manufacturing based on machine learning methods. Opt Laser Technol 159:108964. https://doi.org/10.1016/j.optlastec.2022.10896410.1016/j.optlastec.2022.108964 ↗
43. Akbari P, Ogoke F, Kao NY et al (2022) MeltpoolNet: melt pool characteristic prediction in metal additive manufacturing using machine learning. Addit Manuf 55:102817. https://doi.org/10.1016/j.addma.2022.10281710.1016/j.addma.2022.102817 ↗
44. Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: a survey. J Artif Intell Res 4:237–285. https://doi.org/10.1613/jair.30110.1613/jair.301 ↗
45. Sousa J, Brandau B, Darabi R et al (2025) Artificial intelligence for control in laser-based additive manufacturing: a systematic review. IEEE Access 13:30845–30860. https://doi.org/10.1109/ACCESS.2025.353785910.1109/ACCESS.2025.3537859 ↗
46. Mattera G, Caggiano A, Nele L (2025) Optimal data-driven control of manufacturing processes using reinforcement learning: an application to wire arc additive manufacturing. J Intell Manuf 36(2):1291–1310. https://doi.org/10.1007/s10845-023-02307-w10.1007/s10845-023-02307-w ↗
47. Knaak C, Masseling L, Duong E et al (2021) Improving build quality in laser powder bed fusion using high dynamic range imaging and model-based reinforcement learning. IEEE access 9:55214–55231. https://doi.org/10.1109/ACCESS.2021.306730210.1109/ACCESS.2021.3067302 ↗
48. Wu H, Bordatchev E, Tutunea-Fatan OR (2024) Training reinforcement learning-based controller using performance simulation of the laser remelting process. Procedia Comput Sci 232:1849–1858. https://doi.org/10.1016/J.PROCS.2024.02.00710.1016/J.PROCS.2024.02.007 ↗
49. Petrik J, Bambach M (2024) RLTube: reinforcement learning based deposition path planner for thin-walled bent tubes with optionally varying diameter manufactured by wire-arc additive manufacturing. Manuf Lett 40:31–36. https://doi.org/10.1016/j.mfglet.2024.01.00710.1016/j.mfglet.2024.01.007 ↗
50. Petrik J, Bambach M (2023) Reinforcement learning and optimization based path planning for thin-walled structures in wire arc additive manufacturing. J Manuf Process 93:75–89. https://doi.org/10.1016/j.jmapro.2023.03.01310.1016/j.jmapro.2023.03.013 ↗
51. Vagenas S, Al-Saadi T, Panoutsos G (2026) Multi-layer process control in selective laser melting: a reinforcement learning approach. J Intell Manuf 37:281–298. https://doi.org/10.1007/s10845-024-02548-310.1007/s10845-024-02548-3 ↗
52. Dharmadhikari S, Menon N, Basak A (2023) A reinforcement learning approach for process parameter optimization in additive manufacturing. Addit Manuf 71:103556. https://doi.org/10.1016/j.addma.2023.10355610.1016/j.addma.2023.103556 ↗
53. Watkins CJCH, Dayan P (1992) Technical note: Q-learning. Mach Learn 8:279–292. https://doi.org/10.1023/A:102267672231510.1023/A:1022676722315 ↗
54. Vaghefi E, Hosseini S, Afsharinejad AH et al (2024) Additive manufacturing process parameter design for variable component geometries using reinforcement learning. Addit Manuf 84:104121. https://doi.org/10.1016/J.ADDMA.2024.10412110.1016/J.ADDMA.2024.104121 ↗
55. Haarnoja T, Zhou A, Abbeel P et al (2018) Soft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor. https://doi.org/10.48550/arXiv.1801.0129010.48550/arXiv.1801.01290 ↗
56. Sousa J, Darabi R, Sousa A et al (2023) Enhancing sample efficiency for temperature control in DED with reinforcement learning and MOOSE framework. In: proceedings of ASME 2023 international mechanical engineering congress and exposition. October 29–November 2, 2023, New Orleans, US. https://doi.org/10.1115/IMECE2023-11362910.1115/IMECE2023-113629 ↗
57. Shi S, Liu X, Wang Z et al (2024) An intelligent process parameters optimization approach for directed energy deposition of nickel-based alloys using deep reinforcement learning. J Manuf Process 120:1130–1140. https://doi.org/10.1016/j.jmapro.2024.05.00110.1016/j.jmapro.2024.05.001 ↗
58. Liu S, Shin YC (2019) Additive manufacturing of Ti6Al4V alloy: a review. Mater Des 164:107552. https://doi.org/10.1016/j.matdes.2018.10755210.1016/j.matdes.2018.107552 ↗
59. Dilip JJS, Zhang S, Teng C et al (2017) Influence of processing parameters on the evolution of melt pool, porosity, and microstructures in Ti-6Al-4V alloy parts fabricated by selective laser melting. Prog Addit Manuf 2(3):157–167. https://doi.org/10.1007/s40964-017-0030-210.1007/s40964-017-0030-2 ↗
60. Ye J, Khairallah SA, Rubenchik AM et al (2019) Energy coupling mechanisms and scaling behavior associated with laser powder bed fusion additive manufacturing. Adv Eng Mater 21(7):1900185. https://doi.org/10.1002/adem.20190018510.1002/adem.201900185 ↗
61. Yang J, Han J, Yu H et al (2016) Role of molten pool mode on formability, microstructure and mechanical properties of selective laser melted Ti-6Al-4V alloy. Mater Des 110:558–570. https://doi.org/10.1016/j.matdes.2016.08.03610.1016/j.matdes.2016.08.036 ↗
62. Vaglio E, Totis G, Lanzutti A et al (2024) A novel thermo-geometrical model for accurate keyhole porosity prediction in laser powder-bed fusion. Prog Addit Manuf 9(2):247–261. https://doi.org/10.1007/s40964-023-00446-310.1007/s40964-023-00446-3 ↗
63. Rafi HK, Karthik NV, Gong H et al (2013) Microstructures and mechanical properties of Ti6Al4V parts fabricated by selective laser melting and electron beam melting. J Mater Eng Perform 22(12):3872–3883. https://doi.org/10.1007/s11665-013-0658-010.1007/s11665-013-0658-0 ↗
64. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273–29710.1023/A:1022627411411 ↗
65. Rasmussen CE (2004) Gaussian processes in machine learning. In: Bousquet O, von Luxburg U, Rätsch G (eds) Advanced lectures on machine learning. ML 2003. Lecture Notes in Computer Science. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-28650-9_410.1007/978-3-540-28650-9_4 ↗
66. Breiman L (2001) Random forests. Mach Learn 45(1):5–32. https://doi.org/10.1023/A:101093340432410.1023/A:1010933404324 ↗
67. Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 1189–1232. https://doi.org/10.1214/AOS/101320345110.1214/AOS/1013203451 ↗
68. Chen T, Guestrin C (2016) XGBoost: a scalable tree boosting system. In: proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 13–17 August, San Francisco. 785–794. https://doi.org/10.1145/2939672.293978510.1145/2939672.2939785 ↗
69. Pedregosa F, Varoquaux G, Gramfort A et al (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825–2830
70. Brockman G, Cheung V, Pettersson L et al (2016) Openai gym. https://doi.org/10.48550/arXiv.1606.0154010.48550/arXiv.1606.01540 ↗