L-PBF High-Throughput Data Pipeline Approach for Multi-modal Integration
Source abstract
Abstract
Abstract Metal-based additive manufacturing requires active monitoring solutions for assessing part quality. Multiple sensors and data streams, however, generate large heterogeneous data sets that are impractical for manual assessment and characterization. In this work, an automated pipeline is developed that enables feature extraction from high-speed camera video and multi-modal data analysis. The framework removes the need for manual assessment through the utilization of deep learning techniques and training models in a weakly supervised paradigm. We demonstrate this pipeline’s capability over 700,000 high-speed camera frames. The pipeline successfully extracts melt pool and spatter geometries and links them to corresponding pyrometry, radiography, and processparameter information. 715 individual prints are examined to reveal melt pool areas that exceeds 0.07 mm2 and pyrometry signal over a threshold (375 pyrometry units) were more likely to have defects. These automated processes enable massive throughput of characterization techniques.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Additive Manufacturing Materials and Processes · Thermography and Photoacoustic Techniques · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (70)
Show source-provided references
1. Chowdhury S, Yadaiah N, Prakash C, Ramakrishna S, Dixit S, Gupta LR, Buddhi D (2022) Laser powder bed fusion: a state-of-the-art review of the technology, materials, properties & defects, and numerical modelling. J Mater Res Technol 20:2109–2172. https://doi.org/10.1016/j.jmrt.2022.07.12110.1016/j.jmrt.2022.07.121 ↗
2. Seifi M, Salem A, Beuth J, Harrysson O, Lewandowski JJ (2016) Overview of materials qualification needs for metal additive manufacturing. JOM 68(3):747–764. https://doi.org/10.1007/s11837-015-1810-010.1007/s11837-015-1810-0 ↗
3. Ngo Tuan D, Alireza K, Imbalzano Gabriele TQ, Kate N, David H (2018) Additive manufacturing (3D printing): a review of materials, methods, applications and challenges. Compos Part B Eng 143:172–196. https://doi.org/10.1016/j.compositesb.2018.02.01210.1016/j.compositesb.2018.02.012 ↗
4. Duoss E, Zhu C, Sullivan K, Vericella J, Hopkins J, Zheng R, Pascall A, Weisgraber T, Deotte J, Frank J, Lee H, Kolesky D, Lewis J, Tortorelli D, Saintillan D, Fang N, Kuntz J, Spadaccini C (2014) Additive micro-manufacturing of designer materials: materials challenges and testing for manufacturing, mobility, biomedical applications and climate, pp. 13–24. Springer10.1007/978-3-319-11340-1_2 ↗
5. Priarone PC, Lunetto V, Atzeni E, Salmi A (2018) Laser powder bed fusion (L-PBF) additive manufacturing: on the correlation between design choices and process sustainability. Procedia CIRP 78:85–90. https://doi.org/10.1016/j.procir.2018.09.05810.1016/j.procir.2018.09.058 ↗
6. Zhang Y, Safdar M, Xie J, Li J, Sage M, Zhao YF (2023) A systematic review on data of additive manufacturing for machine learning applications: the data quality, type, preprocessing, and management. J Intell Manuf. https://doi.org/10.1007/s10845-022-02017-910.1007/s10845-022-02017-9 ↗
7. Bilberg A, Malik AA (2019) Digital twin driven human–robot collaborative assembly. CIRP Ann 68(1):499–502. https://doi.org/10.1016/j.cirp.2019.04.01110.1016/j.cirp.2019.04.011 ↗
8. Rosen R, von Wichert G, Lo G, Bettenhausen KD (2015) About the importance of autonomy and digital twins for the future of manufacturing. IFAC-PapersOnLine 48(3):567–572. https://doi.org/10.1016/j.ifacol.2015.06.141. 15th IFAC symposium on information control problems in manufacturing10.1016/j.ifacol.2015.06.141 ↗
9. Criales LE, Arisoy YM, Lane B, Moylan S, Donmez A, Özel T (2017) Laser powder bed fusion of nickel alloy 625: experimental investigations of effects of process parameters on melt pool size and shape with spatter analysis. Int J Mach Tools Manuf 121:22–36. https://doi.org/10.1016/j.ijmachtools.2017.03.00410.1016/j.ijmachtools.2017.03.004 ↗
10. Altıparmak SC, Xiao B (2021) A market assessment of additive manufacturing potential for the aerospace industry. J Manuf Process 68(728–738):11
11. Naghshineh B, Carvalho H (2022) The implications of additive manufacturing technology adoption for supply chain resilience: a systematic search and review. Int J Prod Econ 247:10838710.1016/j.ijpe.2021.108387 ↗
12. Vafadar A, Guzzomi F, Rassau A, Hayward K (2021) Advances in metal additive manufacturing: A review of common processes, industrial applications, and current challenges. Appl Sci 11(3):1213. https://doi.org/10.3390/app1103121310.3390/app11031213 ↗
13. Mani M, Lane BM, Donmez MA, Feng SC, Moylan SP, Fesperman R (2015) Measurement science needs for real-time control of additive manufacturing powder bed fusion processes. NIST10.6028/NIST.IR.8036 ↗
14. Murphy RD (2016) A review of in-situ temperature measurements for additive manufacturing technologies. Sandia National Laboratories
15. Zhao C, Parab ND, Li X, Fezzaa K, Tan W, Rollett AD, Sun T (2020) Critical instability at moving keyhole tip generates porosity in laser melting. Science 370(6520):1080–108610.1126/science.abd1587 ↗
16. Mostafaei A, Zhao C, He Y, Reza Ghiaasiaan S, Shi B, Shao S, Shamsaei N, Wu Z, Kouraytem N, Sun T, Pauza J, Gordon JV, Webler B, Parab ND, Asherloo M, Guo Q, Chen L, Rollett AD (2022) Defects and anomalies in powder bed fusion metal additive manufacturing. Current Opin Solid State Mater Sci 26(2):100974. https://doi.org/10.1016/j.cossms.2021.10097410.1016/j.cossms.2021.100974 ↗
17. Kolb T, Gebhardt P, Schmidt O, Tremel J, Schmidt M (2018) Melt pool monitoring for laser beam melting of metals: assistance for material qualification for the stainless steel 1.4057. Procedia CIRP 74:116–121. https://doi.org/10.1016/j.procir.2018.08.05810.1016/j.procir.2018.08.058 ↗
18. Cunningham R, Narra SP, Montgomery C, Beuth J, Rollett AD (2017) Synchrotron-based X-ray microtomography characterization of the effect of processing variables on porosity formation in laser power-bed additive manufacturing of Ti–6Al–4V. JOM 69(3):479–484. https://doi.org/10.1007/s11837-016-2234-110.1007/s11837-016-2234-1 ↗
19. Cunningham R, Zhao C, Parab N, Kantzos C, Pauza J, Fezzaa K, Sun T, Rollett AD (2019) Keyhole threshold and morphology in laser melting revealed by ultrahigh-speed X-ray imaging. Science 363(6429):849–852. https://doi.org/10.1126/science.aav468710.1126/science.aav4687 ↗
20. Scime L, Beuth J (2019) Using machine learning to identify in-situ melt pool signatures indicative of flaw formation in a laser powder bed fusion additive manufacturing process. Addit Manuf 25:151–165. https://doi.org/10.1016/j.addma.2018.11.01010.1016/j.addma.2018.11.010 ↗
21. Gaikwad A, Giera B, Guss GM, Forien J-B, Matthews MJ, Rao P (2020) Heterogeneous sensing and scientific machine learning for quality assurance in laser powder bed fusion—a single-track study. Addit Manuf 36:101659. https://doi.org/10.1016/j.addma.2020.10165910.1016/j.addma.2020.101659 ↗
22. Tempelman JR, Wachtor AJ, Flynn EB, Depond PJ, Forien J-B, Guss GM, Calta NP, Matthews MJ (2022) Detection of keyhole pore formations in laser powder-bed fusion using acoustic process monitoring measurements. Addit Manuf 55:102735. https://doi.org/10.1016/j.addma.2022.10273510.1016/j.addma.2022.102735 ↗
23. AbouelNour Y, Gupta N (2022) In-situ monitoring of sub-surface and internal defects in additive manufacturing: a review. Mater Design 222:111063. https://doi.org/10.1016/j.matdes.2022.11106310.1016/j.matdes.2022.111063 ↗
24. Yi L, Shokrani A, Bertolini R, Mutilba U, Guerra MG, Loukaides EG, Woizeschke P (2022) Optical sensor-based process monitoring in additive manufacturing. Procedia CIRP 115:107–112. https://doi.org/10.1016/j.procir.2022.10.05810.1016/j.procir.2022.10.058 ↗
25. Gong H, Gu H, Zeng K, Dilip JJS, Pal D, Stucker B (2014) Melt pool characterization for selective laser melting of Ti–6Al–4V pre-alloyed powder. University of Texas at Austin. https://doi.org/10.26153/tsw/15682 . https://repositories.lib.utexas.edu/handle/2152/88748 Accessed 07-14-202310.26153/tsw/15682 ↗
26. Mukherjee T, DebRoy T (2018) Mitigation of lack of fusion defects in powder bed fusion additive manufacturing. J Manuf Process 36:442–449. https://doi.org/10.1016/j.jmapro.2018.10.02810.1016/j.jmapro.2018.10.028 ↗
27. Huang SH, Liu P, Mokasdar A, Hou L (2013) Additive manufacturing and its societal impact: a literature review. Int J Adv Manuf Technol 67(5):1191–1203. https://doi.org/10.1007/s00170-012-4558-510.1007/s00170-012-4558-5 ↗
28. Wei HL, Mukherjee T, Zhang W, Zuback JS, Knapp GL, De A, DebRoy T (2021) Mechanistic models for additive manufacturing of metallic components. Prog Mater Sci 116:100703. https://doi.org/10.1016/j.pmatsci.2020.10070310.1016/j.pmatsci.2020.100703 ↗
29. Ur Rehman A, Mahmood MA, Ansari P, Pitir F, Salamci MU, Popescu AC, Mihailescu IN (2021) Spatter formation and splashing induced defects in laser-based powder bed fusion of alsi10mg alloy: a novel hydrodynamics modelling with empirical testing. Metals 11(12):2023. https://doi.org/10.3390/met1112202310.3390/met11122023 ↗
30. Roy M, Wodo O (2020) Data-driven modeling of thermal history in additive manufacturing. Addit Manuf 32:101017
31. Gershenfeld N (2012) How to make almost anything the digital fabrication revolution. Foreign Aff 91(6):43–57
32. Majeed A, Lv J, Peng T (2018) A framework for big data driven process analysis and optimization for additive manufacturing. Rapid Prototyp J 25(2):308–321. https://doi.org/10.1108/RPJ-04-2017-007510.1108/RPJ-04-2017-0075 ↗
33. Majeed A, Zhang Y, Ren S, Lv J, Peng T, Waqar S, Yin E (2021) A big data-driven framework for sustainable and smart additive manufacturing. Robot Comput-Integr Manuf 67:102026. https://doi.org/10.1016/j.rcim.2020.10202610.1016/j.rcim.2020.102026 ↗
34. Schleder GR, Padilha ACM, Acosta CM, Costa M, Fazzio A (2019) From DFT to machine learning: recent approaches to materials science—a review. J Phys Mater 2(3):032001. https://doi.org/10.1088/2515-7639/ab084b10.1088/2515-7639/ab084b ↗
35. The NOMAD Laboratory: Claudia Draxl (2021) Stepping stones towards the fourth paradigm of materials science
36. Hey T, Tansley S, Tolle K (2009) The fourth paradigm: data-intensive scientific discovery. Microsoft Corporation, Redmond
37. Grasso M, Laguzza V, Semeraro Q, Colosimo BM (2017) In-process monitoring of selective laser melting: spatial detection of defects via image data analysis. J Manuf Sci Eng 139(5):051001. https://doi.org/10.1115/1.403471510.1115/1.4034715 ↗
38. Khairallah SA, Anderson AT, Rubenchik A, King WE (2016) Laser powder-bed fusion additive manufacturing: physics of complex melt flow and formation mechanisms of pores, spatter, and denudation zones. Acta Mater 108:36–45. https://doi.org/10.1016/j.actamat.2016.02.01410.1016/j.actamat.2016.02.014 ↗
39. Zhang Y, Hong GS, Ye D, Zhu K, Fuh JYH (2018) Extraction and evaluation of melt pool, plume and spatter information for powder-bed fusion AM process monitoring. Mater Design 156:458–469. https://doi.org/10.1016/j.matdes.2018.07.00210.1016/j.matdes.2018.07.002 ↗
40. Fang Q, Tan Z, Li H, Shen S, Liu S, Song C, Zhou X, Yang Y, Wen S (2021) In-situ capture of melt pool signature in selective laser melting using u-net-based convolutional neural network. J Manuf Process 68:347–355. https://doi.org/10.1016/j.jmapro.2021.05.05210.1016/j.jmapro.2021.05.052 ↗
41. Thanki A, Goossens L, Ompusunggu AP, Bayat M, Bey-Temsamani A, Van Hooreweder B, Kruth J-P, Witvrouw A (2022) Melt pool feature analysis using a high-speed coaxial monitoring system for laser powder bed fusion of Ti–6Al–4V grade 23. Int J Adv Manuf Technol 120(9):6497–6514. https://doi.org/10.1007/s00170-022-09168-210.1007/s00170-022-09168-2 ↗
42. Lu M, Venkat SN, Augustino J, Meshnick D, Jimenez JC, Tripathi PK, Nihar A, Orme CA, French RH, Bruckman LS, Wu Y (2023) Image processing pipeline for fluoroelastomer crystallite detection in atomic force microscopy images. Integr Mater Manuf Innov. https://doi.org/10.1007/s40192-023-00320-810.1007/s40192-023-00320-8 ↗
43. Yue W, Tripathi PK, Ponon G, Ualikhankyzy Z, Brown DW, Clausen B, Strantza M, Pagan DC, Willard M, Ernst F, Ayday E, Chaudhary V, French RH (2024) Phase identification in synchrotron X-ray diffraction patterns of Ti–6Al–4V using computer vision and deep learning. Integr Mater Manuf Innov. https://doi.org/10.1007/s40192-023-00328-010.1007/s40192-023-00328-0 ↗
44. Proakis JG, Manolakis DG Digital signal processing: principles, algorithms, and applications, 3. ed edn. Prentice Hall international editions. Prentice-Hall International, London
45. Bracewell RN The fourier transform and its applications, 3rd ed edn. McGraw-Hill series in electrical and computer engineering. McGraw Hill, Boston
46. Dilip JJS, Zhang S, Teng C, Zeng K, Robinson C, Pal D, Stucker B (2017) Influence of processing parameters on the evolution of melt pool, porosity, and microstructures in Ti–6Al–4V alloy parts fabricated by selective laser melting. Prog Addit Manuf 2(3):157–167. https://doi.org/10.1007/s40964-017-0030-210.1007/s40964-017-0030-2 ↗
47. Calta NP, Wang J, Kiss AM, Martin AA, Depond PJ, Guss GM, Thampy V, Fong AY, Weker JN, Stone KH, Tassone CJ, Kramer MJ, Toney MF, Buuren AV, Matthews MJ (2018) An instrument for in situ time-resolved X-ray imaging and diffraction of laser powder bed fusion additive manufacturing processes. Rev Sci Instrum 89(5):055101. https://doi.org/10.1063/1.501723610.1063/1.5017236 ↗
48. Khanzadeh M, Chowdhury S, Tschopp MA, Doude HR, Marufuzzaman M, Bian L (2019) In-situ monitoring of melt pool images for porosity prediction in directed energy deposition processes. IISE Trans 51(5):437–455. https://doi.org/10.1080/24725854.2017.141765610.1080/24725854.2017.1417656 ↗
49. Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. Springer. https://doi.org/10.1007/978-3-319-24574-4_2810.1007/978-3-319-24574-4_28 ↗
50. Forien J-B, Calta NP, DePond PJ, Guss GM, Roehling TT, Matthews MJ (2020) Detecting keyhole pore defects and monitoring process signatures during laser powder bed fusion: a correlation between in situ pyrometry and ex situ X-ray radiography. Addit Manuf 35:101336. https://doi.org/10.1016/j.addma.2020.10133610.1016/j.addma.2020.101336 ↗
51. Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T, Preibisch S, Rueden C, Saalfeld S, Schmid B, Tinevez J-Y, White DJ, Hartenstein V, Eliceiri K, Tomancak P, Cardona A 2012 Fiji: an open-source platform for biological-image analysis 9(7), 676–682. https://doi.org/10.1038/nmeth.201910.1038/nmeth.2019 ↗
52. Petri I, Li H, Rezgui Y, Chunfeng Y, Yuce B, Jayan B (2016) A HPC based cloud model for real-time energy optimisation. Enterp Inf Syst 10(1):108–128. https://doi.org/10.1080/17517575.2014.91905310.1080/17517575.2014.919053 ↗
53. Hudak D, Johnson D, Chalker A, Nicklas J, Franz E, Dockendorf T, McMichael B (2018) Open OnDemand: a web-based client portal for HPC centers. J Open Source Softw 3(25):62210.21105/joss.00622 ↗
54. Nihar A, Ciardi T, Chawla R, Akanb OD, Chaudhary V, Wu Y, French RH (2023) Accelerating time to science using cradle: A framework for materials data science. In: 30th IEEE International Conference On High Performance Computing, Data, and Analytics. IEEE, Goa, India. https://doi.org/10.1109/HiPC58850.2023.0004110.1109/HiPC58850.2023.00041 ↗
55. Roger H French: Energy CRADLE: the path forward for scalable analytics of energy systems. CWRU/Tohoku university data science symposium in life sciences and engineering
56. Kim DB, Witherell P, Lu Y, Feng S (2017) Toward a digital thread and data package for metals-additive manufacturing. Smart Sustain Manuf Syst 1(1):20160003. https://doi.org/10.1520/SSMS2016000310.1520/SSMS20160003 ↗
57. R Core Team: R: (2021) A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. R Foundation for Statistical Computing. https://www.R-project.org/
58. RStudio Team: RStudio: (2020) Integrated development environment for R. RStudio, PBC. Boston, RStudio, PBC. http://www.rstudio.com/
59. Wickham H, Averick M, Bryan J, Chang W, McGowan LD, François R, Grolemund G, Hayes A, Henry L, Hester J, Kuhn M, Pedersen TL, Miller E, Bache SM, Müller K, Ooms J, Robinson D, Seidel DP, Spinu V, Takahashi K, Vaughan D, Wilke C, Woo K, Yutani H (2019) Welcome to the tidyverse. J Open Source Softw 4(43):168610.21105/joss.01686 ↗
60. Van Rossum G, Drake FL (2009) Python 3 reference manual. CreateSpace, Scotts Valley, CA. 1441412697
61. Tomar S (2006) Converting video formats with ffmpeg. Linux J 2006(146):10
62. Harris CR, Millman KJ, Walt SJ, Gommers R, Virtanen P, Cournapeau D, Wieser E, Taylor J, Berg S, Smith NJ, Kern R, Picus M, Hoyer S, Kerkwijk MH, Brett M, Haldane A, Río JF, Wiebe M, Peterson P, Gérard-Marchant P, Sheppard K, Reddy T, Weckesser W, Abbasi H, Gohlke C, Oliphant TE (2020) Array programming with NumPy. Nature 585(7825):357–362. https://doi.org/10.1038/s41586-020-2649-210.1038/s41586-020-2649-2 ↗
63. Walt S, Schönberger JL, Nunez-Iglesias J, Boulogne F, Warner JD, Yager N, Gouillart E, Yu T (2014) contributors: scikit-image: image processing in Python. PeerJ 2:453. https://doi.org/10.7717/peerj.45310.7717/peerj.453 ↗
64. McKinney W et al (2010) Data structures for statistical computing in python. In: Proceedings of the 9th Python in Science Conference, vol. 445, pp. 51–56. Austin, TX10.25080/Majora-92bf1922-00a ↗
65. Abadi M, Agarwal A, Barham P, Brevdo E, Chen Z, Citro C, Corrado GS, Davis A, Dean J, Devin M, Ghemawat S, Goodfellow I, Harp A, Irving G, Isard M, Jia Y, Jozefowicz R, Kaiser L, Kudlur M, Levenberg J, Mané D, Monga R, Moore S, Murray D, Olah C, Schuster M, Shlens J, Steiner B, Sutskever I, Talwar K, Tucker P, Vanhoucke V, Vasudevan V, Viégas F, Vinyals O, Warden P, Wattenberg M, Wicke M, Yu Y, Zheng X (2015) TensorFlow: large-scale machine learning on heterogeneous systems. Software available from tensorflow.org. https://www.tensorflow.org/
66. Yoo AB, Jette MA, Grondona M (2003) SLURM: simple linux utility for resource management. vol. 2862, pp. 44–60. Springer, Berlin, Heidelberg. https://doi.org/10.1007/10968987_310.1007/10968987_3 ↗
67. Pascual JA, Navaridas J, Miguel-Alonso J. (2009) Effects of topology-aware allocation policies on scheduling performance. In: Frachtenberg E, Schwiegelshohn U (eds) pp. 138–156. Springer, Berlin, Heidelberg.https://doi.org/10.1007/978-3-642-04633-9_810.1007/978-3-642-04633-9_8 ↗
68. Kingma DP, Ba J (2017) Adam: a method for stochastic optimization (2017)
69. Shapiro LG, Stockman GC (2001) Computer Vision, pp. 186–205. Prentice Hall, Upper Saddle River
70. Sezgin M, Sankur B (2004) Survey over image thresholding techniques and quantitative performance evaluation. J Electron Imaging 13:146–168. https://doi.org/10.1117/1.163131510.1117/1.1631315 ↗