journal article·2022-02-26Open access

Potential of Deep Learning Methods for Deep Level Particle Characterization in Crystallization

Janine Lins, Thomas Harweg, Frank Weichert, Kerstin Wohlgemuth

Applied Sciences· Volume 12· Issue 5

Abstract

Crystalline particle properties, which are defined throughout the crystallization process chain, are strongly tied to the quality of the final product bringing along the need of detailed particle characterization. The most important characteristics are the size, shape and purity, which are influenced by agglomeration. Therefore, a pure size determination is often insufficient and a deep level evaluation regarding agglomerates and primary crystals bound in agglomerates is desirable as basis to increase the quality of crystalline products. We present a promising deep learning approach for particle characterization in crystallization. In an end-to-end fashion, the interactions and processing steps are minimized. Based on instance segmentation, all crystals containing single crystals, agglomerates and primary crystals in agglomerates are detected and classified with pixel-level accuracy. The deep learning approach shows superior performance to previous image analysis methods and reaches a new level of detail. In experimental studies, L-alanine is crystallized from aqueous solution. A detailed description of size and number of all particles including primary crystals is provided and characteristic measures for the level of agglomeration are given. This can lead to a better process understanding and has the potential to serve as cornerstone for kinetic studies.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Crystallization and Solubility Studies · Enzyme Structure and Function · Machine Learning in Materials Science

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Laboratory of Plant and Process Design, TU Dortmund University, Emil-Figge-Strasse 70, 44227 Dortmund, Germany

Chair of Computer Graphics, TU Dortmund University, Otto-Hahn-Straße 16, 44221 Dortmund, Germany

References (57)

Show source-provided references
1. Enabling precision manufacturing of active pharmaceutical ingredients: Workflow for seeded cooling continuous crystallisations10.1039/C7ME00096K ↗
2. A review of the terms agglomerate and aggregate with a recommendation for nomenclature used in powder and particle characterization10.1002/jps.10191 ↗
3. Particle design via spherical agglomeration: A critical review of controlling parameters, rate processes and modelling10.1016/j.powtec.2017.11.052 ↗
4. Agglomeration of Paracetamol during Crystallization in Pure and Mixed Solvents10.1021/ie0301280 ↗
5. Kramer, H.J.M., and van Rosmalen, G.M. (2000). Crystallization, Academic Press.10.1016/B0-12-226770-2/00031-4 ↗
6. Toward a molecular understanding of crystal agglomeration10.1021/cg049837m ↗
7. Using an online image analysis technique to characterize sucrose crystal morphology during a crystallization run10.1021/ie2001499 ↗
8. Aggregation during precipitation from solution: An experimental investigation using Poiseuille flow10.1016/S0009-2509(00)00202-5 ↗
9. Development of Screening Methodology for the Assessment of the Agglomeration Potential of APIs10.1021/acs.oprd.6b00201 ↗
10. Sequential Crystallization Parameter Estimation Method for Determination of Nucleation, Growth, Breakage, and Agglomeration Kinetics10.1021/acs.iecr.7b03995 ↗
11. Modeling induced nucleation processes during batch cooling crystallization: A sequential parameter determination procedure10.1016/j.compchemeng.2012.12.001 ↗
12. Discrimination between Single Crystals and Agglomerates during the Crystallization Process10.1002/ceat.201700651 ↗
13. Measurement of agglomeration during crystallization: Is the differentiation of aggregates and agglomerates via ultrasonic irradiation possible?10.1016/j.ces.2019.115214 ↗
15. Shape-independent particle classification for discrimination of single crystals and agglomerates10.1016/j.powtec.2019.01.018 ↗
16. Application of inline imaging for monitoring crystallization process in a continuous oscillatory baffled crystallizer10.1002/aic.16145 ↗
17. Impact of agglomeration on crystalline product quality within the crystallization process chain10.1002/crat.201600125 ↗
18. Applications of machine vision in pharmaceutical technology: A review10.1016/j.ejps.2021.105717 ↗
19. Chen, S., Liu, T., Xu, D., Huo, Y., and Yang, Y. (2019, January 27–30). Image based measurement of population growth rate for l-glutamic acid crystallization. Proceedings of the 2019 Chinese Control Conference (CCC), Guangzhou, China.10.23919/ChiCC.2019.8866441 ↗
20. Online detection of particle agglomeration during solution crystallization by microscopic double-view image analysis10.1021/acs.iecr.7b02439 ↗
21. Image analysis framework with focus evaluation for in situ characterisation of particle size and shape attributes10.1016/j.ces.2018.06.067 ↗
22. A comprehensive shape analysis pipeline for stereoscopic measurements of particulate populations in suspension10.1016/j.powtec.2017.08.044 ↗
23. Crystal aggregation in a flow tube: Image-based observation10.1002/ceat.201000465 ↗
24. Image-based in situ identification of face specific crystal growth rates from crystal populations10.1021/cg401098x ↗
25. A Short-Cut Method for the Quantification of Crystallization Kinetics. 2. Experimental Application10.1021/acs.cgd.6b00789 ↗
26. Measurement and Evaluation of the Crystallization Kinetics of l -Asparagine Monohydrate in the Ternary l-/d-Asparagine/Water System10.1021/acs.cgd.8b01322 ↗
27. Measuring multidimensional particle size distributions during crystallization10.1016/j.ces.2011.11.029 ↗
28. Perspectives on the Current State, Challenges, and Opportunities in Pharmaceutical Crystallization Process Development10.1021/acs.cgd.0c00847 ↗
29. International Journal of Computer Science and Mobile Computing Various Image Segmentation Techniques: A Review
30. Agglomeration degree distribution as quality criterion to evaluate crystalline products10.1016/j.ces.2015.03.002 ↗
31. Characterization of paracetamol agglomerates by image analysis and strength measurement10.1016/S0032-5910(02)00208-5 ↗
32. Influence of Filtration on the Agglomeration Degree of Two Crystalline Amino Acids10.1002/cite.201700110 ↗
33. Variable selection and training set design for particle classification using a linear and a non-linear classifier10.1016/j.ces.2017.07.030 ↗
34. Fully automated primary particle size analysis of agglomerates on transmission electron microscopy images via artificial neural networks10.1016/j.powtec.2018.03.032 ↗
35. Agglomeration of needle-like crystals in suspension: I. Measurements10.1021/acs.cgd.5b00094 ↗
36. A geometric-based method for recognizing overlapping polygonal-shaped and semi-transparent particles in gray tone images10.1016/j.patrec.2011.09.004 ↗
37. Quantification of internal crystal defects using image analysis10.1016/j.powtec.2020.09.015 ↗
38. A method for analyzing on-line video images of crystallization at high-solid concentrations10.1016/j.cpart.2007.11.001 ↗
39. A novel image analysis technique for 2D characterization of overlapping needle-like crystals10.1016/j.powtec.2021.09.017 ↗
40. Crystal texture recognition system based on image analysis for the analysis of agglomerates10.1016/j.chemolab.2020.103985 ↗
41. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
42. Bruno, A.E., Charbonneau, P., Newman, J., Snell, E.H., So, D.R., Vanhoucke, V., Watkins, C.J., Williams, S., and Wilson, J. (2018). Classification of crystallization outcomes using deep convolutional neural networks. PLoS ONE, 13.10.1371/journal.pone.0198883 ↗
43. In Situ Imaging Combined with Deep Learning for Crystallization Process Monitoring: Application to Cephalexin Production10.1021/acs.oprd.1c00136 ↗
44. A Deep Learning Image-Based Sensor for Real-Time Crystal Size Distribution Characterization10.1021/acs.iecr.9b02450 ↗
45. Image Analysis for In-line Measurement of Multidimensional Size, Shape, and Polymorphic Transformation of l -Glutamic Acid Using Deep Learning-Based Image Segmentation and Classification10.1021/acs.cgd.8b00883 ↗
46. Investigation on mixed particle classification based on imaging processing with convolutional neural network10.1016/j.powtec.2021.02.032 ↗
47. Particle characterization with on-line imaging and neural network image analysis10.1016/j.cherd.2020.03.004 ↗
48. Image-based size analysis of agglomerated and partially sintered particles via convolutional neural networks10.1016/j.powtec.2019.10.020 ↗
49. Wohlgemuth, K. (2012). Induced Nucleation Processes during Batch Cooling Crystallization. [Ph.D. Thesis, Dr. Hut].10.1016/j.compchemeng.2012.12.001 ↗
50. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
51. Lin, T., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
52. Wu, Y., Kirillov, A., Massa, F., Lo, W.Y., and Girshick, R. (2021, September 15). Detectron2. Available online: https://github.com/facebookresearch/detectron2.
53. ECCV (2014). Microsoft COCO: Common Objects in Context. European Conference on Computer Vision, Springer.
54. A Threshold Selection Method from Gray-Level Histograms10.1109/TSMC.1979.4310076 ↗
55. The Pascal Visual Object Classes (VOC) Challenge10.1007/s11263-009-0275-4 ↗
56. International Organization for Standardization (2014). International Standard Particle Size Analysis—Image Analysis Methods, International Organization for Standardization.
57. Potential of gassing crystallization to control the agglomeration degree of crystalline products10.1016/j.powtec.2017.07.044 ↗