Recent progress on machine learning with limited materials data: Using tools from data science and domain knowledge
Source abstract
Abstract
One key challenge in materials informatics is how to effectively use the material data of small size to search for desired materials from a huge unexplored material space. We review the recent progress on the use of tools from data science and domain knowledge to mitigate the issues arising from limited materials data. The enhancement of data quality and amount via data augmentation and feature engineering is first summarized and discussed. Then the strategies that use ensemble model and transfer learning for improved machine learning model are overviewed. Next, we move to the active learning with emphasis on the uncertainty quantification and evaluation. Subsequently, the merits of the combination of domain knowledge and machine learning are stressed. Finally, we discuss some applications of large language models in the field of materials science. We summarize this review by posing the challenges and opportunities in the field of machine learning for small material data.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Machine Learning in Materials Science · Computational Drug Discovery Methods · X-ray Diffraction in Crystallography
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (81)
Show source-provided references
1. Perspective: materials informatics and big data: realization of the "fourth paradigm" of science in materials science10.1063/1.4946894 ↗
2. Materials data science: current status and future outlook10.1146/annurev-matsci-070214-020844 ↗
3. Machine learning in materials science10.1002/inf2.12028 ↗
4. Recent advances and applications of machine learning in solid-state materials science10.1038/s41524-019-0221-0 ↗
5. Machine learning for molecular and materials science10.1038/s41586-018-0337-2 ↗
6. Machine learning for alloys10.1038/s41578-021-00340-w ↗
7. Machine learning for composite materials10.1557/mrc.2019.32 ↗
8. Hastie · 2009
9. Active learning in materials science with emphasis on adaptive sampling using uncertainties for targeted design10.1038/s41524-019-0153-8 ↗
10. The art of data augmentation10.1198/10618600152418584 ↗
11. Deep long short-term memory neural network for accelerated elastoplastic analysis of heterogeneous materials: an integrated data-driven surrogate approach10.1016/j.compstruct.2021.113688 ↗
12. Zheng · 2018
13. A Monte Carlo and PSO based virtual sample generation method for enhancing the energy prediction and energy optimization on small data problem: an empirical study of petrochemical industries10.1016/j.apenergy.2017.04.007 ↗
14. A Gaussian mixture model based virtual sample generation approach for small datasets in industrial processes10.1016/j.ins.2021.09.014 ↗
15. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
16. A survey on image data augmentation for deep learning
17. Improving classification accuracy using data augmentation on small data sets10.1016/j.eswa.2020.113696 ↗
18. Generative adversarial networks (GAN) based efficient sampling of chemical composition space for inverse design of inorganic materials10.1038/s41524-020-00352-0 ↗
19. Applications of generative adversarial networks in materials science
20. Data augmentation in microscopic images for material data mining10.1038/s41524-020-00392-6 ↗
21. Fast and interpretable classification of small X-ray diffraction datasets using data augmentation and deep neural networks10.1038/s41524-019-0196-x ↗
22. Inverse molecular design using machine learning: generative models for matter engineering10.1126/science.aat2663 ↗
23. Accelerating materials property predictions using machine learning10.1038/srep02810 ↗
24. Learning physical descriptors for materials science by compressed sensing10.1088/1367-2630/aa57bf ↗
25. Regression shrinkage and selection via the Lasso10.1111/j.2517-6161.1996.tb02080.x ↗
26. Random forests10.1023/A:1010933404324 ↗
27. Multi-layer feature selection incorporating weighted score-based expert knowledge toward modeling materials with targeted properties10.1002/adts.201900215 ↗
28. Jolliffe · 2002
29. SISSO: a compressed-sensing method for identifying the best low-dimensional descriptor in an immensity of offered candidates
30. Descriptors for phase prediction of high entropy alloys using interpretable machine learning10.1039/D3TA06402F ↗
31. Deep learning in chemistry10.1021/acs.jcim.9b00266 ↗
32. A comparative study of neural network based feature extraction paradigms10.1016/S0167-8655(98)00120-2 ↗
33. Dramatically enhanced combination of ultimate tensile strength and electric conductivity of alloys via machine learning screening10.1016/j.actamat.2020.09.068 ↗
34. A deep learning-aided prediction approach for creep rupture time of Fe–Cr–Ni heat-resistant alloys by integrating textual and visual features10.1016/j.jmrt.2022.02.099 ↗
35. XGBoost: a scalable Tree Boosting system
36. Visualizing data using t-SNE
37. Recent progress in the machine learning-assisted rational design of alloys10.1007/s12613-022-2458-8 ↗
38. Using support vector machine for materials design10.1007/s40436-013-0025-2 ↗
39. Small data materials design with machine learning: when the average model knows best10.1063/5.0012285 ↗
40. ThermoEPred-EL: robust bandgap predictions of chalcogenides with diamond-like structure via feature cross-based stacked ensemble learning10.1016/j.commatsci.2019.109117 ↗
41. Enhancing materials property prediction by leveraging computational and experimental data using deep transfer learning10.1038/s41467-019-13297-w ↗
42. The Open Quantum Materials Database (OQMD): assessing the accuracy of DFT formation energies10.1038/npjcompumats.2015.10 ↗
43. Commentary: the Materials Project: a materials genome approach to accelerating materials innovation10.1063/1.4812323 ↗
44. The joint automated repository for various integrated simulations (JARVIS) for data-driven materials design10.1038/s41524-020-00440-1 ↗
45. Cross-property deep transfer learning framework for enhanced predictive analytics on small materials data10.1038/s41467-021-26921-5 ↗
46. On the use of transfer modeling to design new steels with excellent rotating bending fatigue resistance even in the case of very small calibration datasets10.1016/j.actamat.2022.118103 ↗
47. Multifunctional structural design of graphene thermoelectrics by Bayesian optimization10.1126/sciadv.aar4192 ↗
48. Adaptive strategies for materials design using uncertainties10.1038/srep19660 ↗
49. 2017
50. Standard errors for bagged and random forest estimators10.1016/j.csda.2008.08.007 ↗
51. The Jackknife estimate of variance
52. Neal · 2012
53. A stutorial on Gaussian process regression: modelling, exploring, and exploiting functions10.1016/j.jmp.2018.03.001 ↗
54. Role of uncertainty estimation in accelerating materials development via active learning10.1063/5.0012405 ↗
55. Methods for comparing uncertainty quantifications for material property predictions10.1088/2632-2153/ab7e1a ↗
56. Calibration after bootstrap for accurate uncertainty quantification in regression models10.1038/s41524-022-00794-8 ↗
57. Accurate uncertainties for deep learning using Calibrated regression
58. Evaluating and calibrating uncertainty prediction in regression tasks10.3390/s22155540 ↗
59. Uncertainty quantification using neural networks for molecular property prediction10.1021/acs.jcim.0c00502 ↗
60. Bayes estimates for the linear model10.1111/j.2517-6161.1972.tb00885.x ↗
61. Accelerated search for materials with targeted properties by adaptive design10.1038/ncomms11241 ↗
62. Accelerated discovery of large electrostrains in BaTiO3 -based piezoelectrics using active learning10.1002/adma.201702884 ↗
63. Efficient estimation of material property curves and surfaces via active learning
64. Towards high entropy alloy with enhanced strength and ductility using domain knowledge constrained active learning10.1016/j.matdes.2022.111186 ↗
65. Active learning for accelerated design of layered materials10.1038/s41524-018-0129-0 ↗
66. Machine learning with knowledge constraints for process optimization of open-air perovskite solar cell manufacturing10.1016/j.joule.2022.03.003 ↗
67. Informed machine learning–a taxonomy and survey of integrating prior knowledge into learning systems
68. Machine learning assisted materials design and discovery for rechargeable batteries
69. Data quantity governance for machine learning in materials science10.1093/nsr/nwad125 ↗
70. Machine learning embedded with materials domain knowledge
71. Detection method on data accuracy incorporating materials domain knowledge
72. A machine-learning approach to predict creep properties of Cr–Mo steel with time-temperature parameters10.1016/j.jmrt.2021.04.079 ↗
73. Material descriptors for predicting thermoelectric performance10.1039/C4EE03157A ↗
74. Atomic-position independent descriptor for machine learning of material properties10.1103/PhysRevB.98.214112 ↗
75. Knowledge-based descriptor for the compositional dependence of the phase transition in BaTiO3-based ferroelectrics10.1021/acsami.0c12763 ↗
76. Accelerated search for BaTiO3-based ceramics with large energy storage at low fields using machine learning and experimental design10.1002/advs.201901395 ↗
77. Generative artificial intelligence and its applications in materials science: current situation and future perspectives
78. Recent advances in natural language processing via large pre-trained language models: a survey10.1145/3605943 ↗
79. ChatGPT chemistry assistant for text mining and the prediction of MOF synthesis10.1021/jacs.3c05819 ↗
80. A perspective view and survey of meta-learning10.1023/A:1019956318069 ↗
81. One-shot learning of object categories10.1109/TPAMI.2006.79 ↗