Transfer Learning Study of Gas Adsorption in Metal–Organic Frameworks
Source abstract
Abstract
Metal–organic frameworks (MOFs) are a class of materials promising for gas adsorption due to their highly tunable nanoporous structures and host–guest interactions. While machine learning (ML) has been leveraged to aid the design or screen of MOFs for different purposes, the needs of big data are not always met, limiting the applicability of ML models trained against small data sets. In this work, we introduce an inductive transfer learning technique to improve the accuracy and applicability of ML models trained with a small amount of MOF adsorption data. This technique leverages potentially shareable knowledge from a source task to improve the models on the target tasks. As demonstrations, a deep neural networks (DNNs) trained on H2 adsorption data with 13 506 MOF structures at 100 bar and 243 K is used as the source task. When transferring knowledge from the source task to H2 adsorption at 100 bar and 130 K (one target task), the average predictive accuracy on target tasks was improved from 0.960 (direct training) to 0.991 (transfer learning), and transfer learning works in 89.3% of the cases. We also tested transfer learning across different gas species (i.e., from H2 to CH4), with an average predictive accuracy of CH4 adsorption being improved from 0.935 (direct training) to 0.980 (transfer learning), and transfer learning works in 82.0% of the cases. More importantly, transfer learning is shown to effectively improve the models on the target tasks with low accuracy from direct training. However, when transferring the knowledge from the source task to Xe/Kr adsorption, the transfer learning does not improve the predictive accuracy significantly and even makes it worse in ∼50.0% of the cases, which is attributed to the lack of common descriptors that is key to the underlying knowledge.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Metal-Organic Frameworks: Synthesis and Applications · Covalent Organic Framework Applications · Machine Learning in Materials Science
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (46)
Show source-provided references
1. 10.1038/nchem.83410.1038/nchem.834 ↗
2. 10.1039/b807083k10.1039/b807083k ↗
3. 10.1021/ar000101210.1021/ar0001012 ↗
4. 10.1021/ja102804s10.1021/ja102804s ↗
5. 10.1039/b803498m10.1039/b803498m ↗
6. 10.1021/cr800264210.1021/cr8002642 ↗
7. 10.1039/C4CS00070F10.1039/C4CS00070F ↗
8. 10.1021/jz300848510.1021/jz3008485 ↗
9. 10.1021/jp404287t10.1021/jp404287t ↗
10. 10.1080/08927022.2019.159727110.1080/08927022.2019.1597271 ↗
11. 10.1080/08927022.2019.164880910.1080/08927022.2019.1648809 ↗
12. 10.1039/C4CS00070F10.1039/C4CS00070F ↗
13. 10.1038/s41524-017-0045-810.1038/s41524-017-0045-8 ↗
14. 10.1016/j.cossms.2016.07.00210.1016/j.cossms.2016.07.002 ↗
15. 10.1016/j.micromeso.2020.11016010.1016/j.micromeso.2020.110160 ↗
16. 10.1021/acs.jpcc.8b0942010.1021/acs.jpcc.8b09420 ↗
17. 10.1021/acs.jctc.9b0094010.1021/acs.jctc.9b00940 ↗
18. 10.1039/C8ME00050F10.1039/C8ME00050F ↗
19. 10.1021/acs.jpcc.9b1095510.1021/acs.jpcc.9b10955 ↗
20. 10.1016/j.ces.2019.11543510.1016/j.ces.2019.115435 ↗
21. 10.1021/acs.jpcc.9b1076610.1021/acs.jpcc.9b10766 ↗
22. Zhuang, F.; Qi, Z.; Duan, K.; Xi, D.; Zhu, Y.; Zhu, H.; Xiong, H.; He, Q. A Comprehensive Survey on Transfer Learning. 2019, arXiv: 1911.02685. arXiv.org e-Print archive. https://arxiv.org/abs/1911.02685.
23. 10.1109/TKDE.2009.19110.1109/TKDE.2009.191 ↗
24. Blitzer, J.; Dredze, M.; Pereira, F. Biographies, Bollywood, Boom-Boxes and Blenders: Domain Adaptation for Sentiment Classification, In Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics , 2007; pp 440–447.
25. 10.1016/j.actamat.2017.05.01410.1016/j.actamat.2017.05.014 ↗
26. 10.1038/s41524-019-0203-210.1038/s41524-019-0203-2 ↗
27. 10.1021/acscentsci.9b0080410.1021/acscentsci.9b00804 ↗
28. 10.1021/acs.jcim.9b0035810.1021/acs.jcim.9b00358 ↗
29. 10.1039/C8SC05340E10.1039/C8SC05340E ↗
30. 10.1021/acs.cgd.7b0084810.1021/acs.cgd.7b00848 ↗
31. Studio, A.D. , 1.7; Accelrys Software Inc.: San Diego, CA, USA, 2006.
32. 10.1021/la100449z10.1021/la100449z ↗
33. 10.1021/jp074723h10.1021/jp074723h ↗
34. 10.1039/b803498m10.1039/b803498m ↗
35. 10.1021/la026399h10.1021/la026399h ↗
36. 10.1016/j.micromeso.2011.08.02010.1016/j.micromeso.2011.08.020 ↗
37. 10.1080/08927022.2015.101008210.1080/08927022.2015.1010082 ↗
38. 10.1016/S0167-7012(00)00201-310.1016/S0167-7012(00)00201-3 ↗
39. Agarap, A. F. Deep Learning using Rectified Linear Units (relu). 2018, arXiv: 1803.08375. arXiv.org e-Print archive. https://arxiv.org/abs/1803.08375.
40. Kingma, D. P.; Ba, J. Adam: A method for stochastic optimization. 2014, arXiv: 1412.6980. arXiv.org e-Print archive. https://arxiv.org/abs/1412.6980.
41. 10.1007/s00365-006-0663-210.1007/s00365-006-0663-2 ↗
42. Paszke A. · Adv. Neural Inf. Process. Syst. · 2019 · 8024
43. 10.1023/A:101093340432410.1023/A:1010933404324 ↗
44. https://eli5.readthedocs.io/en/latest/blackbox/permutation_importance.html.
45. 10.1007/s11222-016-9646-110.1007/s11222-016-9646-1 ↗
46. 10.1021/acs.chemmater.5b0147510.1021/acs.chemmater.5b01475 ↗