journal article·2024-10-08Open access

Trust Not Verify? The Critical Need for Data Curation Standards in Materials Informatics

Matthew Hart, Kelvin Idanwekhai, Vinicius M. Alves, Alexander J. M. Miller, Jillian L. Dempsey, James F. Cahoon, Chun-Hsing Chen, David A. Winkler, Eugene N. Muratov, Alexander Tropsha

Chemistry of Materials· Volume 36· Issue 19

Abstract

The importance of data curation has been recognized in multiple areas of research; however, the discussion of this important issue is only beginning to emerge in materials science. In this Perspective, we highlight the benefits of using the standardized data curation protocols in materials science and discuss current gaps in accurate and reproducible data reporting using case studies drawn from high-impact materials science papers and well-known databases such as the Crystallography Open Database (COD) and the Cambridge Structural Database (CSD). We argue that both experimental and computational materials scientists need to embrace a culture of rigorous data curation as part of modern research data management. We propose a sample data curation pipeline for materials chemistry and illustrate its use by creating two new materials chemistry databases. We hope that this perspective will serve to catalyze further discussion and promote the continuous development of rigorous data curation practices within the materials science research community. We posit that adherence to best practices of data curation will promote and enhance the reliability, reproducibility, and integrity of materials research and enable the development of reliable AI and machine learning models that critically depend on the use of quality data.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Research Data Management Practices · Machine Learning in Materials Science · Advanced Materials Characterization Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599, United States

Department of Applied Physical Sciences, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27516, United States

Department of Chemistry, The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27516, United States

School of Pharmacy, University of Nottingham, Nottingham NG7 2QL, United Kingdom

Department of Biochemistry and Chemistry, La Trobe Institute for Molecular Science, La Trobe University, Melbourne, Victoria 3086, Australia

Monash Institute of Pharmaceutical Sciences, Monash University, Parkville, Victoria 3052, Australia

Funding

Division of Mathematical Sciences · Basic Energy Sciences

References (79)

Show source-provided references
1. 10.1016/j.drudis.2020.12.00710.1016/j.drudis.2020.12.007 ↗
2. 10.1021/acs.chemmater.2c0133310.1021/acs.chemmater.2c01333 ↗
3. 10.1126/science.aah616810.1126/science.aah6168 ↗
4. 10.1021/ci100176x10.1021/ci100176x ↗
5. 10.1021/acs.jcim.6b0012910.1021/acs.jcim.6b00129 ↗
6. 10.1038/nnano.2017.23310.1038/nnano.2017.233 ↗
7. 10.1016/j.coche.2021.10077810.1016/j.coche.2021.100778 ↗
8. 10.1039/C6NP00022C10.1039/C6NP00022C ↗
9. 10.1016/B0-12-369400-0/00462-210.1016/B0-12-369400-0/00462-2 ↗
10. Ball, A. Review of Data Management Lifecycle Models; University of Bath: Bath, UK, 2012.
11. 10.1038/s41524-019-0221-010.1038/s41524-019-0221-0 ↗
12. 10.1038/533452a10.1038/533452a ↗
13. 10.1038/533452a10.1038/533452a ↗
14. NIH Scientific Data Sharing. Data Management and Sharing Policy. https://sharing.nih.gov/data-management-and-sharing-policy/data-management (accessed 2024-07-11).
15. 10.1063/1.481232310.1063/1.4812323 ↗
16. 10.1038/sdata.2016.1810.1038/sdata.2016.18 ↗
17. 10.1038/sdata.2016.1810.1038/sdata.2016.18 ↗
18. National Institutes of Health Office of Intramural Research. 2023 NIH Data Management and Sharing Policy. https://oir.nih.gov/sourcebook/intramural-program-oversight/intramural-data-sharing/2023-nih-data-management-sharing-policy#:~:text=The%20NIH%20has%20issued%20a,products%20that%20improve%20human%20health (accessed 2024-07-11).
19. 10.1038/s41563-023-01699-710.1038/s41563-023-01699-7 ↗
20. 10.1038/s41563-023-01790-z10.1038/s41563-023-01790-z ↗
21. 10.1039/D0CS00098A10.1039/D0CS00098A ↗
22. 10.1016/j.conbuildmat.2020.11947810.1016/j.conbuildmat.2020.119478 ↗
23. 10.1126/science.aar516910.1126/science.aar5169 ↗
24. 10.1126/science.aat860310.1126/science.aat8603 ↗
25. 10.1038/s41597-022-01163-210.1038/s41597-022-01163-2 ↗
26. 10.1371/journal.pcbi.100690610.1371/journal.pcbi.1006906 ↗
27. 10.1038/sdata.2019.210.1038/sdata.2019.2 ↗
28. 10.1021/acs.chemmater.0c0190710.1021/acs.chemmater.0c01907 ↗
29. 10.1038/s41557-021-00716-z10.1038/s41557-021-00716-z ↗
30. 10.1021/ci060117s10.1021/ci060117s ↗
31. 10.1021/ci400572x10.1021/ci400572x ↗
32. 10.1038/s41467-020-17112-910.1038/s41467-020-17112-9 ↗
33. 10.1080/00131857.2022.212491410.1080/00131857.2022.2124914 ↗
34. 10.1038/s41467-021-22611-410.1038/s41467-021-22611-4 ↗
35. 10.1557/mrs.2016.9310.1557/mrs.2016.93 ↗
36. 10.1038/s41597-023-02198-910.1038/s41597-023-02198-9 ↗
37. 10.14778/3352063.335211610.14778/3352063.3352116 ↗
38. Muller, M.; Lange, I.; Wang, D.; Piorkowski, D.; Tsay, J.; Liao, Q. V.; Dugan, C.; Erickson, T. How Data Science Workers Work with Data: Discovery, Capture, Curation, Design, Creation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems; ACM: Glasgow, Scotland, UK, 2019; pp 1–15. 10.1145/3290605.3300356.10.1145/3290605.3300356 ↗
39. 10.1080/01930826.2011.60126910.1080/01930826.2011.601269 ↗
40. Wang, J.; Kuo, T.; Li, L.; Zeller, A. Assessing and Restoring Reproducibility of Jupyter Notebooks. In Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering; Virtual Event Australia; ACM: 2020; pp 138–149. 10.1145/3324884.3416585.10.1145/3324884.3416585 ↗
41. 10.1016/j.jbi.2013.12.00610.1016/j.jbi.2013.12.006 ↗
42. 10.1016/j.compchemeng.2020.10681310.1016/j.compchemeng.2020.106813 ↗
43. Li, H.; Armiento, R.; Lambrix, P. An Ontology for the Materials Design Domain. The Semantic Web – ISWC 2020; Springer: 2020; Vol. 12507, p 212,10.1007/978-3-030-62466-8_14.10.1007/978-3-030-62466-8_14 ↗
44. 10.1002/aisy.20230005110.1002/aisy.202300051 ↗
45. 10.1107/S010876810101712810.1107/S0108768101017128 ↗
46. 10.1107/S205322961401754910.1107/S2053229614017549 ↗
47. 10.1107/S205252061700593510.1107/S2052520617005935 ↗
48. 10.1107/S160053680300892410.1107/S1600536803008924 ↗
49. 10.1021/acs.jcim.2c0090310.1021/acs.jcim.2c00903 ↗
50. 10.1021/jm070571310.1021/jm0705713 ↗
51. 10.1002/minf.20160011810.1002/minf.201600118 ↗
52. 10.1007/BF0099401810.1007/BF00994018 ↗
53. 10.1002/wics.4910.1002/wics.49 ↗
54. Liu, F. T.; Ting, K. M.; Zhou, Z.H. Isolation Forest. In 2008 Eighth IEEE International Conference on Data Mining; IEEE: Pisa, Italy, 2008; pp 413–422. 10.1109/ICDM.2008.17.10.1109/ICDM.2008.17 ↗
55. 10.1109/TIT.1967.105396410.1109/TIT.1967.1053964 ↗
56. 10.1080/1478644010946272010.1080/14786440109462720 ↗
57. 10.1021/jacsau.1c0003510.1021/jacsau.1c00035 ↗
58. 10.1039/D2SC04676H10.1039/D2SC04676H ↗
59. Landrum G. · RDKit: Open-Source Cheminformatics Software
60. 10.1038/sdata.2016.1210.1038/sdata.2016.12 ↗
61. 10.1038/s41524-019-0203-210.1038/s41524-019-0203-2 ↗
62. 10.1038/s41467-023-39868-610.1038/s41467-023-39868-6 ↗
63. 10.1021/acs.jpclett.8b0012410.1021/acs.jpclett.8b00124 ↗
64. 10.1021/acsomega.2c0485610.1021/acsomega.2c04856 ↗
65. 10.21272/jnep.8(4(1)).0402110.21272/jnep.8(4(1)).04021 ↗
66. 10.1007/s11837-015-1495-410.1007/s11837-015-1495-4 ↗
67. 10.1021/jacs.1c0818110.1021/jacs.1c08181 ↗
68. 10.1107/S160057672001653210.1107/S1600576720016532 ↗
69. 10.1107/S205252061600395410.1107/S2052520616003954 ↗
70. 10.1126/science.110469610.1126/science.1104696 ↗
71. 10.1126/science.337.6092.290-a10.1126/science.337.6092.290-a ↗
72. Yang, S.; Lach-hab, M.; Vaisman, I. I.; Li, X.; Blaisten-Barojas, E. Problematic Zeolite Records and Bibliographic Reference Link for Normal Zeolite Records in the Inorganic Crystal Structure Database. arXiv, November 9, 2009, http://arxiv.org/abs/0908.4115 (accessed 2024-01-29).
73. 10.1016/j.commatsci.2018.02.00210.1016/j.commatsci.2018.02.002 ↗
74. MatWeb, LLC.
75. Granta Design. Prospector Plastics. https://www.ansys.com/products/materials/materials-data-library (accessed 2024-07-11).
76. Journal of Chemical Information and Modeling. Author Guidelines. https://publish.acs.org/publish/author_guidelines?coden=jcisd8 (accessed 2024-07-11).
77. 10.1186/s13321-022-00614-710.1186/s13321-022-00614-7 ↗
78. 10.1186/s12989-021-00442-x10.1186/s12989-021-00442-x ↗
79. 10.1063/1.504683910.1063/1.5046839 ↗