journal article·2025-01Open access

COBRA web application to benchmark linear regression models for catalyst optimization with few-entry datasets

Zhen Cao, Laura Falivene, Albert Poater, Bholanath Maity, Ziyung Zhang, Gentoku Takasao, Sadeed Bin Sayed, Andrea Petta, Giovanni Talarico, Romina Oliva, Luigi Cavallo

Cell Reports Physical Science· Volume 6· Issue 1

Abstract

Multivariate linear regression (MLR) is a promising machine learning tool for catalyst engineering with small datasets. In order to become the standard in medium to small laboratories, MLR predictors must work with minimal experimental data and provide reliable predictions. To evaluate MLR predictors trained on limited datasets, we developed an easy-to-use workflow to validate models before real-world application. This workflow was tested on 29 reaction classes, covering various reaction types (e.g., hydrogenation and cross-coupling) and experimental properties (e.g., yields and selectivities). We confirm that common metrics like coefficient of determination (R 2 ) and cross-validated R 2 (Q 2 ) are useful starting points but insufficient to uncover all model weaknesses. The proposed workflow offers a systematic pipeline applicable to any MLR model, addressing these gaps. Additionally, a web application was developed to enable users to perform these validation tests online. This framework aims to standardize and simplify the evaluation of MLR predictors in catalyst research.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Catalysis and Hydrodesulfurization Studies · Catalytic Processes in Materials Science

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (61)

Show source-provided references
1. The Evolution of High-Throughput Experimentation in Pharmaceutical Development and Perspectives on the Future10.1021/acs.oprd.9b00140 ↗
2. Autonomous Chemical Experiments: Challenges and Perspectives on Establishing a Self-Driving Lab10.1021/acs.accounts.2c00220 ↗
3. Golem: an algorithm for robust experiment and process optimization10.1039/D1SC01545A ↗
4. Data-science driven autonomous process optimization10.1038/s42004-021-00550-x ↗
5. A Multi-Objective Active Learning Platform and Web App for Reaction Optimization10.1021/jacs.2c08592 ↗
6. Bayesian Optimization of Computer-Proposed Multistep Synthetic Routes on an Automated Robotic Flow Platform10.1021/acscentsci.2c00207 ↗
7. The rise of self-driving labs in chemical and materials sciences10.1038/s44160-022-00231-0 ↗
8. Prediction of higher-selectivity catalysts by computer-driven workflow and machine learning10.1126/science.aau5631 ↗
9. Predicting reaction performance in C–N cross-coupling using machine learning10.1126/science.aar5169 ↗
10. Predicting Reaction Yields via Supervised Learning10.1021/acs.accounts.0c00770 ↗
11. Bayesian reaction optimization as a tool for chemical synthesis10.1038/s41586-021-03213-y ↗
12. Bayesian optimization-driven parallel-screening of multiple parameters for the flow synthesis of biaryl compounds10.1038/s42004-022-00764-7 ↗
13. Discovery of an α-Amino C–H Arylation Reaction Using the Strategy of Accelerated Serendipity10.1126/science.1213920 ↗
14. Snap deconvolution: An informatics approach to high-throughput discovery of catalytic reactions10.1126/science.aan1568 ↗
15. The Chemical Space Project10.1021/ar500432k ↗
16. On the use of real-world datasets for reaction yield prediction10.1039/D2SC06041H ↗
17. Exploiting redundancy in large materials datasets for efficient machine learning with less data10.1038/s41467-023-42992-y ↗
18. Accelerated search for materials with targeted properties by adaptive design10.1038/ncomms11241 ↗
19. Developing Comprehensive Computational Parameter Sets To Describe the Performance of Pyridine-Oxazoline and Related Ligands10.1021/acscatal.7b00739 ↗
20. Quantifying Structural Effects of Amino Acid Ligands in Pd(II)-Catalyzed Enantioselective C–H Functionalization Reactions10.1021/acs.organomet.7b00751 ↗
21. Development of a Computer-Guided Workflow for Catalyst Optimization. Descriptor Validation, Subset Selection, and Training Set Analysis10.1021/jacs.0c04715 ↗
22. Predictive Multivariate Linear Regression Analysis Guides Successful Catalytic Enantioselective Minisci Reactions of Diazines10.1021/jacs.9b11658 ↗
23. Predicting relative efficiency of amide bond formation using multivariate linear regression10.1073/pnas.2118451119 ↗
24. Accelerated dinuclear palladium catalyst identification through unsupervised machine learning10.1126/science.abj0999 ↗
25. Data-Driven Multi-Objective Optimization Tactics for Catalytic Asymmetric Reactions Using Bisphosphine Ligands10.1021/jacs.2c08513 ↗
26. Atroposelective Negishi Coupling Optimization Guided by Multivariate Linear Regression Analysis: Asymmetric Synthesis of KRAS G12C Covalent Inhibitor GDC-603610.1021/jacs.2c09917 ↗
27. Feed-Forward Neural Network for Predicting Enantioselectivity of the Asymmetric Negishi Reaction10.1021/acscentsci.3c00512 ↗
28. Development of Modular Nitrenium Bipolar Electrolytes for Possible Applications in Symmetric Redox Flow Batteries10.1021/jacs.4c05799 ↗
29. Using Data Science Tools to Reveal and Understand Subtle Relationships of Inhibitor Structure in Frontal Ring-Opening Metathesis Polymerization10.1021/jacs.4c04622 ↗
30. Tricyclononenes and tricyclononadienes as efficient monomers for controlled ROMP: understanding structure–propagation rate relationships and enabling facile post-polymerization modification10.1039/D4SC01986E ↗
31. Data Science Guided Multiobjective Optimization of a Stereoconvergent Nickel-Catalyzed Reduction of Enol Tosylates to Access Trisubstituted Alkenes10.1021/acscatal.4c00650 ↗
32. Predicting success in Cu-catalyzed C–N coupling reactions using data science10.1126/sciadv.adn3478 ↗
33. Computational Methods Enable the Prediction of Improved Catalysts for Nickel-Catalyzed Cross-Electrophile Coupling10.1021/jacs.3c09554 ↗
34. A Comprehensive Discovery Platform for Organophosphorus Ligands for Catalysis10.1021/jacs.1c09718 ↗
35. Multi-Threshold Analysis for Chemical Space Mapping of Ni-Catalyzed Suzuki-Miyaura Couplings
36. Development of a Deactivation-Resistant Dialkylbiarylphosphine Ligand for Pd-Catalyzed Arylation of Secondary Amines10.1021/jacs.4c09667 ↗
38. Probing machine learning models based on high throughput experimentation data for the discovery of asymmetric hydrogenation catalysts10.1039/D4SC03647F ↗
39. Underspecification Presents Challenges for Credibility in Modern Machine Learning
40. Shortcut learning in deep neural networks10.1038/s42256-020-00257-z ↗
41. Cao, Z., Falivene, L., Petta, A., Cavallo, L. (2024) COBRA 1.0 A web application for catalyst optimization by linear regression. https://www.aocdweb.com/OMtools/cobra.
42. Data Science Meets Physical Organic Chemistry10.1021/acs.accounts.1c00285 ↗
43. The Evolution of Data-Driven Modeling in Organic Chemistry10.1021/acscentsci.1c00535 ↗
44. Comparing quantitative prediction methods for the discovery of small-molecule chiral catalysts10.1038/s41570-018-0040-8 ↗
45. Steric effects of phosphorus ligands in organometallic chemistry and homogeneous catalysis10.1021/cr60307a002 ↗
46. Todeschini · 2000
47. SambVca 2. A Web Tool for Analyzing Catalytic Pockets with Topographic Steric Maps10.1021/acs.organomet.6b00371 ↗
48. Towards the online computer-aided design of catalytic pockets10.1038/s41557-019-0319-5 ↗
49. Parameterization of phosphine ligands demonstrates enhancement of nickel catalysis via remote steric effects10.1038/nchem.2741 ↗
50. Designer substrate library for quantitative, predictive modeling of reaction performance10.1073/pnas.1409522111 ↗
51. Selection of Low-Dimensional 3-D Geometric Descriptors for Accurate Enantioselectivity Prediction10.1021/acscatal.2c00976 ↗
52. A Multivariate Linear Regression Approach to Predict Ethene/1-Olefin Copolymerization Statistics Promoted by Group 4 Catalysts10.1021/acscatal.0c04856 ↗
53. Hybrid Machine Learning Approach to Predict the Site Selectivity of Iridium-Catalyzed Arene Borylation10.1021/jacs.3c04986 ↗
54. Enantioselectivity prediction of pallada-electrocatalysed C–H activation using transition state knowledge in machine learning10.1038/s44160-022-00233-y ↗
55. y-Randomization and Its Variants in QSPR/QSAR10.1021/ci700157b ↗
56. Bootstrap Methods: Another Look at the Jackknife10.1214/aos/1176344552 ↗
57. Cautionary Guidelines for Machine Learning Studies with Combinatorial Datasets10.1021/acscombsci.0c00118 ↗
58. Evaluating explorative prediction power of machine learning algorithms for materials discovery using k-fold forward cross-validation10.1016/j.commatsci.2019.109203 ↗
59. A critical examination of robustness and generalizability of machine learning prediction of materials properties10.1038/s41524-023-01012-9 ↗
60. Benchmarking materials property prediction methods: the Matbench test set and Automatminer reference algorithm10.1038/s41524-020-00406-3 ↗
61. Asymmetric Epoxidation with H2O2 by Manipulating the Electronic Properties of Non-heme Iron Catalysts10.1021/ja4078446 ↗