journal article·2020-02-14Open access

Net-Net AutoML Selection of Artificial Neural Network Topology for Brain Connectome Prediction

Enrique Barreiro, Cristian R. Munteanu, Marcos Gestal, Juan Ramón Rabuñal, Alejandro Pazos, Humberto González-Díaz, Julián Dorado

Applied Sciences· Volume 10· Issue 4

Abstract

Brain Connectome Networks (BCNs) are defined by brain cortex regions (nodes) interacting with others by electrophysiological co-activation (edges). The experimental prediction of new interactions in BCNs represents a difficult task due to the large number of edges and the complex connectivity patterns. Fortunately, we can use another special type of networks to achieve this goal—Artificial Neural Networks (ANNs). Thus, ANNs could use node descriptors such as Shannon Entropies (Sh) to predict node connectivity for large datasets including complex systems such as BCN. However, the training of a high number of ANNs for BCNs is a time-consuming task. In this work, we propose the use of a method to automatically determine which ANN topology is more efficient for the BCN prediction. Since a network (ANN) is used to predict the connectivity in another network (BCN), this method was entitled Net-Net AutoML. The algorithm uses Sh descriptors for pairs of nodes in BCNs and for ANN predictors of BCNs. Therefore, it is able to predict the efficiency of new ANN topologies to predict BCNs. The current study used a set of 500,470 examples from 10 different ANNs to predict node connectivity in BCNs and 20 features. After testing five Machine Learning classifiers, the best classification model to predict the ability of an ANN to evaluate node interactions in BCNs was provided by Random Forest (mean test AUROC of 0.9991 ± 0.0001, 10-fold cross-validation). Net-Net AutoML algorithms based on entropy descriptors may become a useful tool in the design of automatic expert systems to select ANN topologies for complex biological systems. The scripts and dataset for this project are available in an open GitHub repository.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Neural dynamics and brain function · Functional Brain Connectivity Studies · Computational Drug Discovery Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

RNASA-IMEDIR Group, Computer Science Faculty, University of A Coruña, Elviña, 150171 A Coruña, Spain

Center for Computational Science (CCS), University of Miami, Miami, FL 33136, USA

Computer Engineering, West Coast University, Miami Campus, Doral, FL 33178, USA

Centre for Information and Communications Technology Research (CITIC), Campus de Elviña s/n, 15071 A Coruña, Spain

Biomedical Research Institute of A Coruña (INIBIC), University Hospital Complex of A Coruña (CHUAC), 15006 A Coruña, Spain

Department of Organic Chemistry II, University of the Basque Country UPV/EHU, 48940 Leioa, Spain

IKERBASQUE, Basque Foundation for Science, 48011 Bilbao, Spain

Funding

Instituto de Salud Carlos III

References (73)

Show source-provided references
1. Large-scale functional organization of long-range chromatin interaction networks10.1016/j.celrep.2012.09.022 ↗
2. Rigidity and flexibility of biological networks10.1093/bfgp/els023 ↗
3. Structure and dynamics of molecular networks: A novel paradigm of drug discovery: A comprehensive review10.1016/j.pharmthera.2013.01.016 ↗
4. Interactome networks and human disease10.1016/j.cell.2011.02.016 ↗
5. Network medicine: A network-based approach to human disease10.1038/nrg2918 ↗
6. Network biology: Understanding the cell’s functional organization10.1038/nrg1272 ↗
7. Exploring complex networks10.1038/35065725 ↗
8. The application of graph theoretical analysis to complex networks in the brain10.1016/j.clinph.2007.08.010 ↗
9. Automatic feature extraction using genetic programming: An application to epileptic EEG classification10.1016/j.eswa.2011.02.118 ↗
10. Experimental study and Random Forest prediction model of microbiome cell surface hydrophobicity10.1016/j.eswa.2016.10.058 ↗
11. Exploring patterns of epigenetic information with data mining techniques10.2174/138161213804581936 ↗
12. Classification of signals by means of genetic programming10.1007/s00500-013-1036-4 ↗
13. A mathematical theory of communication10.1002/j.1538-7305.1948.tb01338.x ↗
14. Dehmer, M., and Emmert-Streib, F. (2009). Analysis of Complex Networks. From Biology to Linguistics, WILEY-VCH Verlag GmbH & Co. KGaA.10.1002/9783527627981 ↗
15. Dehmer, M., Grabner, M., and Varmuza, K. (2012). Information indices with high discriminative power for graphs. PLoS ONE, 7.10.1371/journal.pone.0031214 ↗
16. On entropy-based molecular descriptors: Statistical analysis of real and synthetic chemical structures10.1021/ci900060x ↗
17. Continuous symmetry numbers and entropy10.1021/ja020619w ↗
18. Information properties of naturally-occurring proteins: Fourier analysis and complexity phase plots10.1007/s10930-012-9432-7 ↗
19. On the information expressed in enzyme structure: More lessons from ribonuclease A10.1007/s11030-011-9307-4 ↗
20. On the information expressed in enzyme primary structure: Lessons from Ribonuclease A10.1007/s11030-009-9211-3 ↗
21. Information and classical thermodynamic transformations10.1021/jp7119526 ↗
22. Experimental investigation of information processing under irreversible Brownian conditions: Work/time analysis of paper chromatograms10.1021/jp711953r ↗
23. Information content in organic molecules: Brownian processing at low levels10.1021/ci600488x ↗
24. Information content in organic molecules: Aggregation states and solvent effects10.1021/ci050101m ↗
25. Information content in organic molecules: Reaction pathway analysis via Brownian processing10.1021/ci040022v ↗
26. Information content in organic molecules: Quantification and statistical structure via Brownian processing10.1021/ci0400213 ↗
27. Information and organic molecules: Structure considerations via integer statistics10.1021/ci0102923 ↗
28. Base information content in organic formulas10.1021/ci990182k ↗
29. Shannon’s, Mutual, conditional and joint entropy information indices. Generalization of global indices defined from local vertex invariants10.2174/1573409911309020003 ↗
30. Naïve Bayes QSDR classification based on spiral-graph Shannon entropies for protein biomarkers in human colon cancer10.1039/c2mb25039j ↗
31. New Markov-Shannon Entropy models to assess connectivity quality in complex networks: From molecular to cellular pathway, Parasite-Host, Neural, Industry, and Legal-Social networks10.1016/j.jtbi.2011.10.016 ↗
32. Entropy multi-target QSAR model for prediction of antiviral drug complex networks10.1016/j.chemolab.2011.02.003 ↗
33. Multi-target QPDR classification model for human breast and colon cancer-related proteins using star graph topological indices10.1016/j.jtbi.2008.11.017 ↗
34. Natural/random protein classification models based on star network topological indices10.1016/j.jtbi.2008.07.018 ↗
35. Enzymes/non-enzymes classification model complexity based on composition, sequence, 3D and topological indices10.1016/j.jtbi.2008.06.003 ↗
36. Chemometrics for QSAR with low sequence homology: Mycobacterial promoter sequences recognition with 2D-RNA entropies10.1016/j.chemolab.2006.03.005 ↗
37. Stochastic molecular descriptors for polymers. 2. Spherical truncation of electrostatic interactions on entropy based polymers 3D-QSAR10.1016/j.polymer.2005.01.066 ↗
38. Plasmod-PPI: A web-server predicting complex biopolymer targets in plasmodium with entropy measures of protein-protein interactions10.1016/j.polymer.2009.11.029 ↗
39. Prediction of thermal conductivity detection response factors using an artificial neural network10.1016/S0021-9673(00)00793-7 ↗
40. Multi-target spectral moment QSAR versus ANN for antiparasitic drugs against different parasite species10.1016/j.bmc.2010.01.068 ↗
41. ANN multiplexing model of drugs effect on macrophages; theoretical and flow cytometry study on the cytotoxicity of the anti-microbial drug G1 in spleen10.1016/j.bmc.2012.07.020 ↗
42. ANN-QSAR model for selection of anticancer leads from structurally heterogeneous series of compounds10.1016/j.ejmech.2006.11.016 ↗
43. MIANN models in medicinal, physical and organic chemistry10.2174/1568026611313050006 ↗
44. Frank, H. (2017). Auto-WEKA 2.0: Automatic model selection and hyperparameter optimization in WEKA. Automated Machine Learning, Springer.
45. Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., and Blum, M. (2015). Efficient and robust automated machine learning. Advances in Neural Information Processing Systems, Curran Associates, Inc.
46. Net-Net auto machine learning (AutoML) prediction of complex ecosystems10.1038/s41598-018-30637-w ↗
47. Network architecture of the long-distance pathways in the macaque brain10.1073/pnas.1008054107 ↗
48. StatSoft. Inc (2002). STATISTICA (Data Analysis Software System), Version 6.0, StatSoft. Inc.
49. MI-NODES multiscale models of metabolic reactions, brain connectome, ecological, epidemic, world trade, and legal-social networks10.2174/1574893610666151008013413 ↗
50. Nearest neighbor pattern classification10.1109/TIT.1967.1053964 ↗
51. Assumptions in linear discriminant analysis10.1016/S0140-6736(71)90151-6 ↗
52. Lowd, D., and Domingos, P. (2005, January 7–11). Naive Bayes models for probability estimation. Proceedings of the 22nd International Conference on Machine Learning, Bonn, Germany.10.1145/1102351.1102418 ↗
53. Han, S., Qubo, C., and Meng, H. (2012, January 24–28). Parameter selection in SVM with RBF kernel function. Proceedings of the World Automation Congress 2012, Puerto Vallarta, Mexico.
54. Hilbe, J.M. (2009). Logistic Regression Models, Chapman & Hall/CRC Press.10.1201/9781420075779 ↗
55. Haykin, S. (1994). Neural Networks: A Comprehensive Foundation, Prentice Hall PTR.
56. Induction of decision trees10.1007/BF00116251 ↗
57. Random forests10.1023/A:1010933404324 ↗
58. Chen, T., and Guestrin, C. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd ACM Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
59. Greedy function approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
60. A Decision-theoretic generalization of on-line learning and an application to boosting10.1006/jcss.1997.1504 ↗
61. Bagging predictors10.1007/BF00058655 ↗
62. An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
63. The Human Connectome Project: A data acquisition perspective10.1016/j.neuroimage.2012.02.018 ↗
64. Brain connectivity analysis: A short survey10.1155/2012/412512 ↗
65. Advanced database methodology for the Collation of Connectivity data on the Macaque brain (CoCoMac)10.1098/rstb.2001.0908 ↗
66. Online retrieval, processing, and visualization of primate connectivity data from the CoCoMac database10.1385/NI:2:2:127 ↗
67. High performance computing in biology: Multimillion atom simulations of nanoscale systems10.1016/j.jsb.2006.10.023 ↗
68. Current developments in and importance of high-performance computing in drug discovery
69. Ultrasonic diffraction tomography: An application connecting high performance computing centers with clinical environment
70. High-performance computing, high-speed networks, and configurable computing environments: Progress toward fully distributed computing
71. High performance computing in structural determination by electron cryomicroscopy10.1016/j.jsb.2008.07.005 ↗
72. Promise and challenge of high-performance computing, with examples from molecular modelling10.1098/rsta.2002.0984 ↗
73. High-performance computing in computational fluid dynamics: Progress and challenges10.1098/rsta.2002.0990 ↗