journal article·2021-04-25Open access

Information, Thermodynamics and Life: A Narrative Review

George I. Lambrou, Apostolos Zaravinos, Penelope Ioannidou, Dimitrios Koutsouris

Applied Sciences· Volume 11· Issue 9

Abstract

Information is probably one of the most difficult physical quantities to comprehend. This applies not only to the very definition of information, but also to the physical entity of information, meaning how can it be quantified and measured. In recent years, information theory and its function in systems has been an intense field of study, due to the large increase of available information technology, where the notion of bit dominated the information discipline. Information theory also expanded from the “simple” “bit” to the quantal “qubit”, which added more variables for consideration. One of the main applications of information theory could be considered the field of “autonomy”, which is the main characteristic of living organisms in nature since they all have self-sustainability, motion and self-protection. These traits, along with the ability to be aware of existence, make it difficult and complex to simulate in artificial constructs. There are many approaches to the concept of simulating autonomous behavior, yet there is no conclusive approach to a definite solution to this problem. Recent experimental results have shown that the interaction between machines and neural cells is possible and it consists of a significant tool for the study of complex systems. The present work tries to review the question on the interactions between information and life. It attempts to build a connection between information and thermodynamics in terms of energy consumption and work production, as well as present some possible applications of these physical quantities.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Neural dynamics and brain function · Advanced Thermodynamics and Statistical Mechanics · Neural Networks and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Choremeio Research Laboratory, First Department of Pediatrics, National and Kapodistrian University of Athens, Thivon & Levadeias 8, Goudi, 11527 Athens, Greece

Biomedical Engineering Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Heroon Polytechneiou 9, Zografou, 15780 Athens, Greece

Department of Basic Medical Sciences, College of Medicine, Member of QU Health, Qatar University, Doha P.O. Box 2713, Qatar

References (82)

Show source-provided references
1. On the notions of causality and complementarity10.1126/science.111.2873.51 ↗
2. Schroedinger, E. (1955). What is life? The physical Aspect of the Living Cell, The University Press.
3. Life as thermodynamic evidence of algorithmic structure in natural environments10.3390/e14112173 ↗
4. Wolkenhauer, O. (2010). Systems Biology-Dynamic Pathway Modelling, Universitaet Rostock.
5. Chemical information theory: Structural aspects10.1002/qua.560220845 ↗
6. Between laws of thermodynamics and coding of information: There is nothing wrong with carnot’s cycle, but contemporary thermodynamics may be more useful10.1126/science.178.4057.123 ↗
7. Ashby, W.R. (1961). An Introduction to Cybernetics, Chapman & Hall Ltd.
8. A mathematical theory of communication10.1145/584091.584093 ↗
9. Stamatiou, G. (2010). Properties of Quantum Information in Quantum Systems. [Ph.D. Thesis, University of Patras].
10. Gallager, R. (2014). Information Theory and Reliable Communication: Course Held at the Department for Automation and Information July 1970, Springer.
11. Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, Wiley.10.1002/047174882X ↗
12. Organisms, organizations and interactions: An information theory approach to biocultural evolution
13. Gray, R.M. (2013). Entropy and Information Theory, Springer.
14. Roman, S. (1992). Coding and Information Theory, Springer.
15. Recent results in the shannon theory10.1109/TIT.1974.1055171 ↗
16. Wheeler, J.A. (1989, January 28–31). Information, physics, quantum: The search for links. Proceedings of the International Symposium on Foundations of Quantum Mechanics, Tokyo, Japan.
17. Foschini, L. (2013). Where the It from Bit Come From?, INAF-Osservatorio Astronomico di Brera, Merate (LC).
18. Wheeler, J.A., and Ford, K. (2010). Geons, Black Holes, and Quantum Foam: A Life in Physics, W. W. Norton.
19. The uncertainty relations in quantum mechanics
20. Dissipation and noise-immunity in computation and communication10.1038/335779a0 ↗
21. Frieden, B.R., and Gatenby, R.A. (2011). Information dynamics in living systems: Prokaryotes, eukaryotes, and cancer. PLoS ONE, 6.10.1371/journal.pone.0022085 ↗
22. Information theory in living systems, methods, applications, and challenges10.1007/s11538-006-9141-5 ↗
23. Maxwell, J.C. (1871). Theory of Heat, Longmans.
24. Ueber die entropieverminderung in einem thermodynamischen system bei eingriffen intelligenter wesen10.1007/BF01341281 ↗
25. Brillouin, L. (2012). Relativity Reexamined, Elsevier Science.
26. Life, hierarchy, and the thermodynamic machinery of planet earth10.1016/j.plrev.2010.10.002 ↗
27. On the origin of cancer cells10.1126/science.123.3191.309 ↗
28. The thermodynamic cost of fast thought10.1007/s11023-013-9302-x ↗
29. The foundations of information science. Part i. Philosophical aspects10.1177/016555158000200302 ↗
30. Nonequilibrium thermodynamics of feedback control10.1103/PhysRevE.85.021104 ↗
31. Maximum work extraction and implementation costs for nonequilibrium maxwell’s demons10.1103/PhysRevE.90.042119 ↗
32. Genome structure described by formal languages10.1093/nar/12.5.2561 ↗
33. Castellini, A., Franco, G., and Manca, V. (2012). A dictionary based informational genome analysis. BMC Genom., 13.10.1186/1471-2164-13-485 ↗
34. Information theory applications for biological sequence analysis10.1093/bib/bbt068 ↗
35. Moya, A. (2015). The Calculus of Life: Towards a Theory of Life, Springer International Publishing.10.1007/978-3-319-16970-5 ↗
36. Applying shannon’s information theory to bacterial and phage genomes and metagenomes10.1038/srep01033 ↗
37. Application of information theory and extreme physical information to carcinogenesis
38. A supersymmetric model for the evolution of the genetic code10.1073/pnas.95.3.987 ↗
39. Dragovich, B. (2009). Genetic code and number theory. arXiv.
40. Molecular themes in oncogenesis10.1016/0092-8674(91)90636-D ↗
41. RA Fisher’s contributions to genetical statistics10.2307/2532436 ↗
42. Information theory in biology after 18 years10.1126/science.168.3939.1545 ↗
43. Bush, R.R., and Mosteller, F. (1953). A stochastic model with applications to learning. Ann. Math. Stat., 559–585.10.1214/aoms/1177728914 ↗
44. Topological field theory of dynamical systems10.1063/1.4746037 ↗
45. Ovchinnikov, I.V. (2012). Topological supersymmetry breaking as the origin of the butterfly effect. arXiv.
46. Ovchinnikov, I.V. (2013). Transfer operators and topological field theory. arXiv.
47. Topological field theory of dynamical systems. II10.1063/1.4775755 ↗
48. Self-organized criticality as witten-type topological field theory with spontaneously broken becchi-rouet-stora-tyutin symmetry10.1103/PhysRevE.83.051129 ↗
49. Toward a statistical theory of learning10.1037/h0058559 ↗
50. A statistical description of verbal learning10.1007/BF02288914 ↗
51. Stanley, J.C. (1950). The Differential Effects of Partial and Continuous Reward upon the Acquisition and Elimination of a Running Response in a Two-Choice Situation. [Ph.D. Thesis, Harvard Graduate School of Education].
52. Bush, R.R. (1955). Some problems in stochastic learning models with three or more responses. Mathematical Model of Human Behavior: Proceedings of a Symposium, Dunlap & Associates Inc.
53. Mosteller, F. (1956). Stochastic learning models. Proceedings of the Berkeley Symposium on Mathematical Statistics and Probability, University of California Press.
54. Information-driven self-organization: The dynamical system approach to autonomous robot behavior10.1007/s12064-011-0137-9 ↗
55. Methods for quantifying the informational structure of sensory and motor data10.1385/NI:3:3:243 ↗
56. Prokopenko, M., Gerasimov, V., and Tanev, I. (2006). Evolving Spatiotemporal Coordination in a Modular Robotic System, Springer.10.1007/11840541_46 ↗
57. Martius, G., Der, R., and Ay, N. (2013). Information driven self-organization of complex robotic behaviors. PLoS ONE, 8.10.1371/journal.pone.0063400 ↗
58. Genetic algorithm optimization of supercritical fluid extraction of nimbin from neem seeds10.1016/j.jfoodeng.2009.10.001 ↗
59. Der, R., and Liebscher, R.A. (2002). True Autonomy from Self-Organized Adaptivity, Universität Leipzig.
60. Learning with incomplete information in the committee machine10.1007/s00422-009-0345-2 ↗
61. From synaptic plasticity to spatial maps and sequence learning10.1002/hipo.22472 ↗
62. A hebbian/anti-hebbian neural network for linear subspace learning: A derivation from multidimensional scaling of streaming data10.1162/NECO_a_00745 ↗
63. Improved bidirectional retrieval of sparse patterns stored by hebbian learning10.1016/S0893-6080(98)00125-7 ↗
64. Feller, W. (1968). An Introduction to Probability Theory and Its Applications: Volume i, John Wiley & Sons.
65. Braitenberg, V. (1984). Vehicles: Explorations in Synthetic Psychology, MIT Press.
66. Temporal code versus rate code for binary information sources10.1016/j.neucom.2016.08.034 ↗
67. Reliability of spike timing in neocortical neurons10.1126/science.7770778 ↗
68. Universal theory of brain waves: From linear loops to nonlinear synchronized spiking and collective brain rhythms10.1103/PhysRevResearch.2.023061 ↗
69. Oweiss, K.G. (2010). Chapter 8—Inner products for representation and learning in the spike train domain. Statistical Signal Processing for Neuroscience and Neurotechnology, Academic Press.
70. Deciphering the neural code: Neuronal discharge variability is preferentially controlled by the temporal distribution of afferent impulses10.1016/S0925-2312(01)00556-2 ↗
71. Novel presynaptic mechanisms for coincidence detection in synaptic plasticity10.1016/j.conb.2006.05.008 ↗
72. A theoretical analysis of neuronal variability10.1016/S0006-3495(65)86709-1 ↗
73. How far can neural correlations reduce uncertainty? Comparison of information transmission rates for markov and bernoulli processes10.1142/S0129065719500035 ↗
74. The mathematical theory of communication. 1963
75. Gupta, D.S., and Bahmer, A. (2019). Increase in mutual information during interaction with the environment contributes to perception. Entropy, 21.10.20944/preprints201902.0153.v1 ↗
76. Upper limit on the thermodynamic information content of an action potential10.3389/fncom.2020.00037 ↗
77. Computational analysis in vitro: Dynamics and plasticity of a neuro-robotic system10.1088/1741-2560/2/3/S08 ↗
78. Detection of nonlinear dynamics in short, noisy time series10.1038/381215a0 ↗
79. Titration of chaos with added noise10.1073/pnas.131173198 ↗
80. Postural control in the lamprey: A study with a neuro-mechanical model10.1152/jn.2000.84.6.2880 ↗
81. Logical reversibility of computation10.1147/rd.176.0525 ↗
82. Information theory and computational thermodynamics: Lessons for biology from physics10.3390/info3040739 ↗