Artificial Punishment Signals for Guiding the Decision-Making Process of an Autonomous System
Source abstract
Abstract
Somatic markers have been evidenced as determinant factors in human behavior. In particular, the concepts of somatic reward and punishment have been related to the decision-making process; both reward and somatic punishment represent bodily states with positive or negative sensations, respectively. In this research work, we have designed a mechanism to generate artificial somatic punishments in an autonomous system. An autonomous system is understood as a system capable of performing autonomous behavior and decision making. We incorporated this mechanism within a decision model oriented to support decision making on stock markets. Our model focuses on using artificial somatic punishments as a tool to guide the decisions of an autonomous system. To validate our proposal, we defined an experimental scenario using official data from Standard & Poor’s 500 and the Dow Jones index, in which we evaluated the decisions made by the autonomous system based on artificial somatic punishments in a general investment process using 10,000 independent iterations. In the investment process, the autonomous system applied an active investment strategy combined with an artificial somatic index. The results show that this autonomous system presented a higher level of investment decision effectiveness, understood as the achievement of greater wealth over time, as measured by profitability, utility, and Sharpe Ratio indicators, relative to an industry benchmark.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Opinion Dynamics and Social Influence
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Escuela de Ingeniería Informática, Universidad de Valparaíso, Valparaíso 2362905, Chile
Departamento de Industrias, Universidad Técnica Federico Santa María, Valparaíso 2090123, Chile
Escuela de Psicología, Universidad Arturo Prat, Victoria 4721189, Chile
Valencian Research Institute for Artificial Intelligence (VRAIN), Universitat Politècnica de València, 46022 València, Spain
Funding
ANID Chile · Generalitat Valenciana · Spanish Government
References (52)
Show source-provided references
1. Descartes’ error: Emotion, rationality and the human brain
2. Damasio, A. (2010). Self Comes to Mind: Constructing the Conscious Brain, Knopf Doubleday Publishing Group.
3. Cabrera, D., Cubillos, C., Urra, E., and Mellado, R. (2020). Framework for incorporating artificial somatic markers in the decision-making of autonomous agents. Appl. Sci., 10.10.3390/app10207361 ↗
4. Experimental test of the effects of punishment probability and size on the decision to take a bribe10.1016/j.socec.2021.101813 ↗
5. Effect of reward and punishment on no-risk decision-making in young men: An EEG study10.1016/j.brainres.2022.147788 ↗
6. Punishment-related memory-guided attention: Neural dynamics of perceptual modulation10.1016/j.cortex.2019.01.029 ↗
7. Affective autonomous agents for supporting investment decision processes using artificial somatic reactions10.1007/s12652-021-03319-1 ↗
8. Cominelli, L., Mazzei, D., Pieroni, M., Zaraki, A., Garofalo, R., and De Rossi, D. (2015). Damasio’s somatic marker for social robotics: Preliminary implementation and test. Biomimetic and Biohybrid Systems, Proceedings of the 4th International Conference, Living Machines 2015, Barcelona, Spain, 28–31 July 2015, Springer. Proceedings 4.10.1007/978-3-319-22979-9_31 ↗
9. (2024, January 01). Standard & Poor’s 500 Index. Available online: https://www.standardandpoors.com.
10. (2024, January 01). Dow Jones Index. Available online: https://www.dowjones.com.
11. Adaptive intelligent autonomous system using artificial somatic markers and Big Five personality traits10.1016/j.knosys.2022.108995 ↗
12. Yilmaz, S., and Kafadar, H. (2022). Decision-making under stress: Executive functions, analytical intelligence, somatic markers, and personality traits in young adults. Appl. Neuropsychol. Adult, 1–15.10.1080/23279095.2022.2122829 ↗
13. Decision-making in uncertain contexts: The role of autonomic markers in resolving indecision10.1016/j.ijpsycho.2022.05.014 ↗
14. Lin, C.H., Huang, J.T., and Chiu, Y.C. (2022). Iowa Gambling Task, Somatic Marker Hypothesis, and Neuroeconomics: Rationality and Emotion in Decision Under Uncertainty. Front. Psychol., 13.10.3389/fpsyg.2022.848603 ↗
15. Xu, F., and Huang, L. (2020). Electrophysiological measurement of emotion and somatic state affecting ambiguity decision: Evidences from SCRs, ERPs, and HR. Front. Psychol., 11.10.3389/fpsyg.2020.00899 ↗
16. Snellman, H. (2024, January 01). Mind, Body, and Choice: A Review of Alexithymia and the Somatic-Marker Hypothesis 2022. Available online: https://www.diva-portal.org/smash/get/diva2:1682603/FULLTEXT01.pdf.
17. Miraghaie, A.M., Pouretemad, H., Villa, A.E., Mazaheri, M.A., Khosrowabadi, R., and Lintas, A. (2022). Electrophysiological markers of fairness and selfishness revealed by a combination of dictator and ultimatum games. Front. Syst. Neurosci., 16.10.3389/fnsys.2022.765720 ↗
18. Chaminade, T., and Spatola, N. (2022). Perceived facial happiness during conversation correlates with insular and hypothalamus activity for humans, not robots: An investigation of the somatic marker hypothesis applied to social interactions. Front. Psychol., 13.10.3389/fpsyg.2022.871676 ↗
19. May, J., Workman, C.I., Haas, J., and Han, H. (2022). The neuroscience of moral judgment: Empirical and philosophical developments. Neuroscience and Philosophy, The MIT Press.10.7551/mitpress/12611.003.0005 ↗
20. Follow your gut? Emotional intelligence moderates the association between physiologically measured somatic markers and risk-taking10.1037/emo0000561 ↗
21. Role of somatic markers in consumer durable brand selection in e-retail
22. Development of somatic markers guiding decision-making along adolescence10.1016/j.ijpsycho.2018.12.005 ↗
23. Wang, L., Li, J., Liu, H., Wang, Z., Yang, L., and An, L. (2021). Influence Factors for Decision-Making Performance of Suicide Attempters and Suicide Ideators: The Roles of Somatic Markers and Explicit Knowledge. Front. Psychol., 12.10.3389/fpsyg.2021.693879 ↗
24. Effect of financial and non-financial reward and punishment for inhibitory control in boys with attention deficit hyperactivity disorder10.1016/j.ridd.2023.104438 ↗
25. Reward and Punishment Mechanism with weighting enhances cooperation in evolutionary games10.1016/j.physa.2022.128165 ↗
26. The impact of reward and punishment sensitivity on memory and executive performance in individuals with Amnestic Mild Cognitive Impairment10.1016/j.bbr.2024.115099 ↗
27. Sensitivity to reward and punishment in adolescents with repetitive non-suicidal self-injury: The role of inhibitory control10.1016/j.ijchp.2024.100456 ↗
28. The somatic marker hypothesis: Revisiting the role of the ‘body-loop’in decision-making10.1016/j.cobeha.2017.10.007 ↗
29. Decision-making, somatic markers and emotion processing in opiate users10.1007/s00213-017-4760-0 ↗
30. Contributions of medial prefrontal cortex to decision making involving risk of punishment10.1016/j.neuropharm.2018.07.018 ↗
31. Behavioral and neurobiological mechanisms of punishment: Implications for psychiatric disorders10.1038/s41386-018-0047-3 ↗
32. Exploring market overreaction, investors’ sentiments and investment decisions in an emerging stock market10.1016/j.bir.2020.02.002 ↗
33. Optimism, volatility and decision-making in stock markets10.1016/j.irfa.2019.05.007 ↗
34. Are investors sensitive to climate-related transition and physical risks? Evidence from global stock markets10.1016/j.ribaf.2022.101710 ↗
35. Emotions and stock market anomalies: A systematic review10.1016/j.jbef.2022.100722 ↗
36. Reciprocal, but inequality averse as well? Mixed motives for punishment and reward10.1016/j.jebo.2023.03.028 ↗
37. Investors’ personal characteristics and trading decisions under distressed market conditions10.1016/j.bir.2021.04.005 ↗
38. Investor psychology in the stock market: An empirical study of the impact of overconfidence on firm valuation10.1016/j.bir.2022.09.010 ↗
39. The effects of public sentiments and feelings on stock market behavior: Evidence from Australia10.1016/j.jebo.2021.11.026 ↗
40. Cabrera-Paniagua, D., Primo, T.T., and Cubillos, C. (2014). Distributed stock exchange scenario using artificial emotional knowledge. Advances in Artificial Intelligence–IBERAMIA 2014, Proceedings of the 14th Ibero-American Conference on AI, Santiago de Chile, Chile, 24–27 November 2014, Springer. Proceedings 14.10.1007/978-3-319-12027-0_52 ↗
41. Defining an affective algorithm for purchasing decisions in E-commerce environments10.1109/TLA.2015.7273796 ↗
42. Resilience in the decision-making of an artificial autonomous system on the stock market10.1109/ACCESS.2019.2945471 ↗
43. A fuzzy appraisal model for affective agents adapted to cultural environments using the pleasure and arousal dimensions10.1016/j.ins.2020.08.006 ↗
44. Emotion space model for classifying opinions in stock message board10.1016/j.eswa.2015.08.023 ↗
45. On algorithmic collusion and reward–punishment schemes10.1016/j.econlet.2024.111661 ↗
46. Evolutionary game analysis of chemical enterprises’ emergency management investment decision under dynamic reward and punishment mechanism10.1016/j.jlp.2023.105230 ↗
47. A novel artificial autonomous system for supporting investment decisions using a Big Five model approach10.1016/j.engappai.2020.104107 ↗
48. Schäl, M. (2002). Markov decision processes in finance and dynamic options. Handbook of Markov Decision Processes: Methods and Applications, Springer.10.1007/978-1-4615-0805-2_15 ↗
49. Claramunt, M.M., Mármol, M., and Varea, X. (2023). Facing a Risk: To Insure or Not to Insure—An Analysis with the Constant Relative Risk Aversion Utility Function. Mathematics, 11.10.3390/math11051070 ↗
50. Optimal portfolio with relative performance and CRRA risk preferences in a partially observable financial market10.1016/j.amc.2024.128947 ↗
51. Mutual fund performance10.1086/294846 ↗
52. Portfolio Selection