journal article·2023-04Open access

Implicit Perception of Differences between NLP‐Produced and Human‐Produced Language in the Mentalizing Network

Zhengde Wei, Ying Chen, Qian Zhao, Pengyu Zhang, Longxi Zhou, Jiecheng Ren, Yi Piao, Bensheng Qiu, Xing Xie, Suiping Wang, Jia Liu, Daren Zhang, Roi Cohen Kadosh, Xiaochu Zhang

Advanced Science· Volume 10· Issue 12

Abstract

Abstract Natural language processing (NLP) is central to the communication with machines and among ourselves, and NLP research field has long sought to produce human‐quality language. Identification of informative criteria for measuring NLP‐produced language quality will support development of ever‐better NLP tools. The authors hypothesize that mentalizing network neural activity may be used to distinguish NLP‐produced language from human‐produced language, even for cases where human judges cannot subjectively distinguish the language source. Using the social chatbots Google Meena in English and Microsoft XiaoIce in Chinese to generate NLP‐produced language, behavioral tests which reveal that variance of personality perceived from chatbot chats is larger than for human chats are conducted, suggesting that chatbot language usage patterns are not stable. Using an identity rating task with functional magnetic resonance imaging, neuroimaging analyses which reveal distinct patterns of brain activity in the mentalizing network including the DMPFC and rTPJ in response to chatbot versus human chats that cannot be distinguished subjectively are conducted. This study illustrates a promising empirical basis for measuring the quality of NLP‐produced language: adding a judge's implicit perception as an additional criterion.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Personality Traits and Psychology · Misinformation and Its Impacts · Action Observation and Synchronization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Psychology School of Humanities & Social Science University of Science & Technology of China Hefei Anhui 230026 China

Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science & Technology of China Hefei 230027 China

Computational Bioscience Research Center (CBRC) King Abdullah University of Science and Technology (KAUST) Thuwal 4700 Saudi Arabia

Application Technology Center of Physical Therapy to Brain Disorders Institute of Advanced Technology University of Science & Technology of China Hefei 230026 China

Centers for Biomedical Engineering School of Information Science and Technology University of Science & Technology of China Hefei Anhui 230027 China

Microsoft Research Asia Beijing 100080 China

Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University) Ministry of Education Guangzhou 510631 China

State Key Laboratory of Cognitive Neuroscience and Learning Beijing Normal University Beijing 100875 China

Faculty of Health & Medical Sciences University of Surrey 30AD04 Elizabeth Fry Building Guildford GU2 7XH UK

Funding

National Natural Science Foundation of China

References (63)

Show source-provided references
1. 10.1126/science.253.5025.124210.1126/science.253.5025.1242 ↗
2. 10.1017/S095834400800081510.1017/S0958344008000815 ↗
3. 10.1075/ijcl.10.4.06sha10.1075/ijcl.10.4.06sha ↗
4. D.Adiwardana M. T.Luong D. R.So J.Hall N.Fiedel R.Thoppilan Z.Yang A.Kulshreshtha G.Nemade Y.Lu arXiv:2001.09977v32020.
5. 10.1016/j.knosys.2018.10.00610.1016/j.knosys.2018.10.006 ↗
6. 10.1016/j.chb.2016.01.00410.1016/j.chb.2016.01.004 ↗
7. 10.1016/j.jesp.2018.05.00710.1016/j.jesp.2018.05.007 ↗
8. 10.1159/00047571610.1159/000475716 ↗
9. 10.2147/CIA.S11410010.2147/CIA.S114100 ↗
10. 10.1111/j.2044-8295.1990.tb02342.x10.1111/j.2044-8295.1990.tb02342.x ↗
11. 10.1111/j.0956-7976.2004.00760.x10.1111/j.0956-7976.2004.00760.x ↗
12. 10.1186/s12978-018-0494-710.1186/s12978-018-0494-7 ↗
13. 10.1371/journal.pone.019682110.1371/journal.pone.0196821 ↗
14. 10.1016/j.sxmr.2020.06.00510.1016/j.sxmr.2020.06.005 ↗
15. 10.1016/j.tics.2011.01.00510.1016/j.tics.2011.01.005 ↗
16. 10.1146/annurev.psych.54.101601.14522510.1146/annurev.psych.54.101601.145225 ↗
17. 10.1146/annurev.psych.54.101601.14504110.1146/annurev.psych.54.101601.145041 ↗
18. 10.1146/annurev-neuro-071013-01384710.1146/annurev-neuro-071013-013847 ↗
19. 10.1016/j.tics.2017.11.00610.1016/j.tics.2017.11.006 ↗
20. 10.1037/0022-3514.77.6.129610.1037/0022-3514.77.6.1296 ↗
21. 10.1037/0022-3514.84.4.85710.1037/0022-3514.84.4.857 ↗
22. 10.1631/FITEE.170082610.1631/FITEE.1700826 ↗
23. 10.2991/nlpr.d.210223.00110.2991/nlpr.d.210223.001 ↗
24. 10.18653/v1/P16-109410.18653/v1/P16-1094 ↗
25. C.Park Y.Jang S.Lee S.Park H.Lim arXiv:2112.04126 2021.
26. 10.1609/aaai.v30i1.1047510.1609/aaai.v30i1.10475 ↗
27. 10.1038/s41467-019-09927-y10.1038/s41467-019-09927-y ↗
28. 10.1111/j.0956-7976.2004.00760.x10.1111/j.0956-7976.2004.00760.x ↗
29. 10.1016/j.tree.2012.09.00310.1016/j.tree.2012.09.003 ↗
30. Woods S. · 2004 · 47
31. 10.1016/j.neuropsychologia.2005.07.01710.1016/j.neuropsychologia.2005.07.017 ↗
32. 10.1093/cercor/bhu11610.1093/cercor/bhu116 ↗
33. 10.1016/j.cortex.2019.12.03110.1016/j.cortex.2019.12.031 ↗
34. 10.1093/scan/nst04810.1093/scan/nst048 ↗
35. 10.1017/S0140525X0004618510.1017/S0140525X00046185 ↗
36. 10.1098/rstb.2018.003310.1098/rstb.2018.0033 ↗
37. 10.1371/journal.pone.001157710.1371/journal.pone.0011577 ↗
38. 10.3389/fnhum.2012.0010310.3389/fnhum.2012.00103 ↗
39. 10.1016/j.rasd.2014.10.01510.1016/j.rasd.2014.10.015 ↗
40. 10.1371/journal.pone.000259710.1371/journal.pone.0002597 ↗
41. 10.1162/coli_a_0036810.1162/coli_a_00368 ↗
42. M.‐T. L.Daniel Adiwardana D. R.So J.Hall N.Fiedel R.Thoppilan Z.iYang A.Kulshreshtha G.Nemade Y.Lu Q. V.Le arXiv:2001.09977v3 2020.
43. 10.2466/pr0.2002.91.2.40710.2466/pr0.2002.91.2.407 ↗
44. 10.1523/JNEUROSCI.5547-11.201210.1523/JNEUROSCI.5547-11.2012 ↗
45. 10.1016/j.neubiorev.2016.03.02010.1016/j.neubiorev.2016.03.020 ↗
46. 10.2307/218244010.2307/2182440 ↗
47. 10.1146/annurev.neuro.27.070203.14423010.1146/annurev.neuro.27.070203.144230 ↗
48. 10.1093/cercor/bht11210.1093/cercor/bht112 ↗
49. 10.1016/0010-0277(95)00692-R10.1016/0010-0277(95)00692-R ↗
50. 10.1097/00001756-199509000-0000910.1097/00001756-199509000-00009 ↗
51. 10.1098/rstb.2002.121810.1098/rstb.2002.1218 ↗
52. 10.1146/annurev.psych.55.090902.14204410.1146/annurev.psych.55.090902.142044 ↗
53. 10.1016/j.neuroimage.2011.02.06710.1016/j.neuroimage.2011.02.067 ↗
54. 10.1016/j.tics.2004.10.00310.1016/j.tics.2004.10.003 ↗
55. 10.1146/annurev-psych-010418-10324410.1146/annurev-psych-010418-103244 ↗
56. 10.1037/pspp000006610.1037/pspp0000066 ↗
57. Cohen J. · 1988
58. 10.1002/1097-4679(195904)15:2<182::AID-JCLP2270150219>3.0.CO;2-710.1002/1097-4679(195904)15:2<182::AID-JCLP2270150219>3.0.CO;2-7 ↗
59. 10.1207/s15327752jpa5004_710.1207/s15327752jpa5004_7 ↗
60. 10.2147/JMDH.S10480710.2147/JMDH.S104807 ↗
61. 10.1016/j.neuron.2006.03.04010.1016/j.neuron.2006.03.040 ↗
62. 10.1162/0898929026013867210.1162/08989290260138672 ↗
63. 10.1006/nimg.2001.078910.1006/nimg.2001.0789 ↗