{"id":112815,"date":"2025-11-03T09:39:10","date_gmt":"2025-11-03T09:39:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/112815\/"},"modified":"2025-11-03T09:39:10","modified_gmt":"2025-11-03T09:39:10","slug":"people-are-telling-chatgpt-about-their-most-intimate-problems-but-ai-is-not-our-friend","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/112815\/","title":{"rendered":"People are telling ChatGPT about their most intimate problems \u2013 but AI is not our friend"},"content":{"rendered":"<p>If a lion could speak, we couldn\u2019t understand him,&#8221; wrote Ludwig Wittgenstein in the Philosophical Investigations, published in 1953. He might just as well have said that if a large language model could speak, we couldn&#8217;t understand it. And he would be right: we don\u2019t. And yet we persist in having those conversations.<\/p>\n<p>It is, fittingly, not entirely clear what Wittgenstein was getting at either. It is a kind of provocation, sandwiched between other provocations. But I at least have always understood it to be a reflection of the fact that language relies on a whole web of experiences that we must understand if we are to understand the language. A couple of paragraphs before the lion, Wittgenstein notes that people can be enigmatic to us, even if we know the words they are saying.<\/p>\n<p>\u201cWe learn this when we come into a strange country with entirely strange traditions; and, what is more, even given a mastery of the country\u2019s language,\u201d he writes. \u201cWe do not understand the people. (And not because of not knowing what they are saying to themselves.) We cannot find our feet with them.\u201d<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2025\/11\/iStock-494189202.jpeg\"  loading=\"lazy\" alt=\"ChatGPT is a linguistically gifted but fundamentally oblivious sycophant\" class=\"sc-1mc30lb-0 ggpMaE inline-gallery-btn\"\/><\/p>\n<p>open image in gallery<\/p>\n<p>ChatGPT is a linguistically gifted but fundamentally oblivious sycophant (Getty Images)<\/p>\n<p>This is something of a problem for large language models like <a href=\"https:\/\/www.independent.co.uk\/topic\/chatgpt\" rel=\"nofollow noopener\" target=\"_blank\">ChatGPT<\/a>. They have mastered our country\u2019s language, but they are inherently ignorant of our strange traditions. They are necessarily unable to understand us, to find their feet; they don\u2019t have feet, they don\u2019t even really know what a foot is, apart from it being a word that tends to come alongside other ones. <\/p>\n<p>And still people keep trying to go on deep meaningful walks with ChatGPT. The full scale of that was revealed this week, when its creators <a href=\"https:\/\/www.independent.co.uk\/topic\/openai\" rel=\"nofollow noopener\" target=\"_blank\">OpenAI<\/a> released research that said that 0.07 per cent of its users in a given week show \u201cpossible signs of mental health emergencies related to psychosis or mania\u201d. That percentage might sound small, but the numbers are huge, since OpenAI says 800 million people use it each week, so it is presumably in the hundreds of thousands. What\u2019s more, it does not account for the people whose discussions of their mental health might not be acutely concerning enough to trigger OpenAI\u2019s automatic systems for spotting distress, but are substantial nonetheless. <\/p>\n<p>This is a problem in part because ChatGPT is a linguistically gifted but fundamentally oblivious sycophant; if it were a person, it would be all IQ and no EQ, which is to say the very worst person to talk to about your emotional wellbeing, but one that it is tempting to share your problems with. ChatGPT will say all the right things, but not mean any of them. It will give you the sense of having shared a problem, but ultimately sharing is a reciprocal and active process on both parts, which requires someone to actually accept as well as give.<\/p>\n<p>Many of us know this, intellectually; it\u2019s obvious when you think about it that there\u2019s no other person on the other side of the chat. But it really does do a fantastic impression of there being someone on the other side. And in many ways the impression is better than sharing your problems with a real person: it\u2019s not a gossip (though your conversations might still be used against you), its attention is always on you, its responses are never especially difficult or challenging. But it is also not real.<\/p>\n<p>It is easy to forget because, for almost the entirety of history, if words had sense then they also had someone sending them to you; meaning needed a meaner. The breakthrough of recent decades \u2013 and the last few years especially \u2013 has been the production of language without anyone to actually say it. We might know intellectually that these are just \u201cwords, words, words\u201d, but it doesn\u2019t feel that way. <\/p>\n<p><img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2025\/11\/iStock-1286844073.jpeg\"  loading=\"lazy\" alt=\"The anonymous internet has brought us many amazing things, but it also weakened the idea that every idea needs someone to say it\" class=\"sc-1mc30lb-0 ggpMaE inline-gallery-btn\"\/><\/p>\n<p>open image in gallery<\/p>\n<p>The anonymous internet has brought us many amazing things, but it also weakened the idea that every idea needs someone to say it (Getty Images)<\/p>\n<p>It might partly be a result of the fact that the internet has already worn away much of the connection between words and the people forming them. The anonymous internet has brought us many amazing things, but it also weakened the idea that every idea needs someone to say it, an idea that couldn\u2019t survive pseudonymous ragebait and statements hidden behind self-reference and irony of the kind found across social media. ChatGPT and similar apps appear in the same form as conversations with customer service agents, dating app matches and other interlocutors that might never actually really exist at all.<\/p>\n<p>This isn\u2019t an entirely new problem; people have been just saying stuff probably as long as there was stuff to say. When someone playing Hamlet reads that famous \u201cwords, words, words\u201d line, we are at once convinced and critical; <a rel=\"nofollow noopener\" target=\"_blank\" href=\"https:\/\/clicks.independent.co.uk\/f\/a\/VTJVqr6maPusoit9U8nqog~~\/AAAHahA~\/HjBMPKBrJK8xhH53k4haO_SXvq431_SuKS6sGbPtcgsAe-d3hN5hUuCoVmpOCM6eKMCGEnXfUKqc4VHgblzAw1DwRYRJtj5tXp01vSNhdQkrDxXZXO-RS5yT7Vw7arekWofIHCHZjx9rxf0fQUYveuJ5mzbrPRxiOhrvAomX0YS_co_NsMK0adT92jziD9_t_5ircE97-w45DrLUhRHdX1Tf_0JdEsGLCWTE8wHWLPGG60LW8iTrifS62wSqDDlJ-T73OVFnd1hLLPnlto-cUpWNbmLZ8EtW-43eFkwi9Lfan3vLND4mvPQt3Icb17HkKZJe4pFC7sf_AdZtGISrk6yq6OkS64-DYzZNqILInuBtOocFVBl73nZdt2FjTqms4Y6C-tbF9jsapOqOfpLtVw~~\">as computing pioneer Alan Kay said in a recent talk at the Royal Society<\/a>, the theatre has always relied on the fact that the quick part of our brain understands drama as real, while the slower part understands it is as an artistic exercise. In fact, that dual recognition is part of the thrill of the theatre.<\/p>\n<p>But at the theatre we know who is talking. We have a whole intellectual framework that allows us to understand that those words are Hamlet\u2019s, and they are also Shakespeare\u2019s, and they are the actor\u2019s and the director\u2019s too, and they are also none of those people\u2019s because in another important sense they are not actually saying anything about the world beyond the play. We could do with a similarly nuanced intellectual framework around the game of speaking to ChatGPT, but we don\u2019t have it yet, and our fascination with the technology is speeding along much more quickly than any attempt to reckon with that.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2025\/11\/iStock-2184934524.jpeg\"  loading=\"lazy\" alt=\"Helping someone else carry an emotional burden is among the most human things we can do together\" class=\"sc-1mc30lb-0 ggpMaE inline-gallery-btn\"\/><\/p>\n<p>open image in gallery<\/p>\n<p>Helping someone else carry an emotional burden is among the most human things we can do together (Getty Images)<\/p>\n<p>Helping someone else carry an emotional burden is among the most human things we can do together. \u201cIf after I am free a friend of mine gave a feast, and did not invite me to it, I should not mind a bit. I can be perfectly happy by myself,\u201d Oscar Wilde writes in De Profundis, in a passage worth quoting at length. \u201cWith freedom, flowers, books, and the moon, who could not be perfectly happy? Besides, feasts are not for me any more. I have given too many to care about them. That side of life is over for me, very fortunately, I dare say.<\/p>\n<p>\u201cBut if after I am free a friend of mine had a sorrow and refused to allow me to share it, I should feel it most bitterly. If he shut the doors of the house of mourning against me, I would come back again and again and beg to be admitted, so that I might share in what I was entitled to share in. If he thought me unworthy, unfit to weep with him, I should feel it as the most poignant humiliation, as the most terrible mode in which disgrace could be inflicted on me.<\/p>\n<p>\u201cBut that could not be. I have a right to share in sorrow, and he who can look at the loveliness of the world and share its sorrow, and realise something of the wonder of both, is in immediate contact with divine things, and has got as near to God\u2019s secret as any one can get.&#8221;<\/p>\n<p><a href=\"https:\/\/www.independent.co.uk\/tech\/ai-sexism-women-discrimination-tech-b2750029.html\" title=\"Nine ways sexist AI is already discriminating against women in the real world\" rel=\"nofollow noopener\" target=\"_blank\">ChatGPT<\/a> cannot weep with us. It may bang against the doors of mourning and beg to be admitted, confident of being entitled to share in it, but only because mental and emotional suffering of this kind is good for keeping users engaged, which in turn is good for business. It cannot share our sorrows; it is as far from God\u2019s secret as anyone can get.<\/p>\n","protected":false},"excerpt":{"rendered":"If a lion could speak, we couldn\u2019t understand him,&#8221; wrote Ludwig Wittgenstein in the Philosophical Investigations, published in&hellip;\n","protected":false},"author":2,"featured_media":112816,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,85,46,125],"class_list":["post-112815","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-il","tag-israel","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/112815","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=112815"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/112815\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/112816"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=112815"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=112815"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=112815"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}