OpenAI wants ChatGPT to stop enabling its users\u2019 unhealthy behaviors.<\/p>\n
Starting Monday, the popular chatbot app will prompt users to take breaks from lengthy conversations. The tool will also soon shy away from giving direct advice about personal challenges, instead aiming to help users decide for themselves by asking questions or weighing pros and cons.<\/p>\n
\u201cThere have been instances where our 4o model fell short in recognizing signs of delusion or emotional dependency,\u201d OpenAI wrote in an announcement. \u201cWhile rare, we\u2019re continuing to improve our models and are developing tools to better detect signs of mental or emotional distress so ChatGPT can respond appropriately and point people to evidence-based resources when needed.\u201d<\/p>\n
The updates appear to be a continuation of OpenAI\u2019s attempt to keep users, particularly those who view ChatGPT as a therapist or a friend, from becoming too reliant on the emotionally validating responses ChatGPT has gained a reputation for.<\/p>\n
A helpful ChatGPT conversation, according to OpenAI, would look like practice scenarios for a tough conversation, a \u201ctailored pep talk\u201d or suggesting questions to ask an expert.<\/p>\n
Earlier this year, the AI giant rolled back an update to GPT-4o that made the bot so overly agreeable<\/a> that it stirred mockery and concern online. Users shared conversations in which GPT-4o, in one instance, praised them for believing their family was responsible for \u201cradio signals coming in through the walls\u201d and, in another instance, endorsed and gave instructions for terrorism.<\/p>\n These behaviors led OpenAI to announce in April that it revised its training techniques<\/a> to \u201cexplicitly steer the model away from sycophancy\u201d or flattery.<\/p>\n Now, OpenAI says it has engaged experts to help ChatGPT respond more appropriately in sensitive situations, such as when a user is showing signs of mental or emotional distress. <\/p>\n The company wrote in its blog post that it worked with more than 90 physicians across dozens of countries to craft custom rubrics for \u201cevaluating complex, multi-turn conversations.\u201d It\u2019s also seeking feedback from researchers and clinicians who, according to the post, are helping to refine evaluation methods and stress-test safeguards for ChatGPT.<\/p>\n And the company is forming an advisory group made up of experts in mental health, youth development and human-computer interaction. More information will be released as the work progresses, OpenAI wrote.<\/p>\n In a recent interview with podcaster Theo Von, OpenAI CEO Sam Altman expressed some concern over people using ChatGPT as a therapist or life coach. <\/p>\n He said legal confidentiality protections between doctors and their patients or between lawyers and their clients don\u2019t apply the same way to chatbots. <\/p>\n \u201cSo if you go talk to ChatGPT about your most sensitive stuff and then there\u2019s a lawsuit or whatever, we could be required to produce that. And I think that\u2019s very screwed up,\u201d Altman said. \u201cI think we should have the same concept of privacy for your conversations with AI that we do with a therapist or whatever. And no one had to think about that even a year ago.\u201d<\/p>\n The updates come during a buzzy time for ChatGPT: It just rolled out an agent mode<\/a>, which can complete online tasks like making an appointment or summarizing an email inbox, and many online are now speculating about the highly anticipated release of GPT-5. Head of ChatGPT Nick Turley said Monday<\/a> that the AI model is on track to reach 700 million weekly active users this week.<\/p>\n As OpenAI continues to jockey in the global race for AI dominance, the company noted that less time spent in ChatGPT could actually be a sign that its product did its job.<\/p>\n \u201cInstead of measuring success by time spent or clicks, we care more about whether you leave the product having done what you came for,\u201d OpenAI wrote. \u201cWe also pay attention to whether you return daily, weekly, or monthly, because that shows ChatGPT is useful enough to come back to.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI wants ChatGPT to stop enabling its users\u2019 unhealthy behaviors. Starting Monday, the popular chatbot app will prompt…\n","protected":false},"author":2,"featured_media":45804,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,61],"class_list":["post-45803","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/45803","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=45803"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/45803\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/45804"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=45803"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=45803"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=45803"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}