{"id":79541,"date":"2025-08-18T20:34:12","date_gmt":"2025-08-18T20:34:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/79541\/"},"modified":"2025-08-18T20:34:12","modified_gmt":"2025-08-18T20:34:12","slug":"claude-ai-will-end-persistently-harmful-or-abusive-user-interactions","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/79541\/","title":{"rendered":"Claude AI will end \u2018persistently harmful or abusive user interactions\u2019"},"content":{"rendered":"<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1ymtmqpi _17nnmdy1 _17nnmdy0 _1xwtict1\">Anthropic\u2019s Claude AI chatbot can now end conversations deemed \u201cpersistently harmful or abusive,\u201d as spotted <a href=\"https:\/\/techcrunch.com\/2025\/08\/16\/anthropic-says-some-claude-models-can-now-end-harmful-or-abusive-conversations\/\" rel=\"nofollow noopener\" target=\"_blank\">earlier by TechCrunch<\/a>. The capability <a href=\"https:\/\/www.anthropic.com\/research\/end-subset-conversations\" rel=\"nofollow noopener\" target=\"_blank\">is now available in Opus 4 and 4.1 models<\/a>, and will allow the chatbot to end conversations as a \u201clast resort\u201d after users repeatedly ask it to generate harmful content despite multiple refusals and attempts at redirection. The goal is to help the \u201cpotential welfare\u201d of AI models, Anthropic says, by terminating types of interactions in which Claude has shown \u201capparent distress.\u201d<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1ymtmqpi _17nnmdy1 _17nnmdy0 _1xwtict1\">If Claude chooses to cut a conversation short, users won\u2019t be able to send new messages in that conversation. They can still create new chats, as well as edit and retry previous messages if they want to continue a particular thread.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1ymtmqpi _17nnmdy1 _17nnmdy0 _1xwtict1\">During its testing of Claude Opus 4, Anthropic says it found that Claude had a \u201crobust and consistent aversion to harm,\u201d including when asked to generate sexual content involving minors, or provide information that could contribute to violent acts and terrorism. In these cases, Anthropic says Claude showed a \u201cpattern of apparent distress\u201d and a \u201ctendency to end harmful conversations when given the ability.\u201d<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1ymtmqpi _17nnmdy1 _17nnmdy0 _1xwtict1\">Anthropic notes that conversations triggering this kind of response are \u201cextreme edge cases,\u201d adding that most users won\u2019t encounter this roadblock even when chatting about controversial topics. The AI startup has also instructed Claude not to end conversations if a user is showing signs that they might want to hurt themselves or cause \u201cimminent harm\u201d to others. <a href=\"https:\/\/www.anthropic.com\/news\/building-safeguards-for-claude#:~:text=We%20also%20work,in%20these%20conversations.\" rel=\"nofollow noopener\" target=\"_blank\">Anthropic partners<\/a> with Throughline, an online crisis support provider, to help develop responses to prompts related to self-harm and mental health.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1ymtmqpi _17nnmdy1 _17nnmdy0 _1xwtict1\">Last week, <a href=\"https:\/\/www.theverge.com\/news\/760080\/anthropic-updated-usage-policy-dangerous-ai-landscape\" rel=\"nofollow noopener\" target=\"_blank\">Anthropic also updated Claude\u2019s usage policy<\/a> as rapidly advancing AI models raise more concerns about safety. Now, the company prohibits people from using Claude to develop biological, nuclear, chemical, or radiological weapons, as well as to develop malicious code or exploit a network\u2019s vulnerabilities.<\/p>\n","protected":false},"excerpt":{"rendered":"Anthropic\u2019s Claude AI chatbot can now end conversations deemed \u201cpersistently harmful or abusive,\u201d as spotted earlier by TechCrunch.&hellip;\n","protected":false},"author":2,"featured_media":79542,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,44,61],"class_list":["post-79541","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-news","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/79541","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=79541"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/79541\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/79542"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=79541"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=79541"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=79541"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}