{"id":64511,"date":"2025-10-08T02:27:22","date_gmt":"2025-10-08T02:27:22","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/64511\/"},"modified":"2025-10-08T02:27:22","modified_gmt":"2025-10-08T02:27:22","slug":"openai-says-chinese-agents-used-chatgpt-to-plan-mass-surveillance-tools-targeting-social-media","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/64511\/","title":{"rendered":"OpenAI says Chinese agents used ChatGPT to plan mass surveillance tools targeting social media"},"content":{"rendered":"<p>OpenAI has announced that it banned several ChatGPT accounts that were attempting to use the AI chatbot to develop tools for large-scale monitoring of data collected on social media platforms. The AI startup said that it has banned a user who was asking ChatGPT to help design promotional materials and project plans for an AI-powered social media listening tool for use by a government client. The tool is described as a social media &#8220;probe,&#8221; which could scan social media sites like X, Facebook, Instagram, Reddit, TikTok, and YouTube for specific extremist speech, and ethnic, religious, and political content.<\/p>\n<p>\u200bThe company also says it banned another account, suspected of being connected to a government entity, who was using ChatGPT to help write a proposal for a &#8220;High-Risk Uyghur-Related Inflow Warning Model.&#8221; The proposal would analyze transport bookings and compare them with the police records in order to provide early warning of travel movements by the Uyghur community.<\/p>\n<p>\u200b&#8221;The PRC is making real progress in advancing its autocratic version of AI,&#8221; <a class=\"backlink\" target=\"_blank\" href=\"https:\/\/www.livemint.com\/companies\/openai-deals-with-amd-and-nvidia-may-lead-to-a-show-me-the-money-moment-11759839578140.html\" data-vars-page-type=\"story\" data-vars-link-type=\"Manual\" data-vars-anchor-text=\"OpenAI\" rel=\"nofollow noopener\">OpenAI<\/a> said in the report.<\/p>\n<p>\u200b&#8221;Some elements of this usage appeared aimed at supporting large-scale monitoring of online or offline traffic, underscoring the importance of our ongoing attention to potential authoritarian abuses in this space,&#8221; the company added.<\/p>\n<p>\u200bNotably, OpenAI&#8217;s models are not officially available in China, and the company says that these users may have used a VPN to access its website.<\/p>\n<p>\u200bOpenAI says it also banned Russian hackers who were using its AI model to develop and refine malware, including a remote access trojan and credential stealers.<\/p>\n<p>\u200bThe company said in the report that it has noticed that persistent threat actors seemed to have changed their behavior in order to remove some of the better-known signs of AI usage from their content, like removing em-dashes.<\/p>\n<p>\u200bThe San Francisco-based startup noted that <a class=\"backlink\" target=\"_blank\" href=\"https:\/\/www.livemint.com\/news\/world\/florida-school-student-asks-chatgpt-how-to-kill-my-friend-lands-up-in-jail-following-gaggle-alert-11759841541691.html\" data-vars-page-type=\"story\" data-vars-link-type=\"Manual\" data-vars-anchor-text=\"ChatGPT\" rel=\"nofollow noopener\">ChatGPT<\/a> is being used to help people correctly identify scams significantly more often than it is being used by threat actors to generate scams.<\/p>\n<p>\u200b&#8221;Our current estimate is that ChatGPT is being used to identify scams up to three times more often than it is being used for scams,&#8221; the company noted.<\/p>\n<p>\u200bSince the beginning of its public threat reporting in February 2024, OpenAI says it has disrupted and reported over 40 networks that violated its usage policies.<\/p>\n<p>\u200bThe company also noted that threat actors are primarily &#8220;building AI into existing workflows,&#8221; rather than creating new workflows entirely around AI.<\/p>\n<p>\u200b&#8221;We found no evidence of new tactics or that our models provided threat actors with novel offensive capabilities. In fact, our models consistently refused outright malicious requests,&#8221; OpenAI added.<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI has announced that it banned several ChatGPT accounts that were attempting to use the AI chatbot to&hellip;\n","protected":false},"author":2,"featured_media":64512,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,52352,363,364,4036,52353,52350,52351,111,139,69,620,145],"class_list":["post-64511","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-ai-chatgpt","tag-artificial-intelligence","tag-artificialintelligence","tag-chatgpt","tag-chatgpt-free","tag-chinese-hacker","tag-hacker","tag-new-zealand","tag-newzealand","tag-nz","tag-openai","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/64511","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=64511"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/64511\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/64512"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=64511"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=64511"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=64511"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}