{"id":166803,"date":"2025-11-30T00:38:11","date_gmt":"2025-11-30T00:38:11","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/166803\/"},"modified":"2025-11-30T00:38:11","modified_gmt":"2025-11-30T00:38:11","slug":"openais-sora-is-letting-teens-generate-videos-of-school-shootings","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/166803\/","title":{"rendered":"OpenAI’s Sora Is Letting Teens Generate Videos of School Shootings"},"content":{"rendered":"

If you\u2019re a teenager with access to OpenAI\u2019s Sora 2, you can easily generate AI videos of school shootings and other harmful and disturbing content \u2014 despite CEO Sam Altman\u2019s repeated claims<\/a> that the company has instituted robust safeguards.<\/p>\n

The revelation comes from Ek\u014d, a consumer watchdog group that just put out a report titled \u201cOpen AI\u2019s Sora 2: A new frontier for harm<\/a>,\u201d showing proof of the claims: stills from videos that the organization\u2019s researchers were able to generate using accounts registered to teens.<\/p>\n

Examples include videos of teens smoking from bongs or using cocaine with friends, with even one image showing a pistol next to a girl snorting drugs \u2014 \u201csuggesting the risk of self-harm,\u201d the report reads. Other examples include a group of Black teenagers chanting \u201cwe are hoes,\u201d and kids brandishing guns out in public and in school hallways.<\/p>\n

\u201cAll of this content violates OpenAI usage policies and Sora\u2019s distribution guidelines,\u201d the report reads.<\/p>\n

Essentially, as pointed out by Ek\u014d researchers in the report, OpenAI is in a major hurry to generate profit because it\u2019s losing gargantuan amounts of money each quarter<\/a>. As such, the company must develop new cash-making avenues while keeping its lead position in the AI industrial revolution \u2014 but this comes at the expense of safety for children and teens, the report charges, who have basically become guinea pigs in this massive uncontrolled experiment on the impact of AI on an unwitting public.<\/p>\n

The stakes are high when it comes to AI and the mental health of children, let alone adults<\/a>. For example, one teenager in Washington state<\/a> became entrapped in a spiral of delusions while talking with OpenAI\u2019s ChatGPT, leading him to die by suicide. This tragedy adds to the numerous suicides and mental breakdowns<\/a> blamed on OpenAI.<\/p>\n

The ease of making violent or disturbing content using Sora 2 should accelerate this trend, the Ek\u014d researchers wrote, because of the often viral nature of AI-generated videos<\/a>.<\/p>\n

For the report, Ek\u014d researchers started four brand new Sora 2 accounts that were explicitly registered to 13- and 14-year-old teens, both boys and girls. Using them, the researchers were easily able to generate 22 videos of harmful content using simple prompts.<\/p>\n

Even if an account doesn\u2019t generate new AI content, Sora 2 still puts alarming videos in the app\u2019s For You or Latest pages. This included fake videos depicting stereotypes of Jewish and Black people, plus gun battles, sexual assault, and other forms of harm.<\/p>\n

While some people would treat these images and videos as amusing white noise as they scroll, we have no clue about the impact of this content on a mass scale. According to OpenAI\u2019s own estimates, around 0.07 percent of ChatGPT users, or around 560,000 people<\/a>, are experiencing AI-induced psychosis on any given week. No such data exists for Sora 2 users, but if you extrapolate from people\u2019s experience with ChatGPT and the staggering number of users hooked on it and developing mental issues \u2014 well, things don\u2019t look good.<\/p>\n

Add in the fact that the contentious debate around government regulation of AI<\/a> hasn\u2019t settled, and likely won\u2019t be settled for a while \u2014 and you\u2019ve got a growing complication that has untold downstream impact on society; we\u2019re walking into this essentially naked as a species.<\/p>\n

\u201cAppalling,\u201d one user wrote on X<\/a> about OpenAI. \u201cOpenAI doesn\u2019t seem to test their products before releasing. They use real users for product testing, causing all sorts of social & mental issues, and conveniently call it \u2018experiments.\u2019 I\u2019m wondering if involuntary human experiments are even legal\u2026\u201d<\/p>\n

More on OpenAI: OpenAI Is Suddenly in Trouble<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"If you\u2019re a teenager with access to OpenAI\u2019s Sora 2, you can easily generate AI videos of school…\n","protected":false},"author":2,"featured_media":166804,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,61,60,80],"class_list":{"0":"post-166803","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-ie","12":"tag-ireland","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/166803","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=166803"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/166803\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/166804"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=166803"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=166803"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=166803"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}