![\"\"\/](\"https:\/\/www.newsbeep.com\/ca\/wp-content\/uploads\/2025\/07\/1753405088_218_indicator-big.gif\")
<\/p>\nThe legislation would have required those companies to take down two types of content within 24 hours \u2014 content that sexually victimizes a child or revictimizes a survivor, or intimate content that\u2019s shared without consent, including deepfakes.<\/p>\n
\t<\/p>\n
Helen Hayes, a senior fellow at the Centre for Media, Technology, and Democracy at McGill University, conducts research on youth, social media and online harms. She said a big source of concern is some users\u2019 \u201cdevelopmental reliance on chatbots or (generative) AI systems for relationship building, which we\u2019ve seen has caused really unfortunate outcomes\u201d \u2014 including suicides.<\/p>\n
She also flagged the increasing use of generative AI systems for therapy and warned that relying on them may be \u201cpropelling people\u2019s mental health issues instead of supporting them.\u201d<\/p>\n
In late August in California, the parents of a teenage boy launched a wrongful-death lawsuit against OpenAI, the maker of ChatGPT. The parents of 16-year-old Adam Raine allege ChatGPT encouraged their son in his plans to die by suicide.<\/p>\n
The case followed another wrongful death lawsuit launched last year in Florida against Character.AI by a woman whose 14-year-old son died by suicide.<\/p>\n
Reuters reported last month on the death of a man, cognitively impaired after a stroke, who became infatuated with a Meta chatbot. After the chatbot invited him to visit it in New York and gave him a fake address, the man attempted to do so \u2014 only to fall on the way and later die in hospital.<\/p>\n
Experts are also warning about the threat of AI chatbots fuelling delusions \u2014 so-called \u201cAI psychosis.\u201d In one case reported by The New York Times last month, a Canadian man who had no history of mental illness became convinced he had invented a revolutionary new mathematical framework after engaging with ChatGPT.<\/p>\n
A spokesperson for OpenAI said the company is \u201cdeeply saddened by Mr. Raine\u2019s passing, and our thoughts are with his family.\u201d<\/p>\n
The spokesperson said ChatGPT includes safeguards and directs users to crisis helplines.<\/p>\n
\u201cWhile these safeguards work best in common, short exchanges, we\u2019ve learned over time that they can sometimes become less reliable in long interactions where parts of the model\u2019s safety training may degrade,\u201d the spokesperson said. \u201cSafeguards are strongest when every element works as intended, and we will continually improve on them, guided by experts.\u201d<\/p>\n
The company announced Tuesday that it plans to soon launch a feature which will give parents the ability to receive notifications if a teen is \u201cin a moment of acute distress.\u201d<\/p>\n
A spokesperson for Meta declined additional comment beyond what was already included in the Reuters story. The company did not answer Reuters\u2019 questions when asked why its chatbots can say they are real people and start romantic conversations.<\/p>\n
Character.AI declined to comment on pending litigation, though a spokesperson said the company posts \u201cprominent disclaimers in every chat to remind users that a character is not a real person and that everything a character says should be treated as fiction.\u201d<\/p>\n
Experts are calling for extensive safeguards to make it clear that chatbots are not real. Laidlaw said that can\u2019t just be a notice at the beginning when a user signs up.<\/p>\n
\u201cIt has to be something that is prompted by the nature of the conversation. There basically needs to be constant attention to how to ensure that this is, it\u2019s not going to be perfectly safe, but it\u2019s as safe as possible,\u201d she said.<\/p>\n
Hayes said generative AI systems, particularly those marketed at children, need to be clearly labelled as AI.<\/p>\n
\u201cI would go so far as to say that that labeling should happen every time there is some interaction between a user and the platform, so that there\u2019s a constant reminder that the conversation is AI-generated,\u201d she said.<\/p>\n
The previous version of the online harms bill was aimed at social media platforms. Laidlaw, who was one of the experts consulted by the previous Liberal government on that legislation, said the basic structure of the bill is sound.<\/p>\n
\u201cBut I think what we have to revisit is, precisely who do we want to be regulated by this?\u201d she asked.<\/p>\n
\u201cI think that it doesn\u2019t make sense to just narrowly focus on traditional social media, and that the different types of kind of platforms for discourse and the different type of AI-enabled harms should be captured by this.\u201d<\/p>\n
Hayes said she would agree with using the previous version of the legislation as a foundation, then including generative AI systems under its scope through transparency or labelling provisions.<\/p>\n
Laidlaw said that if AI is going to be included in the legislation, the government needs to make it clear that is the goal.<\/p>\n
Hayes said stand-alone generative AI systems like ChatGPT wouldn\u2019t fall under the previous bill and would need to be added as a separate category.<\/p>\n
Whether the government plans to do so is not clear. Justice Minister Sean Fraser told The Canadian Press earlier this summer that he would be taking a fresh look at the bill, and AI would be one of the factors under consideration.<\/p>\n
A statement from the minister\u2019s office did not directly state whether the minister plans to include any provisions in the legislation to address AI harms, either targeted specifically at chatbots or at AI more broadly.<\/p>\n
A spokesperson for Fraser said the government is \u201cmoving forward with legislation to protect children from online sexual exploitation and extortion, tighten child-luring laws, and increase penalties for the distribution of intimate images without consent.\u201d<\/p>\n
It will also make non-consensual distribution of sexual deepfakes a criminal offence, Jeremy Bellefeuille said.<\/p>\n
\u201cThis is a priority for us, and the work is ongoing as we continue consultations to get it right.\u201d<\/p>\n
While the landscape around online harms has changed since the previous version of the bill was introduced, so too have global attitudes on AI regulation as countries prioritize AI adoption and economic opportunity over governance.<\/p>\n
Evan Solomon, Canada\u2019s AI minister, has said Canada will move away from \u201cover-indexing on warnings and regulation.\u201d<\/p>\n
Under the administration of U.S. President Donald Trump, the U.S. State Department recently took aim at Canada\u2019s Online News Act, which requires Meta and Google to compensate news publishers for the use of their content.<\/p>\n
A group of U.S. Republicans has also urged the Trump administration to push Canada to eliminate the Online Streaming Act, under which large streaming companies like Netflix and Amazon are required to make financial contributions to Canadian content and news.<\/p>\n
Prime Minister Mark Carney killed a digital services tax on big tech companies in order to restart trade talks with Trump.<\/p>\n
Chris Tenove, assistant director at the Centre for the Study of Democratic Institutions at the University of British Columbia, said that while there has been momentum in the United Kingdom and European Union on regulating online harms, \u201cthe Trump administration is a major counterforce.\u201d<\/p>\n
He said in an email that if Canada moves forward with online harms regulation, it\u2019s clear \u201cwe will face a U.S. backlash.\u201d<\/p>\n
But Tenove said that beyond the American reaction, there is no good reason to eliminate or water down the bill.<\/p>\n
\u201cSo, we\u2019re left with the question of whether Canada can make its own laws to protect its own citizens, or has to comply with Trump administration wishes,\u201d he said.<\/p>\n
This report by The Canadian Press was first published Sept. 3, 2025.<\/p>\n
Anja Karadeglija, The Canadian Press<\/p>\n","protected":false},"excerpt":{"rendered":"The legislation would have required those companies to take down two types of content within 24 hours \u2014…\n","protected":false},"author":2,"featured_media":116368,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,61],"class_list":["post-116367","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/116367","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=116367"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/116367\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/116368"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=116367"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=116367"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=116367"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}