{"id":101606,"date":"2025-08-27T20:19:14","date_gmt":"2025-08-27T20:19:14","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/101606\/"},"modified":"2025-08-27T20:19:14","modified_gmt":"2025-08-27T20:19:14","slug":"ai-chatbots-putting-sensitive-data-at-risk-says-u-of-g-professor","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/101606\/","title":{"rendered":"AI chatbots putting sensitive data at risk, says U of G professor"},"content":{"rendered":"<p>U of G professor Ali Dehghantanha is warning companies of the risks when it comes to using AI<\/p>\n<p>Artificial intelligence chatbots are putting businesses at risk, according to a University of Guelph professor.\u00a0<\/p>\n<p>It took cybersecurity professor and Canada Research Chair Ali Dehghantanha only 47 minutes of speaking with an internal chatbot to steal a Fortune 500 company\u2019s sensitive client data and project information during a proactive security audit.\u00a0<\/p>\n<p>The method used is a non-destructive process for testing cyber security called red teaming, where they attempt to simulate what an attacker would do if they got access to an organization.<\/p>\n<p>\u201cWe were testing the security of the internal chatbots that were used by the employees,\u201d he told GuelphToday.\u00a0<\/p>\n<p>In less than an hour, they bypassed the guardrails that had been developed for the chatbot, which means they were able to make the chatbot give the answer to any question it had access to, including information from all internal projects and some executive-level communications.\u00a0<img decoding=\"async\" alt=\"headshot-3\" class=\"figure-l\" id=\"file-4143629\" src=\"https:\/\/www.newsbeep.com\/ca\/wp-content\/uploads\/2025\/08\/headshot-3.jpeg;w=960.jpeg\"\/><\/p>\n<p>It\u2019s an approach attackers are regularly using to craft convincing phishing emails.<\/p>\n<p>\u201cFor example, if you know about one internal project and you include that in your phishing email, the chances that the victims (fall for) that would be significantly higher,\u201d he said.\u00a0<\/p>\n<p>Before the use of AI was widespread, he said cybersecurity wasn\u2019t as much of a concern for entire companies, since only executive-level information would need to be secure.\u00a0<\/p>\n<p>But now, AI tools are available to interns, new and low-level employees.\u00a0<\/p>\n<p>A chatbot like this is especially helpful for an intern, for example, who might have a number of questions as they\u2019re onboarded, and the chatbot can answer them.\u00a0<\/p>\n<p>\u201cThat has improved the new employees&#8217; performance significantly,\u201d he said. \u201cSo it\u2019s understandable why they\u2019re making them available.\u201d\u00a0<\/p>\n<p>\u201cBut securing them is a challenge, and in this case, we could get access to a lot of company information.\u201d\u00a0<\/p>\n<p>AI is like fast food, he said: companies are utilizing these tools because they\u2019re cheap and accessible.\u00a0<\/p>\n<p>But most companies are \u201cforgetting about the total cost of AI ownership,\u201d he said.\u00a0<\/p>\n<p>\u201cThey just deploy the AI with the assumption that it is important to improve their performance and productivity, without thinking about how to make AI secure, how to test for security.\u201d<\/p>\n<p>His main advice for any company adopting AI is to consider the total cost when deploying something like a chatbot.\u00a0<\/p>\n<p>\u201cThe days that an intern machine was less valuable for an attacker than a CEO machine are long past, if the same AI is running on both machines,\u201d he said. \u201cSo you need to make sure that you\u2019re offering uniform security protection on almost all the assets that you have in the organization.\u201d\u00a0<br \/>&#13;<br \/>\n\u00a0<br \/>&#13;<br \/>\nBut it\u2019s not something that\u2019s on the radar for most people, especially small and medium businesses, he said.\u00a0<\/p>\n<p>\u201cThey are underestimating the risk that the AI adoption is exposing their companies,\u201d he said, adding that if they\u2019re working to get the AI implemented quickly with no security checks, they may find themselves in the middle of a high profile attack that was caused through those AI systems.\u00a0<\/p>\n<p>Dehghantanha said he\u2019s noticed with smaller businesses, sometimes the same AI that offers public facing questions and answers is serving the internal employees as well, which means if the attacker is able to bypass the guards on the public facing AI, they can get access to everything.\u00a0<\/p>\n<p>\u201cThat\u2019s very common with smaller companies, which is unfortunate because it\u2019s actually opening up a big attack vector,\u201d he said.\u00a0<\/p>\n<p>The risk to the average person interacting with AI chatbots depends on the type of system being used, since in some cases you can interact anonymously, or ask non-personal questions.\u00a0<\/p>\n<p>But the risk increases if you need to log in to talk to AI, or are asking more sensitive questions.\u00a0<\/p>\n<p>\u201cIn this case it would be the responsibility of the providers to make sure that data AI systems are not storing the queries of people, anything private or sensitive about them, and that they are secure, because whether we want it or not, AI would have some memory. They need to know what they have told you before so they can continue answering you.\u201d<\/p>\n<p>One of the ways organizations can ensure their AI systems are secure is by complying with AI security standards and conducting regular tests, like the one Dehghantanha did for the Fortune 500 company.\u00a0<\/p>\n<p>Moving forward, he said regulation and policy changes pushing for security requirements would be helpful.\u00a0<\/p>\n<p>\u201cBut my advice to all businesses out there, public or private, is you should not wait for the policies to make you take the right action.<\/p>\n<p>\u201cThese days, AI plays a critical role. I am not suggesting to stop deploying AI systems. They are really useful for improving performance and productivity,\u201d he said. \u201cBut what is important is to make sure that security is a major evaluation and consideration when we are deploying these systems.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"U of G professor Ali Dehghantanha is warning companies of the risks when it comes to using AI&hellip;\n","protected":false},"author":2,"featured_media":101607,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,61],"class_list":["post-101606","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/101606","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=101606"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/101606\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/101607"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=101606"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=101606"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=101606"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}