{"id":7348,"date":"2025-09-07T04:43:07","date_gmt":"2025-09-07T04:43:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/7348\/"},"modified":"2025-09-07T04:43:07","modified_gmt":"2025-09-07T04:43:07","slug":"should-you-trust-an-ai-agent-to-buy-your-shopping-or-manage-your-email","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/7348\/","title":{"rendered":"Should you trust an AI agent to buy your shopping or manage your email?"},"content":{"rendered":"<p class=\"MFxmLElkspXO\" style=\"display:none\">In the domestic environment, use cases include everything from an AI agent \u201clooking\u201d at a photo of a dish, working out all the ingredients, ordering them for you and finding a recipe, to cleaning up and managing your email inbox, and sending basic replies on your behalf.<\/p>\n<p>Not just about you<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Deloitte NZ AI director Dr Amanda Williamson says it\u2019s important to remember that when you give an AI agent full access to your email, it\u2019s not just you deciding to trust a big tech firm with your sensitive information. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">You\u2019re also making a decision on behalf of all of your friends, family and colleagues or anyone who might send you a message. The same goes for giving an agent access to your calendar and letting it make appointments for you.<\/p>\n<p><img  alt=\"When you give an AI agent full access to your inbox, you're also making a decision on behalf of friends, family and colleagues, says Deloitte artificial intelligence director Dr Amanda Williamson.\" class=\"article-media__image responsively-lazy\" data-test-ui=\"article-media__image\"\/>When you give an AI agent full access to your inbox, you&#8217;re also making a decision on behalf of friends, family and colleagues, says Deloitte artificial intelligence director Dr Amanda Williamson.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">And Williamson, who has been using a number of agents, says they can\u2019t be left to do their own thing. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cIt can be a bit frustrating to use, because it asks for human input quite regularly &#8230; If you ask it to research something, it might say after 10 minutes, \u2018Oh, would you like that to be in a PowerPoint presentation?\u2019 and if a human isn\u2019t sitting there to click \u2018yes\u2019 it\u2019s going to be a frustrating experience.\u201d<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Agents have recently been pushed towards the mainstream with a number of home users experimenting with the recently released ChatGPT Agent (now available to New Zealanders who are on a US$20 ($34) or US$200 per month premium plan).<\/p>\n<p>Protection from rogue spending<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Earlier adopters who were happy to give a ChatGPT agent full access to their bank accounts \u2013 all the better for a snappy social clip \u2013 often found it went for top-rated items from top-rated sellers. One user did get coffee delivered in half an hour, even if it was the most expensive cup of his life (see clip below).<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Williamson found a grey area when she asked Perplexity\u2019s AI agent to order her ingredients for making a pavlova. She assumed it would ask her to okay the final order, but instead the agent tried to go ahead and buy the items from New World\u2019s online store, where Williamson\u2019s credit card details were saved and the agent did not have to enter a security code. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">In the event, the agent was thwarted because her card on file was out of date (see video below).<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Whatever you think of Visa and Mastercard\u2019s fees, they\u2019ve helped fund a near black-and-white protection against unauthorised spending on your card. If you didn\u2019t authorise the spending, you can get your money back in most circumstances.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">AI agents have introduced an element of fuzziness.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cToday, Visa\u2019s existing rules for disputes and liability apply to purchases made by AI agents,\u201d a Visa spokesman said.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cIf an agent places an order, it must show that the cardholder authorised and authenticated the transaction and received the goods or services.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cIf a cardholder has stored their payment details and enrolled in an AI service, this may be considered consent for future purchases.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cHowever, Visa\u2019s zero liability policy still protects users against genuinely unauthorised transactions.\u201d<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Mastercard was unable to comment by deadline.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Williamson says liability problems are sweeping and extend beyond credit card purchases. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">She asks what happens if an agent books the wrong flight, makes an error screening job applicants or enters incorrect medical data on a form? <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cThese are all very fresh questions,\u201d she says. And at this point, many institutions have not even grasped the power of agents, let alone formed policies around them, she adds.<\/p>\n<p>\u2018Riskier than standard ChatGPT\u2019<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cAn AI personal assistant might sound great at first glance but the risks of using something like ChatGPT Agent are much higher than when using standard ChatGPT,\u201d Simply Privacy director Frith Tweedie says.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cThe more you want it to do for you, the more access you have to give it,\u201d the former digital and tech lawyer says.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">That comes against the backdrop of OpenAI\u2019s own testing finding that 91% of the time its agent will ask for confirmation before taking an action, when confirmation is required, which implies that <a href=\"https:\/\/openai.com\/index\/chatgpt-agent-system-card\/\" target=\"_self\" rel=\"nofollow noopener\" title=\"https:\/\/openai.com\/index\/chatgpt-agent-system-card\/\">9% of the time it might take action without asking<\/a>. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cSo you really need to consider how comfortable you are handing over access to your credit card details, website logins, calendar or contacts to a black box.\u201d<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">OpenAI has published the ChatGPT System Card, which is its technical brief on how the system works, Tweedie says.<\/p>\n<p>OpenAI acknowledges privacy risk<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cWhile they\u2019ve clearly thought carefully about the various risks and how to reduce them, they explicitly note that \u2018ChatGPT agent may have access to sensitive and private data about the user (eg via their Google drive or email)\u2019 and acknowledge \u2018the risk that ChatGPT agent could mistakenly reveal this private data in ways the user doesn\u2019t intend\u2019.\u201d<\/p>\n<p><img  alt=\"OpenAI acknowledges in its terms there is a risk a ChatGPT agent could mistakenly reveal private data &quot;in ways the user doesn\u2019t intend\u201d, says Simply Privacy director Frith Tweedie.\" class=\"article-media__image responsively-lazy\" data-test-ui=\"article-media__image\"\/>OpenAI acknowledges in its terms there is a risk a ChatGPT agent could mistakenly reveal private data &#8220;in ways the user doesn\u2019t intend\u201d, says Simply Privacy director Frith Tweedie.<\/p>\n<p>\u2018Onus on us\u2019<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Even Sam Altman, not generally known for underselling OpenAI\u2019s services, has said \u201cbad actors may try to \u2018trick\u2019 users\u2019 AI agents into giving private information they shouldn\u2019t, in ways we can\u2019t predict\u201d, Tweedie says.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cHe recommended that people give agents \u2018the minimum access required to complete a task\u2019. But once again, this put the onus on us to manage these risks, rather than big tech fully addressing them.\u201d<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">There\u2019s also the paradox that Altman is recommending minimum access, but for maximum usefulness an agent needs access to all your logins and data.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Lastly, Tweedie says: \u201cThe well-established accuracy challenges of generative AI aren\u2019t going anywhere with agentic AI \u2013 they\u2019re multiplying. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cThese kinds of agents typically involve a chain of individual LLMs [large language models] and the potential multiplication of errors. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cPlus, later models often accept earlier answers as gospel, so a single early hallucination can echo right through to the final action. <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cThat could look like buying the wrong thing, submitting your credit card details to a scam website or worse.\u201d <\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">While you can get agents to peer review each other\u2019s accuracy, co-ordinating multiple agents requires another layer of logic (often itself an LLM) that might introduce fresh errors or rubber\u2011stamp the wrong consensus, Tweedie says.<\/p>\n<p>Privacy protections weak compared to elsewhere<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">The rise of agentic AI underscores a range of issues that are increasingly presenting challenges to the Privacy Act and the extent of protection it provides, she says.<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">\u201cWhile it provides a flexible, tech-agnostic and principles\u2011based framework, unlike Australia, the UK and Europe, we have no rights to an explanation of automated decisions. And our tiny fines [$10,000 compared with up to A$50 million ($55m) in Australia] are absolutely no deterrent for global AI vendors or local corporates betting big on productivity gains.\u201d<\/p>\n<p class=\"MFxmLElkspXO\" style=\"display:none\">Chris Keall is an Auckland-based member of the Herald\u2019s business team. He joined the Herald in 2018 and is the technology editor and a senior business writer.<\/p>\n","protected":false},"excerpt":{"rendered":"In the domestic environment, use cases include everything from an AI agent \u201clooking\u201d at a photo of a&hellip;\n","protected":false},"author":2,"featured_media":7349,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[6116,9555,365,8831,9556,363,364,3167,1459,5658,9557,9554,111,139,1536,69,691,1243,3271,145,4468,61,9438,1533,197,1959],"class_list":["post-7348","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-agent","tag-agentic","tag-ai","tag-an","tag-artificial","tag-artificial-intelligence","tag-artificialintelligence","tag-buy","tag-email","tag-experts","tag-intelligence","tag-manage","tag-new-zealand","tag-newzealand","tag-next","tag-nz","tag-or","tag-shopping","tag-should","tag-technology","tag-thing","tag-to","tag-trust","tag-will","tag-you","tag-your"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/7348","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=7348"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/7348\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/7349"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=7348"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=7348"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=7348"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}