{"id":207232,"date":"2025-12-29T20:26:17","date_gmt":"2025-12-29T20:26:17","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/207232\/"},"modified":"2025-12-29T20:26:17","modified_gmt":"2025-12-29T20:26:17","slug":"what-happened-when-we-tested-a-safe-ai-mental-health-chatbot","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/207232\/","title":{"rendered":"What happened when we tested a &#8216;safe&#8217; AI mental health chatbot"},"content":{"rendered":"<p class=\"paragraph_paragraph__iYReA\">If you can&#8217;t easily access or afford a mental health specialist, you might turn to artificial intelligence as a sort of &#8220;therapist&#8221; to get you by.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">AI chatbots are always available and very empathetic; but evidence shows they can give generic, incorrect and even harmful answers.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Shocking allegations that chatbots <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.abc.net.au\/news\/2025-08-12\/how-young-australians-being-impacted-by-ai\/105630108\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">encouraged a 13-year-old to take his own life<\/a>, and urged a <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/www.abc.net.au\/news\/2025-09-21\/ai-chatbot-encourages-australian-man-to-murder-his-father\/105793930\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">Victorian man to murder his own father, going as far as providing instructions<\/a> have raised alarm bells.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">OpenAI, who owns the popular ChatGPT model, is currently facing multiple wrongful death lawsuits in the US from families who say the chatbot contributed to harmful thoughts.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">But researchers at the University of Sydney&#8217;s Brain and Mind Centre have set out to do things differently.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">The cohort say they have been working on a smarter, safer chatbot that thinks and acts like a mental health professional.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It&#8217;s called MIA, which stands for Mental Health Intelligence Agent, and the ABC was invited for a sneak peek to see how it works.<\/p>\n<p>What MIA does well<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Researcher Frank Iorfino came up with the idea for MIA after a friend asked where they should go for help with mental health concerns.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">&#8220;I was kind of annoyed the only real answer I had was &#8216;go to your GP&#8217;. Obviously, that&#8217;s the starting point for a lot of people and there&#8217;s nothing wrong with that, but as someone working in mental health I thought, &#8216;I need a better answer to that question;,'&#8221; Dr Iorfino said.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">He said some GPs don&#8217;t have extensive mental health expertise, and even when they refer a patient to a specialist, there can be long waits.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">So MIA was developed to give people immediate access to some of the best psychiatrists and psychologists who work at the Brain and Mind Centre.<\/p>\n<p><img decoding=\"async\" alt=\"Frank Iorfino looks pensive as he holds a mobile in his hand\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/567a98d30ccfd8b5d56b6274208ce8ae.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">Frank Iorfino said MIA could be a lifeline for people who can&#8217;t easily access in-person support. (Supplied: The University of Sydney)<\/p>\n<p class=\"paragraph_paragraph__iYReA\">MIA doesn&#8217;t scrape the internet to answer questions, it only uses its internal knowledge bank made up of high-quality research.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">This means it doesn&#8217;t &#8220;&#8216;hallucinate&#8221; \u2014 the AI term for exaggerating or making up information.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">MIA will assess a patient&#8217;s symptoms, identify their needs and match them with the right support by relying on a database of decisions made by real clinicians.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It&#8217;s designed to be particularly useful for anyone with mood disorders, like anxiety or depression, and has been trialled on dozens of young people in a user testing study.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">To put it to the test, I asked MIA several fictional questions based on common emotions and experiences, including:<\/p>\n<p class=\"paragraph_paragraph__iYReA\">&#8220;I have been feeling anxious for a few months now. Things at work are just so intense that I am feeling overwhelmed and not able to deal with the stress. Can you help?&#8221;<\/p>\n<p class=\"paragraph_paragraph__iYReA\">The first thing MIA asked was whether I had thoughts about self-harming, so it could determine whether I needed immediate crisis support.<\/p>\n<p><img decoding=\"async\" alt=\"A screenshot of a response from MIA asking whether the person has had any thoughts of self-harm\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/c3d3397ac4486cd411d0a950b9acf473.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">MIA is trained to recognise any potential risks, like a psychologist would. (Supplied)<\/p>\n<p class=\"paragraph_paragraph__iYReA\">I tell MIA I&#8217;m safe and over the course of about 15 minutes it asks a series of questions to find out if:<\/p>\n<p>I have any friends or family I can talk about my feelings withWhether I&#8217;d consider expanding my support systemIf there are specific situations or stressors that trigger anxious thoughtsHow my physical health isWhether I&#8217;ve explored any treatments for anxiety in the past<\/p>\n<p class=\"paragraph_paragraph__iYReA\">MIA also explains why it is asking each question.<\/p>\n<p><img decoding=\"async\" alt=\"A screenshot from the MIA chatbot. It asks whether I've tried talking to a counsellor or doctor before.\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/e6814ad85bb0b062330a3e70902d7fef.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">MIA explaining why it is asking about treatment history. (Supplied)<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Transparency is key with MIA and it shows what conclusions and assumptions it makes.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Users can even edit conclusions if they feel MIA hasn&#8217;t got it exactly right.<\/p>\n<p><img decoding=\"async\" alt=\"Screenshot from MIA chatbot - it says it has assumed social withdrawal is a contributing factor \" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/f106520e4b50112858a76ad629a37f63.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">MIA shows its inner workings to build trust. (Supplied)<\/p>\n<p>What did MIA recommend?<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Once MIA feels confident it knows enough about a patient, it triages them and suggests actions.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It uses the same triage framework a clinician does and ranks patients between a level one \u2014 mild illness that can benefit from self-management \u2014 and a level five \u2014 severe and persistent illness that require intensive treatment.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">In this case, it put me at level three and recommended several self-care techniques such as exercise as well as professional support to explore cognitive behavioural therapy.<\/p>\n<p><img decoding=\"async\" alt=\"A screenshot showing the chatbot putting my level of care at a 3 out of 5\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/274cfc26e33dc38458b3fd54073de4ab.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">MIA uses the Initial Assessment and Referral (IAR) tool to recommend the most appropriate support. (Supplied)<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It did not recommend anything like mindfulness or meditation because during our session I mentioned I wasn&#8217;t a fan .<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Lastly, it suggested relevant support services in my area and told me how to monitor my symptoms.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Users can return to MIA over time to discuss their symptoms or raise new issues as it will remember everything from previous sessions, but importantly, patient data isn&#8217;t used to train the model.<\/p>\n<p>How it differs to ChatGPT<\/p>\n<p class=\"paragraph_paragraph__iYReA\">When I gave ChatGPT the same prompt about feeling anxious it didn&#8217;t probe for information nearly as much as MIA.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It jumped straight into problem-solving and advice, even though it knew very little about me.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It said &#8220;you&#8217;re not alone&#8221; without knowing anything about my support network and told me &#8220;I&#8217;m here with you&#8221; as though it were a real person.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">While MIA is warm and empathetic, it does not try to befriend users and keeps a much more professional tone.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">ChatGPT did invite me to share more information, but not until the end of a lengthy answer.<\/p>\n<p><img decoding=\"async\" alt=\"A screenshot showing ChatGPT's response - it said &quot;You're not alone&quot; and &quot;I'm glad you reached out&quot;.\" class=\"Image_image__5tFYM ContentImage_image__DQ_cq\"  src=\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2025\/12\/c55b02c18c48c90f8d621bd50f6d0651.jpeg\" loading=\"lazy\" data-component=\"Image\" data-lazy=\"true\"\/><\/p>\n<p class=\"Typography_base__sj2RP FigureCaption_text__zDxQ5 Typography_sizeMobile12__w_FPC Typography_lineHeightMobile20___U7Vr Typography_regular__WeIG6 Typography_colourInherit__dfnUx\" data-component=\"Typography\">ChatGPT told me I&#8217;m &#8220;not alone&#8221;. (Supplied)<\/p>\n<p>How MIA deals with tougher questions<\/p>\n<p class=\"paragraph_paragraph__iYReA\">There have been instances of ChatGPT giving dangerous responses to people in crisis so I wanted to see how MIA handled prompts that suggested someone was in extreme distress.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">I&#8217;ve chosen not to include the questions here, but I found MIA was very clinical in its responses.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It tried to determine what risk I was to myself or others and recommended I seek urgent professional help.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">It did not make an effort to continue the conversation, like ChatGPT did.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Dr Iorfino said that&#8217;s because MIA has been engineered to know its limits and not make people think they can use it in place of professional help.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">One drawback was MIA&#8217;s lack of follow up after it provided recommendations on where to get professional help, relying on the user to take the initiative to reach out.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">In the future the researchers want MIA to directly refer the user to a support service, like Lifeline, so they can be tracked through the system.<\/p>\n<p>Where it fell down<\/p>\n<p class=\"paragraph_paragraph__iYReA\">When I first tried MIA, it got caught in a loop while trying to complete its initial assessment and kept asking the same question again and again.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">The experts worked on a fix and when I tried again it ran much more smoothly.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Dr Iorfino said MIA had got stuck because it was being too cautious.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">&#8220;That&#8217;s one of the biggest differences between this system and anything else out that&#8217;s available on the internet now \u2026 it has, what I like to think of as &#8216;gates,&#8217; that the responses have to go through.&#8221;<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Getting through these &#8220;gates&#8221; takes time so MIA isn&#8217;t as fast as other chatbots but in the future it should be able to do a full assessment in five to 10 minutes.<\/p>\n<p>What&#8217;s next?<\/p>\n<p class=\"paragraph_paragraph__iYReA\">MIA is expected to be ready for public release next year.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">The researchers want it to be free and hosted somewhere obvious like the federal government&#8217;s HealthDirect website, where many people go to check their symptoms.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">MIA can&#8217;t replace a professional human but experts believe &#8220;therapy&#8221; chatbots are here to stay as Australia&#8217;s mental health workforce cannot keep up with demand.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Clinical psychologist at the Black Dog Institute Jill Newby supports evidence-based chatbots with strong guardrails \u2014 she doesn&#8217;t want to see more &#8220;general&#8221; mental health apps on the market which aren&#8217;t backed by evidence.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">But building something safe takes a lot of money, she said, and lengthy clinical trials are needed to show it actually does improve someone&#8217;s quality of life.<\/p>\n<p>Using AI for mental health?<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Professor Newby recommends:<\/p>\n<p>Choosing a mental health specific chatbot over a more generic chatbot that isn&#8217;t fit for purposeUse the tool in conjunction with seeing a real practitionerBe sceptical about the information you&#8217;re reading \u2014 remember that bots can be effusive and agree with you, even if you&#8217;re saying things that will exacerbate your mental health problemsConnect with family and\/or friends. Tell them you&#8217;re using a chatbot for mental health, there&#8217;s no need to keep it a secret.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">Even though crowd-favourite <a class=\"Link_link__5eL5m ScreenReaderOnly_srLinkHint__OysWz Link_showVisited__C1Fea Link_showFocus__ALyv2\" href=\"https:\/\/openai.com\/index\/strengthening-chatgpt-responses-in-sensitive-conversations\/\" data-component=\"Link\" rel=\"nofollow noopener\" target=\"_blank\">ChatGPT was recently updated<\/a> to include some extra safety nets, Professor Newby said it still told people what they wanted to hear.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">&#8220;You like it because it sounds so convincing and the research sounds powerful but it&#8217;s actually completely wrong \u2026 I only see that because I have the knowledge and literature to go and check.&#8221;<\/p>\n<p class=\"paragraph_paragraph__iYReA\">The Therapeutic Goods Administration regulates some online mental health tools but Professor Newby said many &#8220;skirt&#8221; around the rules.<\/p>\n<p class=\"paragraph_paragraph__iYReA\">&#8220;They do this by saying the program is for &#8216;education&#8217; for example, when it&#8217;s actually being used for mental health advice.&#8221;<\/p>\n<p class=\"paragraph_paragraph__iYReA\">The TGA is currently reviewing the regulations that apply to digital mental health tools.<\/p>\n","protected":false},"excerpt":{"rendered":"If you can&#8217;t easily access or afford a mental health specialist, you might turn to artificial intelligence as&hellip;\n","protected":false},"author":2,"featured_media":207233,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,3404,363,364,126490,9473,4036,3419,554,111,139,69,145],"class_list":{"0":"post-207232","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-anxiety","10":"tag-artificial-intelligence","11":"tag-artificialintelligence","12":"tag-brain-and-mind-centre","13":"tag-chatbot","14":"tag-chatgpt","15":"tag-depression","16":"tag-mental-health","17":"tag-new-zealand","18":"tag-newzealand","19":"tag-nz","20":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/207232","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=207232"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/207232\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/207233"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=207232"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=207232"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=207232"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}