{"id":70468,"date":"2025-08-09T17:09:07","date_gmt":"2025-08-09T17:09:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/70468\/"},"modified":"2025-08-09T17:09:07","modified_gmt":"2025-08-09T17:09:07","slug":"students-have-been-called-to-the-office-and-even-arrested-for-ai-surveillance-false-alarms","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/70468\/","title":{"rendered":"Students have been called to the office \u2014 and even arrested \u2014 for AI surveillance false alarms"},"content":{"rendered":"<p>Surveillance systems in American schools increasingly monitor everything students write on school accounts and devices.<\/p>\n<p>Lesley Mathis knows what her daughter said was wrong. But she never expected the 13-year-old girl would get arrested for it.<\/p>\n<p>The teenage girl made an offensive joke while chatting online with her classmates, triggering the <a href=\"https:\/\/apnews.com\/article\/ai-school-chromebook-gaggle-goguardian-securly-25a3946727397951fd42324139aaf70f\" id=\"link-1\" rel=\"nofollow noopener\" target=\"_blank\">school\u2019s surveillance software<\/a>.<\/p>\n<p>Before the morning was even over, the Tennessee eighth grader was under arrest. She was interrogated, strip-searched and spent the night in a jail cell, her mother says.<\/p>\n<p>Earlier in the day, her friends had teased the teen about her tanned complexion and called her \u201cMexican,\u201d even though she\u2019s not. When a friend asked what she was planning for Thursday, she wrote: \u201con Thursday we kill all the Mexico\u2019s.\u201d<\/p>\n<p>Mathis said the comments were \u201cwrong\u201d and \u201cstupid,\u201d but context showed they were not a threat.<\/p>\n<p>\u201cIt made me feel like, is this the America we live in?\u201d Mathis said of her daughter&#8217;s arrest. \u201cAnd it was this stupid, stupid technology that is just going through picking up random words and not looking at context.\u201d<\/p>\n<p>Surveillance systems in American schools increasingly monitor everything students write on school accounts and devices. <a href=\"https:\/\/apnews.com\/article\/ai-school-chromebook-surveillance-gaggle-investigation-takeaways-381fa82978f27eb85f20d03236820711\" id=\"link-2\" rel=\"nofollow noopener\" target=\"_blank\">Thousands of school districts<\/a> across the country use software like Gaggle and Lightspeed Alert to track kids\u2019 online activities, looking for signs they might hurt themselves or others. With the help of <a href=\"https:\/\/apnews.com\/article\/ai-school-shooting-threat-prevention-bark-c7e89f29b13d0a8470ee44b91d7651ed\" id=\"link-3\" rel=\"nofollow noopener\" target=\"_blank\">artificial intelligence<\/a>, technology can dip into online conversations and immediately notify both school officials and law enforcement.<\/p>\n<p>Educators say the technology has saved lives. But critics warn it can criminalize children for careless words.<\/p>\n<p>&#8220;It has routinized law enforcement access and presence in students\u2019 lives, including in their home,\u201d said Elizabeth Laird, a director at the Center for Democracy and Technology.<\/p>\n<p>In a country weary of school shootings, several states have taken a harder line on threats to schools. Among them is Tennessee, which passed a 2023 zero-tolerance law requiring any threat of mass violence against a school to be reported immediately to law enforcement.<\/p>\n<p>The 13-year-old girl arrested in August 2023 had been texting with friends on a chat function tied to her school email at Fairview Middle School, which uses Gaggle to monitor students&#8217; accounts. (The Associated Press is withholding the girl\u2019s name to protect her privacy. The school district did not respond to a request for comment.)<\/p>\n<p>Taken to jail, the teen was interrogated and strip-searched, and her parents weren&#8217;t allowed to talk to her until the next day, according to a <a href=\"https:\/\/storage.courtlistener.com\/recap\/gov.uscourts.tnmd.99558\/gov.uscourts.tnmd.99558.14.0.pdf\" id=\"link-4\" rel=\"nofollow noopener\" target=\"_blank\">lawsuit<\/a> they filed against the school system. She didn\u2019t know why her parents weren\u2019t there.<\/p>\n<p>\u201cShe told me afterwards, \u2018I thought you hated me.\u2019 That kind of haunts you,\u201d said Mathis, the girl&#8217;s mother.<\/p>\n<p>A court ordered eight weeks of house arrest, a psychological evaluation and 20 days at an alternative school for the girl.<\/p>\n<p>Gaggle&#8217;s CEO, Jeff Patterson, said in an interview that the school system did not use Gaggle the way it is intended. The purpose is to find early warning signs and intervene before problems escalate to law enforcement, he said.<\/p>\n<p>\u201cI wish that was treated as a teachable moment, not a law enforcement moment,\u201d said Patterson.<\/p>\n<p>Students who think they are chatting privately among friends often do not realize they are under constant surveillance, said Shahar Pasch, an education lawyer in Florida.<\/p>\n<p>One teenage girl she represented made a joke about school shootings on a private Snapchat story. Snapchat\u2019s automated detection software picked up the comment, the company alerted the FBI, and the girl was arrested on school grounds within hours.<\/p>\n<p>Alexa Manganiotis, 16, said she was startled by how quickly monitoring software works. West Palm Beach&#8217;s Dreyfoos School of the Arts, which she attends, last year piloted <a href=\"https:\/\/www.themuseatdreyfoos.com\/news\/2024\/12\/05\/district-pilots-ai-student-surveillance-program\/\" id=\"link-5\" rel=\"nofollow noopener\" target=\"_blank\">Lightspeed Alert<\/a>, a surveillance program. Interviewing a teacher for her school newspaper, Alexa discovered two students once typed something threatening about that teacher on a school computer, then deleted it. Lightspeed picked it up, and \u201cthey were taken away like five minutes later,\u201d Alexa said.<\/p>\n<p>Teenagers face steeper consequences than adults for what they write online, Alexa said.<\/p>\n<p>\u201cIf an adult makes a super racist joke that\u2019s threatening on their computer, they can delete it, and they wouldn\u2019t be arrested,&#8221; she said.<\/p>\n<p>Amy Bennett, chief of staff for Lightspeed Systems, said that the software helps understaffed schools \u201cbe proactive rather than punitive\u201d by identifying early warning signs of bullying, self-harm, violence or abuse.<\/p>\n<p>The technology can also involve law enforcement in responses to mental health crises. In Florida&#8217;s Polk County Schools, a district of more than 100,000 students, the school safety program received nearly 500 Gaggle alerts over four years, officers said in public Board of Education meetings. This led to 72 involuntary hospitalization cases under the Baker Act, a state law that allows authorities to require mental health evaluations for people against their will if they pose a risk to themselves or others.<\/p>\n","protected":false},"excerpt":{"rendered":"Surveillance systems in American schools increasingly monitor everything students write on school accounts and devices. Lesley Mathis knows&hellip;\n","protected":false},"author":2,"featured_media":70469,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,74],"class_list":["post-70468","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/70468","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=70468"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/70468\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/70469"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=70468"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=70468"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=70468"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}