“Grok styling itself as a genocidal dictator is the kind of flaw that should make the entire A.I. industry take pause.” What Elon Musk’s rogue chatbot tells us about the dangers of artificial intelligence. Plus:
How Bad Is It?
Kyle Chayka
Staff writer covering technology and internet culture.
A couple of weekends ago, Grok, the A.I. chatbot that runs across Elon Musk’s X social network, began calling itself “MechaHitler.” In its interactions with X users, it cited Adolf Hitler approvingly and hinted at violence, spewing the kind of toxicity that internet moderators wouldn’t tolerate from a human. Basically, it turned evil, until it was shut down for reprogramming. On Saturday, the normally gleeful and unheeding company confessed to the mistake and said it was sorry: “We deeply apologize for the horrific behavior that many experienced.”
Photograph by Samuel Corum / Getty
Just how worrisome is it that a chatbot went off the rails and spread such garbage on a massive platform used by hundreds of millions of people? The short answer is that it’s really bad. Grok styling itself as a genocidal dictator is the kind of flaw that should make the entire A.I. industry take pause. Its automated hate speech blatantly breaks the illusion of neutrality and safety that artificial-intelligence companies, including OpenAI, have carefully cultivated. In Grok’s case, the glitch appears to have been intentional. Before the outburst, the internal A.I. prompt that drives Grok’s personality was edited, commanding it to “not shy away from making claims which are politically incorrect.” The bot clearly ran with the suggestion.
Presumably, these changes were part of Elon Musk’s personal campaign to build a less woke chatbot. But the incident shows that, far from presenting some evenhanded view of reality, A.I. output simply reflects the concerns and priorities of its designers. (Researchers found that Grok was actually checking Musk’s personal opinions, espoused on X, to shape its responses.) Grok is a product of xAI, Musk’s umbrella A.I. company, which was just announced as a participant in a two-hundred-million-dollar development grant from the Department of Defense. In short, we are allowing buggy, biased A.I. models to influence government policy, not to mention sit alongside the human-to-human conversations of social-media users in our feeds. A.I. goes beyond that, of course; flawed chatbots are already influencing our news consumption, our interpersonal communication, and our educational practices. Generative A.I. is a bit like a drug released into the water supply without proper testing. Regulation can’t come soon enough.
Chayka writes Infinite Scroll, which publishes on Wednesdays. This week’s column is about Opal, the app he’s been using to successfully manage his screentime.
Editor’s Pick
From assassination plots to torture programs, the agency’s darkest operations have always been at the President’s behest.Illustration by Ben Hickey
What Could Become of the C.I.A.
What if Donald Trump tries to make the spy agency great again? A new book, from a longtime national-security correspondent, explores the C.I.A.’s agenda since 9/11 and argues that its latest adversary lives in the White House. “If a genuine emergency were to take place, and Trump tried to use the occasion to cancel elections or declare martial law, who would be able to stop him?” Keith Gessen asks in a review. Read the story »
More Top Stories
Our Culture PicksRead: Eighty years ago today, the first atomic bomb was tested near Alamogordo, New Mexico. Lydia Millet’s gripping novel “Oh Pure and Radiant Heart” imagines how those scientists might feel if they could see the fallout of their invention, decades later.Watch: Mike White, the “exacting and perceptive” creator of “The White Lotus,” raked in Emmy nominations for the show this week. But if island paradises aren’t your thing, Inkoo Kang recommends another work of White’s to watch.Listen: The podcast “Bad Therapist,” from two hosts who are self-professed “big fans of therapy and big critics of those who abuse its insights,” can help navigate a field sometimes overrun with TikTok influencer-gurus.Daily Cartoon
“Only a hundred and fifty-eight days till we desperately miss this heat wave.”
Cartoon by Kit Fraser
Puzzles & Games
P.S. “There is something both thrilling and reassuring in following the story of a star who rises, falls, and then rises anew,” Naomi Fry writes of Justin Bieber’s very public life. Perhaps, with “SWAG” and newfound swagger, the singer is back on the upswing.
Hannah Jocelyn contributed to this edition.