{"id":565862,"date":"2026-03-28T04:58:15","date_gmt":"2026-03-28T04:58:15","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/565862\/"},"modified":"2026-03-28T04:58:15","modified_gmt":"2026-03-28T04:58:15","slug":"why-gmails-ai-generated-email-replies-feel-so-creepy","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/565862\/","title":{"rendered":"Why Gmail\u2019s AI-generated email replies feel so creepy"},"content":{"rendered":"<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">I first noticed it when, a few months ago, I opened an email from Ian, my literary agent. Before I\u2019d had a chance to read anything he\u2019d written, Gmail was recommending a full, fleshed-out, AI-generated reply, ventriloquizing ideas for a book and even my feelings about the job transition I\u2019d recently made. It had mined my inbox to infer why Ian was writing to me and ingested bits of my style, even signing off with the lowercase \u201cm\u201d that I use with people with whom I have an easy familiarity.<\/p>\n<p><a class=\"_1j8uwx1\" href=\"https:\/\/platform.vox.com\/wp-content\/uploads\/sites\/2\/2026\/03\/image-6.png?quality=90&amp;strip=all&amp;crop=2.6,0,95.4,93.528408013651\" data-pswp-height=\"836.1439676420401\" data-pswp-width=\"1724.8319999999999\" target=\"_blank\" rel=\"noreferrer nofollow noopener\"><img alt=\"Screenshot of Gmail\u2019s \u2018Suggested reply\u2019 feature showing a draft email that reads: \u2018Hi Ian, It\u2019s been a whirlwind but I\u2019m really enjoying the transition to full-time writing! Lots of interesting stuff coming up at Vox. And thanks for reading! Pederson is definitely on to something there. I\u2019m excited to keep digging into this for the book. Talk soon, m\u2019.\" data-chromatic=\"ignore\" loading=\"lazy\" decoding=\"async\" data-nimg=\"fill\" class=\"mvmjsc0\" style=\"position:absolute;height:100%;width:100%;left:0;top:0;right:0;bottom:0;color:transparent;background-size:cover;background-position:50% 50%;background-repeat:no-repeat;background-image:url(&quot;data:image\/svg+xml;charset=utf-8,%3Csvg xmlns='http:\/\/www.w3.org\/2000\/svg' %3E%3Cfilter id='b' color-interpolation-filters='sRGB'%3E%3CfeGaussianBlur stdDeviation='20'\/%3E%3CfeColorMatrix values='1 0 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 100 -1' result='s'\/%3E%3CfeFlood x='0' y='0' width='100%25' height='100%25'\/%3E%3CfeComposite operator='out' in='s'\/%3E%3CfeComposite in2='SourceGraphic'\/%3E%3CfeGaussianBlur stdDeviation='20'\/%3E%3C\/filter%3E%3Cimage width='100%25' height='100%25' x='0' y='0' preserveAspectRatio='none' style='filter: url(%23b);' href='data:image\/png;base64,iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mN8+R8AAtcB6oaHtZcAAAAASUVORK5CYII='\/%3E%3C\/svg%3E&quot;)\"   src=\"https:\/\/www.newsbeep.com\/ca\/wp-content\/uploads\/2026\/03\/1774673894_909_image-6.png\"\/><\/a><\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">For <a href=\"https:\/\/blog.google\/products-and-platforms\/products\/gmail\/computer-respond-to-this-email\/\" rel=\"nofollow noopener\" target=\"_blank\">around a decade<\/a>, Google had been suggesting very generic, sometimes monosyllabic \u201csmart replies\u201d \u2014 things like \u201cOkay\u201d or \u201cThanks!\u201d or \u201cAny thoughts?\u201d I\u2019ve used these to send quick acknowledgements to emails I\u2019d have otherwise forgotten about. But <a href=\"https:\/\/workspace.google.com\/blog\/product-announcements\/new-ways-engage-gemini-workspace\" rel=\"nofollow noopener\" target=\"_blank\">in the last couple years<\/a>, Gmail has begun to offer fully formed draft replies that presume to impersonate my own, individual reactions to my interlocutors\u2019 questions, ideas, and emotions.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">This felt like a striking turn. I reflected with some sadness on the idea of sending one of these to someone who matters to me \u2014 how dehumanizing to both me and Ian it would feel to make him read a counterfeit subjectivity pretending to be my own.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">You might say this is no big deal; maybe it gives you time back for deeper work or more meaningful parts of your life (I wouldn\u2019t begrudge that at all \u2014 AI saves me time, too!). We\u2019re all drowning in too much email, much of it pointless or lacking any great meaning. Isn\u2019t that exactly the kind of day-to-day tedium that we should happily invite AI to liberate us from?<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">But I think that this machine-generated personal correspondence, which is only likely to spread further into other forms of communication, has preoccupied me because there\u2019s something deeper going on here. A lot of ink has been spilled in the last few years about AI-generated writing and its social consequences \u2014 how it will<a href=\"https:\/\/www.vox.com\/politics\/478794\/ai-economy-claude-code-jobs-openai-anthropic\" rel=\"nofollow noopener\" target=\"_blank\"> deskill millions of workers<\/a>, <a href=\"https:\/\/www.derekthompson.org\/p\/the-end-of-thinking\" rel=\"nofollow noopener\" target=\"_blank\">outsource our thinking<\/a>, confuse kids growing up in the AI age about the difference between <a href=\"https:\/\/www.newyorker.com\/culture\/infinite-scroll\/your-ai-companion-will-support-you-no-matter-what\" rel=\"nofollow noopener\" target=\"_blank\">real and synthetic friends<\/a>, and so on. We already know that AI language is <a href=\"https:\/\/www.vox.com\/future-perfect\/462468\/chatgpt-consciousness-sentient-ai-persona-what-to-do\" rel=\"nofollow noopener\" target=\"_blank\">unnervingly good<\/a> at sounding like it\u2019s the product of a fellow consciousness. But the particular creepiness of elaborate email autocomplete is that it\u2019s training on and simulating your consciousness. And as it does so, it also gives you a little less reason to actually be conscious.<\/p>\n<p>AI writing and \u201ccognitive surrender\u201d<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">Like many <a href=\"https:\/\/www.vox.com\/future-perfect\/403708\/artificial-intelligence-robots-jobs-employment-remote-workers\" rel=\"nofollow noopener\" target=\"_blank\">knowledge workers<\/a> <a href=\"https:\/\/www.vox.com\/future-perfect\/482460\/ai-jobs-automation-meaning-work\" rel=\"nofollow noopener\" target=\"_blank\">who derive their living and their identities from cognitive capacities<\/a> now being at least partially replicated in silicon, I have a complicated and ambivalent relationship with generative AI. I now depend on it to research almost every story I work on, a purpose for which it\u2019s obviously very useful (despite those who still insist it can never be useful for anything).<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">I am, though, deeply skeptical of using it for writing, because, as many writers smarter than me have already <a href=\"https:\/\/www.derekthompson.org\/p\/the-end-of-thinking\" rel=\"nofollow noopener\" target=\"_blank\">noted<\/a>, writing is inextricable from thinking, and short-circuiting it can diminish our capacity for deep thought. The friction of writing is not dead weight but is part of how you decide what you mean and give coherence to ideas. For that reason, my former Vox colleague, the brilliant Kelsey Piper, who is generally positive about AI\u2019s potential to make us more productive and improve human life, <a href=\"https:\/\/www.youtube.com\/watch?v=5xVeWnbO80w\" rel=\"nofollow noopener\" target=\"_blank\">said<\/a> on a recent podcast episode, \u201cI would never use it to write.\u201d<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">In a recent paper, a <a href=\"https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=6097646\" rel=\"nofollow noopener\" target=\"_blank\">pair<\/a> of University of Pennsylvania scholars described the wholesale outsourcing of cognitively complex tasks to AI as \u201ccognitive surrender.\u201d \u201cAn abdication of critical evaluation,\u201d they write, \u201cwhere the user relinquishes cognitive control and adopts the AI\u2019s judgment as their own.\u201d This is one reason why it felt especially inappropriate to have AI generate thoughts for me in reply to someone with whom I\u2019m brainstorming about writing a book, likely one of the most cognitively demanding things I\u2019ll ever do. Email, for all of its annoyances, is also relational. And letting a machine generate your side of the exchange diminishes the authenticity of your connection to another person.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">Sometimes the AI drafts, of course, are plainly wrong. An AI-suggested email might, for example, say you\u2019ve read a book that you haven\u2019t, perhaps making it more likely that you go along with the false claim. But what unsettles me the most is not the mere hallucination, it is when the AI is right, or right enough. My email\u2019s AI is pulling from its knowledge of everything I\u2019ve written before, so it can often make a reasonable guess of what I\u2019d want to say anyway. The system is not wholly failing to reproduce my mind, but is actually producing a close-to plausible substitute for it.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">It feels like the beginnings of what Silicon Valley has prophesized for decades as a coming <a href=\"https:\/\/blog.samaltman.com\/the-merge\" rel=\"nofollow noopener\" target=\"_blank\">merge<\/a> (sometimes called the \u201csingularity\u201d) between human and machine minds. I used to consider this a totally improbable idea, but I hadn\u2019t been open-minded enough. It might turn out to be dispiritingly easy for an advanced AI to train on a sample of your past thoughts and write future ones for you.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">Still, it seems unlikely that we will simply acclimate to the idea that all the written communication we encounter and generate every day may be AI-generated. So much, if not most, of our interpersonal communication now takes place in writing. However vulnerable we may be to cognitive surrender, humans also have a deep countervailing need to experience language as coming from another conscious mind \u2014 to feel seen and known, and to assert our own distinctness in return.<\/p>\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph _1agbrixi lg8ac51 lg8ac50 xkp0cg1\">And anyway, Gmail isn\u2019t yet that good at imitating my conscious voice. I would never write, \u201cLots of interesting stuff coming up at Vox!\u201d (Which isn\u2019t, of course, to say that there isn\u2019t a lot of interesting stuff going on at Vox.) That still leaves me, for now, with the pleasure of figuring out what I want to say.<\/p>\n<p class=\"_1tzd3in1\">You\u2019ve read 1 article in the last month<\/p>\n<p class=\"_1tzd3in4\">Here at Vox, we&#8217;re unwavering in our commitment to covering the issues that matter most to you \u2014 threats to democracy, immigration, reproductive rights, the environment, and the rising polarization across this country.<\/p>\n<p class=\"_1tzd3in4\">Our mission is to provide clear, accessible journalism that empowers you to stay informed and engaged in shaping our world. By becoming a Vox Member, you directly strengthen our ability to deliver in-depth, independent reporting that drives meaningful change.<\/p>\n<p class=\"_1tzd3in4\">We rely on readers like you \u2014 join us.<\/p>\n<p><img alt=\"Swati Sharma\" loading=\"lazy\" width=\"59\" height=\"69\" decoding=\"async\" data-nimg=\"1\" style=\"color:transparent\"  src=\"https:\/\/www.newsbeep.com\/ca\/wp-content\/uploads\/2026\/03\/1774673895_21_image.png\"\/><\/p>\n<p class=\"_1tzd3in8\">Swati Sharma<\/p>\n<p class=\"_1tzd3in9\">Vox Editor-in-Chief<\/p>\n","protected":false},"excerpt":{"rendered":"I first noticed it when, a few months ago, I opened an email from Ian, my literary agent.&hellip;\n","protected":false},"author":2,"featured_media":565863,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,8050,140,61],"class_list":["post-565862","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-future-perfect","tag-innovation","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/565862","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=565862"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/565862\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/565863"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=565862"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=565862"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=565862"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}