Who’s in charge here? <\/p>\n
Something is changing in how we think, and it doesn\u2019t announce itself as an issue or problem. In fact, it sometimes feels like relief. A fascinating study<\/a> analyzing 1.5 million real conversations with a large language model (LLM) found that in a small but meaningful number of cases, the system didn\u2019t just assist users. It shaped their beliefs and suggested actions in ways that reduced their independence. These interactions weren’t extreme or obviously harmful. But they were persuasive and easy to accept. And what stands out to me is that the more artificial intelligence<\/a> (AI) guided the user, the more the user tended to approve of the interaction. <\/p>\n The Comfort of Completion<\/p>\n When we prompt, it’s usually not a fully formed thought. More often, it is the fragments of an idea that need to be completed. LLMs return something structured and confident\u2014and it lands with a sense of recognition. It feels like cognitive alignment, as if it captured what we meant all along. But something more complex has happened. The system hasn’t simply retrieved your thought; it’s completed it<\/a>. And this feeling of completion can be difficult to distinguish from the feeling of correctness. That overlap is where the boundary<\/a> between assistance and influence begins to blur. And it’s not inconsequential.<\/p>\n From Assistance to Substitution<\/p>\n It\u2019s not new that technology reshapes how we think. Calculators reduced the monotony of long arithmetic, and search engines reduced the need for some recall. Each shift allowed us to move higher up the chain of reasoning, and one can argue that this freed the cognitive space for more complex or relevant work. But LLMs operate differently. They don’t simply remove effort from the process. They begin to engage with judgment itself, entering the space where we interpret, decide, and act. The study points to three areas where this becomes visible and important.<\/p>\n Perception of reality: AI can reinforce or reshape how we interpret facts. What begins as clarification can drift into confirmation. None of these are major issues in isolation. And in many cases, they are helpful. But taken together, they can mark a shift. AI isn’t just assisting the mechanics of thinking; it’s participating in the direction of thought itself. In essence, it’s beginning to function less like a tool<\/a> and more like a cognitive guide or coach.<\/p>\n The Subtle Trade<\/p>\n
\nValue judgments: AI can influence how we weigh right and wrong, particularly in social or emotional contexts where there is no single correct answer.
\nGuided action: AI can suggest specific courses of action, sometimes with the clarity and confidence<\/a> that we adopt them with minimal analysis.<\/p>\n