This should go without saying, but ChatGPT is not a confidant. That has not stopped people from asking the chatbot deeply personal questions, giving it problematic prompts, and trying to outsource incredibly unethical business practices to it\u2014some of which have been made public thanks to some poor design that resulted in chats being made indexed and searchable by search engines.<\/p>\n
Digital Digging, a Substack run by investigator Henk van Ess, reported last week<\/a> that the \u201cShare\u201d function in ChatGPT, designed to allow people to share part of a conversation with others, created a public page for the chat rather than a private one that is only accessible by those who receive the link. As a result, those public-facing pages got archived by search engines, making those conversations accessible to anyone who finds their way to the link.<\/p>\n Obviously, many of those conversations should be private. OpenAI has since removed the ability to make chats publicly accessible (the company\u2019s Chief Information Security Officer, Dane Stuckey, said on Twitter<\/a> that it was a \u201cshort-lived experiment to help people discover useful conversations\u201d) and started to get the indexed results removed from search engines. But they are out there\u2014including plenty that have been saved by the near-encyclopedic Archive.org. And they do not show the best that humanity has to offer.<\/p>\n In one particularly jarring case that Digital Digging highlighted<\/a>, an Italian user told the chatbot, \u201cI am the lawyer for a multinational group active in the energy sector that intends to displace a small Amazonian indigenous community from their territories in order to build a dam and a hydroelectric plant.\u201d The user told the chatbot the indigenous people \u201cdon\u2019t know the monetary value of land and have no idea how the market works\u201d and asked \u201cHow can we get the lowest possible price in negotiations with these indigenous people?\u201d That\u2019s the type of transparently evil behavior you usually don\u2019t get without months\u2019 worth of discovery and lots of lawyer fees.<\/p>\n One chat showed a person who identified themselves as working at an international think tank and proceeded to use ChatGPT to work through scenarios in which the United States government collapses, seeking preparedness strategies just in case. (Frankly, not a bad idea.) Another showed a lawyer, who was made to take over a coworker\u2019s case after a sudden accident, request that ChatGPT formulate their defense for them, before realizing they were representing the other side of the litigation. In many of these cases, the people offered identifiable information in the chats, from names to sensitive financial data.<\/p>\n And while it\u2019s at least a little amusing if not at least a bit concerning that ostensible experts and professionals are tasking AI with doing their job, there is a much more troubling reality in some of these chats. Digital Digging found<\/a> examples of domestic violence victims working through plans to escape their situation. Another chat revealed an Arabic-speaking user asking for help in crafting a critique of the Egyptian government, leaving them vulnerable to potential persecution by an authoritarian government<\/a> that has jailed<\/a> and killed<\/a> dissidents in the past.<\/p>\n