{"id":70977,"date":"2025-08-15T19:44:15","date_gmt":"2025-08-15T19:44:15","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/70977\/"},"modified":"2025-08-15T19:44:15","modified_gmt":"2025-08-15T19:44:15","slug":"the-latest-chatgpt-is-supposed-to-be-phd-level-smart-it-cant-even-label-a-map-2","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/70977\/","title":{"rendered":"The latest ChatGPT is supposed to be \u2018PhD level\u2019 smart. It can\u2019t even label a map"},"content":{"rendered":"<p>                Facebook<\/p>\n<p>                Tweet<\/p>\n<p>        <a class=\"social-share_labelled-list__share\" href=\"mailto:?subject=CNN%20content%20share&amp;body=Check%20out%20this%20article%3A%0Ahttps%3A%2F%2Fwww.cnn.com%2F2025%2F08%2F14%2Fbusiness%2Fchatgpt-rollout-problems\" data-type=\"email\" target=\"_blank\" rel=\"noopener noreferrer\" aria-label=\"share with email\" title=\"Share with email\"><\/p>\n<p>                Email<br \/>\n        <\/a><\/p>\n<p>                Link<\/p>\n<p data-uri=\"cms.cnn.com\/_components\/editor-note\/instances\/cmeacp1qy001s3b6n2gf3dlbl@published\" data-editable=\"text\" data-component-name=\"editor-note\" class=\"editor-note-elevate vossi-editor-note inline-placeholder \" data-article-gutter=\"true\">\n    A version of this story appeared in CNN Business\u2019 Nightcap newsletter. To get it in your inbox, sign up for free <a href=\"https:\/\/www.cnn.com\/newsletters\/nightcap?source=nl-acq_article\" rel=\"nofollow noopener\" target=\"_blank\">here<\/a>.\n<\/p>\n<p>      New York<br \/>\n        \u00a0\u2014\u00a0<\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8786001s27qlchphg11a@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Sam Altman, the artificial intelligence hype master, is in damage-control mode.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeafyv6o00013b6nd2er2w0q@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            OpenAI\u2019s latest version of its vaunted ChatGPT bot was supposed to be \u201cPhD-level\u201d smart. It was supposed to be the next great leap forward for a company that investors have poured billions of dollars into.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeag1ja600033b6nsupxhs5a@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Instead, ChatGPT got a flatter, more terse personality that can\u2019t reliably answer basic questions. The resulting public mockery has forced the company to make sweaty apologies while standing by its highfalutin claims about the bot\u2019s capabilities.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeag9ynm00093b6n45g3wfh5@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            In short: It\u2019s a dud.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeag5m7600073b6nppj8u4pc@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n             The misstep on the model, called GPT-5, is notable for a couple of reasons.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy00043b6n91ejerc7@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            1. It highlighted the many existing shortcomings of generative AI that critics were quick to seize on (more on that in a moment, because they were quite funny).\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeagr59t00053b6n9kjywode@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            <br \/>2. It raised serious doubts about OpenAI\u2019s ability to build and market consumer products that human beings are willing to pay for. That should be particularly concerning for investors, given <a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2025-08-06\/openai-in-talks-for-share-sale-valuing-startup-at-500-billion\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">OpenAI, which has never turned a profit, is reportedly worth $500 billion.<\/a>\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy00053b6n7ws9uhvq@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Let\u2019s rewind a bit to last Thursday, when OpenAI finally released GPT-5 to the world \u2014 about a year behind schedule, <a href=\"https:\/\/www.wsj.com\/tech\/ai\/openai-gpt5-orion-delays-639e7693?mod=article_inline\" target=\"_blank\" rel=\"nofollow noopener\">according to the Wall Street Journal.<\/a> Now, one thing this industry is really good at is hype, and on that metric, CEO Sam Altman delivered.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy00063b6ngzcxincz@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            During a livestream ahead of the launch last Thursday, Altman said talking to GPT-5 would be like talking to \u201ca legitimate PhD-level expert in anything, any area you need.\u201d\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeah4ewy00093b6nibju2yg3@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            In his typically lofty style, Altman said GPT-5 reminds him of \u201cwhen the iPhone went from those giant-pixel old ones to the retina display.\u201d The new model, he said, is \u201csignificantly better in obvious ways and subtle ways, and it feels like something I don\u2019t want to ever have to go back from,\u201d Altman said in a press briefing.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy00073b6nf7d4mcr0@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Then people started actually using it.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy00083b6nbyp7ymp8@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Users had a field day testing GPT-5 and mocking its wildly incorrect answers.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy00093b6n2abun602@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            The journalist Tim Burke said on <a href=\"https:\/\/bsky.app\/profile\/bubbaprog.xyz\/post\/3lvvplusuos2n\" target=\"_blank\" rel=\"nofollow noopener\">Bluesky<\/a> that he prompted GPT-5 to \u201cshow me a diagram of the first 12 presidents of the United States with an image of their face and their name under the image.\u201d\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeabjszb000z3b6nou1eldmh@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            The bot returned an image of nine people instead, with rather creative spellings of America\u2019s early leaders, like \u201cGearge Washingion\u201d and \u201cWilliam Henry Harrtson.\u201d\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8a2300003b6nzdtvzd1q@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            A similar prompt for the last 12 presidents returned an image that included two separate versions of George W. Bush. No, not George H.W. Bush, and then Dubya. It had \u201cGeorge H. Bush.\u201d And then his son, twice. Except the second time, George Jr. looked like just some random guy.\n    <\/p>\n<p lang=\"en\">At first I thought GPT 5 had got this right then I saw things like  &#8220;Tonnessee,&#8221; &#8220;Mississipo&#8221; and my personal favourite &#8220;West Wigina.&#8221; Please do not respond just saying the different typos to me we can all read the joke, we all know about &#8220;Distrricke&#8221;<\/p>\n<p><a href=\"https:\/\/bsky.app\/profile\/did:plc:qc6xzgctorfsm35w6i3vdebx\/post\/3lvua4fgc722k?ref_src=embed\" target=\"_blank\" rel=\"nofollow noopener\">[image or embed]<\/a><\/p>\n<p>\u2014 Ed Zitron (<a href=\"https:\/\/bsky.app\/profile\/did:plc:qc6xzgctorfsm35w6i3vdebx?ref_src=embed\" target=\"_blank\" rel=\"nofollow noopener\">@edzitron.com<\/a>) <a href=\"https:\/\/bsky.app\/profile\/did:plc:qc6xzgctorfsm35w6i3vdebx\/post\/3lvua4fgc722k?ref_src=embed\" target=\"_blank\" rel=\"nofollow noopener\">August 7, 2025 at 10:42 PM<\/a><\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000a3b6n5vahiq69@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Labeling basic maps of the United States also proved tricky for GPT-5 (but again, pretty funny, as tech writer Ed Zitron\u2019s <a href=\"https:\/\/bsky.app\/profile\/edzitron.com\/post\/3lvua4fgc722k\" target=\"_blank\" rel=\"nofollow noopener\">post on Bluesky<\/a> showed).\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeac398m00183b6nihgppkh0@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            GPT-5 did slightly better when I asked it on Wednesday for a map of the US. Some people can, in fact, label the great state of Vermont correctly without a PhD, but not GPT-5. And this is the first I\u2019m hearing of states named \u201cYirginia.\u201d\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000b3b6nsf93vmvz@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            The slop coming out of GPT-5 was funny when it was just us nerds trying to find its blind spots. But some regular fans of ChatGPT weren\u2019t laughing. Especially because users have been particularly alarmed by the new version\u2019s personality \u2013 or rather, lack thereof.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000c3b6n6tg41o27@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            In rolling out the new model, OpenAI essentially retired its earlier models, including the wildly popular GPT-4o that\u2019s been on the market for over a year, making it so that even people who loved the previous iteration of the chatbot suddenly couldn\u2019t use it. More than 4,000 people <a href=\"https:\/\/www.change.org\/p\/please-keep-gpt-4o-available-on-chatgpt?\" target=\"_blank\" rel=\"nofollow noopener\">signed a Change.org petition<\/a> to compel OpenAI to resurrect it.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeacav53001e3b6nij2suc4u@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            \u201cI\u2019m so done with ChatGPT 5,\u201d one user <a href=\"https:\/\/www.reddit.com\/r\/ChatGPT\/comments\/1mp3asi\/im_so_done_with_chatgpt_5\/\" target=\"_blank\" rel=\"nofollow noopener\">wrote on Reddit<\/a>, explaining how they tried to use the new model to run \u201ca simple system\u201d of tasks that an earlier ChatGPT model used to handle. The user said GPT-5 \u201cwent rogue,\u201d deleting tasks and moving deadlines.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000d3b6nq3rdwul5@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            And while OpenAI\u2019s defenders could chalk that up to an isolated or even made-up incident, within 24 hours of the GPT-5 launch Altman was doing damage control, seemingly caught of guard by the bad reception. On <a href=\"https:\/\/x.com\/sama\/status\/1953893841381273969\" target=\"_blank\" rel=\"nofollow\">X<\/a>, he announced a laundry list of updates, including the return of GPT-4o for paid subscribers.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000e3b6num258lw3@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            \u201cWe expected some bumpiness as we roll out so many things at once,\u201d Altman said in a post. \u201cBut it was a little more bumpy than we hoped for!\u201d\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000f3b6n58zdxu6j@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            The CEO\u2019s failure to anticipate the outrage suggests he doesn\u2019t have a firm grasp on how an estimated 700 million weekly active users are engaging with his product.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000g3b6nm67tazuz@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            Perhaps Altman missed all the coverage \u2014 from <a href=\"https:\/\/www.cnn.com\/2025\/07\/02\/tech\/chatgpt-ai-spirituality\" rel=\"nofollow noopener\" target=\"_blank\">CNN<\/a>, <a href=\"https:\/\/www.nytimes.com\/2025\/08\/08\/technology\/ai-chatbots-delusions-chatgpt.html\" target=\"_blank\" rel=\"nofollow noopener\">the New York Times<\/a>, <a href=\"https:\/\/www.wsj.com\/tech\/ai\/i-feel-like-im-going-crazy-chatgpt-fuels-delusional-spirals-ae5a51fc\" target=\"_blank\" rel=\"nofollow noopener\">the Wall Street Journal<\/a> \u2014 of people forming deep emotional attachments to ChatGPT or rival chatbots, having endless conversations with them as if they were real people. A simple search of Reddit could have offered insights into how others are integrating the tool into their workflows and lives. Basic market research should have shown OpenAI that a mass update sunsetting the tools people rely on would be more than just a bit bumpy.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeabnrb800123b6nzm2dd7sb@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            When asked about the backlash to GPT-5, an OpenAI representative pointed CNN to Altman\u2019s public statements <a href=\"https:\/\/x.com\/sama\/status\/1953893841381273969\" target=\"_blank\" rel=\"nofollow\">on social media<\/a> announcing the return of older models, as well as <a href=\"https:\/\/openai.com\/index\/how-we&#039;re-optimizing-chatgpt\/\" target=\"_blank\" rel=\"nofollow noopener\">a blog post<\/a> about how the company is optimizing GPT-5.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000i3b6nm0byj3gz@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            The messy rollout speaks to how the AI industry as a whole is struggling to prove themselves as producers of consumer goods rather than \u201clabs\u201d \u2014 as they love to call themselves, because it sounds more scientific and distracts people from the fact that they are backed by people who are trying to make unfathomable amounts of cash for themselves.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000j3b6n08jxi3k7@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            AI companies often base their fanfare around how a model performs in various behind-the-scenes benchmark tests that show how well a bot can do complex math. For all we know, GPT-5 sailed through those evaluations.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000k3b6n87of0sha@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            But the problem is that OpenAI hyped the thing so far into the stratosphere, disappointment was (or should have been) inevitable.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000l3b6nrerbb0qu@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            \u201cI honestly didn\u2019t think OpenAI would burn the brand name on something so mid,\u201d <a href=\"https:\/\/garymarcus.substack.com\/p\/gpt-5-overdue-overhyped-and-underwhelming\" target=\"_blank\" rel=\"nofollow noopener\">wrote<\/a> prominent researcher and AI critic Gary Marcus. \u201cIn a rational world, their valuation would take a hit,\u201d he added, noting OpenAI still hasn\u2019t turned a profit, is slashing prices to keep its user numbers up, and is hemorrhaging talent as competition heats up.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000m3b6ny5gtcadr@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            For critics like Marcus, the GPT-5 flop was a kind of vindication. As he noted in a blog post, other models like Elon Musk\u2019s Grok aren\u2019t faring much better, and the backlash from even AI proponents feels like a turning point.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000n3b6nbgjrtpri@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            When people talk about AI, they\u2019re talking about one of two things: the AI we have now \u2014 chatbots with limited, defined utility \u2014 and the AI that companies like Altman\u2019s claim they can build \u2014 machines that can outsmart humans and tell us how to cure cancer, fix global warming, drive our cars and grow our crops, all while entertaining and delighting us along the way.\n    <\/p>\n<p class=\"paragraph-elevate inline-placeholder vossi-paragraph\" data-uri=\"cms.cnn.com\/_components\/paragraph\/instances\/cmeab8mvy000o3b6n0n3qlykp@published\" data-editable=\"text\" data-component-name=\"paragraph\" data-article-gutter=\"true\">\n            But the gap between the promise and the reality of AI only seems to widen with every new model.\n    <\/p>\n","protected":false},"excerpt":{"rendered":"Facebook Tweet Email Link A version of this story appeared in CNN Business\u2019 Nightcap newsletter. To get it&hellip;\n","protected":false},"author":2,"featured_media":67818,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-70977","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/70977","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=70977"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/70977\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/67818"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=70977"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=70977"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=70977"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}