Humans have been keeping time as far back as 3500 B.C. ChatGPT is still figuring it out.<\/p>\n
Last week, OpenAI CEO Sam Altman appeared on the show Mostly Human to talk about the future of AI, his company, and humanity as a whole. The interview was relatively standard fare\u2014the host, Laurie Segall, got Altman on the record on the demise of Sora, OpenAI sliding in following the Pentagon\u2019s spat with Anthropic, etc. But at one point, she asked Altman to react<\/a> to a viral video posted by TikTok user @huskistaken<\/a> in which he asks ChatGPT\u2019s voice model to time him running a mile. The chatbot very obviously makes up a time instead of actually keeping track.<\/p>\n Husk is a pro at showing the limitations of AI models, and getting ChatGPT to not only pretend to keep time for him but then also insist that it actually did so when it obviously hasn\u2019t is a solid bit of prodding at the machine. Altman laughs when shown the video, though it looks like it\u2019s in the way that people laugh when they\u2019re actually angry and trying to play it off. When Segall asks him if he needs to show the video to his product team, Altman pretty tersely responds, \u201cNo, no, that\u2019s a known issue.\u201d<\/p>\n Then, unprompted, Altman offers up a kind of shocking timeline for the groundbreaking feature of counting: \u201cMaybe another year before something like that works well.\u201d Per Altman, ChatGPT\u2019s voice model doesn\u2019t have the capability of starting a timer or keeping track of time. \u201cBut we will add the intelligence into the voice models,\u201d he said.<\/p>\n AI models, kinda notoriously, do not handle time well. People have asked ChatGPT\u2019s text model to track<\/a> how long a conversation has been going, and it also seemingly just makes up a duration in response. Most models also struggle to tell what time it is<\/a> on a clock when presented with an image of one, and image generation models have always had a hard time creating clocks<\/a> that display a specific hour or minute. Something about numbers and the concept of time just really throws these systems for a loop.<\/p>\n Husk happened to see the video in which Altman responded to him, and decided to add one more layer to the reaction chain by showing Altman\u2019s take to ChatGPT<\/a>\u2014specifically, that the AI model does not actually possess this capability, no matter how much it insists it does. After getting ChatGPT to confirm that it claims to have a timer (it calls keeping time \u201cjust a basic part of what I can do\u201d), he plays the clip of Altman saying that the model cannot, in fact, time anything.<\/p>\n Upon being presented with Altman, CEO of the company that makes ChatGPT, saying that it cannot keep time, ChatGPT insists, \u201cWhat he\u2019s saying is that some voice models might not have all the capabilities, but I do.\u201d Pressed on this, the model said, \u201cI definitely have a time capability.\u201d Finally, when asked to time Huck running a mile, which he claims is complete almost immediately, ChatGPT clocks the run at 7 minutes and 42 seconds.<\/p>\n So, the countdown clock is ticking; Altman has 1 year to get this sorted out.<\/p>\n