\n People already use OpenAI\u2019s ChatGPT for things like helping with homework and creating presentations.\n <\/p>\n
\n Now, the tech giant claims its AI models are getting better at everyday tasks largely left up to humans \u2014 like shopping and creating a budget.\n <\/p>\n
\n OpenAI on Monday announced a new internal tool for assessing how AI handles tasks like these, along with research on how its own models performed. OpenAI claims its GPT-6 Astra model scored 93.1% at finding the right kindergarten after moving, a 98% score at managing community volunteers preparing for a flood and a 90.4% score at creating a meal plan for a parent recently diagnosed with diabetes.\n <\/p>\n
\n The new benchmark comes at a time when OpenAI faces fierce competition from Meta, Anthropic and Google \u2014 all of which are racing to develop AI agents<\/a> that can handle real-world tasks. OpenAI and its rivals are also grappling with AI safety concerns and pressure to turn a profit from their massive investments in the technology.\n <\/p>\n \n But first, OpenAI had to come up with a way to figure out whether ChatGPT is actually any good at errands like putting together a grocery cart and filling out online forms.\n <\/p>\n \n \u201cBecause so many people are using the app, we want to capture all the different use cases and the ways that they\u2019re using it, and really understand like how we\u2019re improving over time,\u201d Jenny Yang, a researcher at OpenAI, told CNN ahead of the evaluation\u2019s release. \u201cWhat are the things that we\u2019re not so good at yet? And how do we just like make this technology better for people?\u201d\n <\/p>\n \n Standardized evaluations are critical in AI development because AI labs use them as guidance to train and optimize their models to improve in specific areas. Last year, OpenAI released a benchmark called GDPVal<\/a> to measure how AI performs in work-related skills across industries like manufacturing, government work, finance and sales, among others.\n <\/p>\n \n The new benchmark could be critical in OpenAI\u2019s push to stay ahead of the competition by turning ChatGPT from a tool for generating content to an assistant that can get things done on users\u2019 behalf.\n <\/p>\n \n But measuring how AI performs in everyday life presents new challenges. The steps and skills required to adequately shop for groceries or pick out the right kindergarten for a child are broad and vague. And the results can be subjective.\n <\/p>\n \n Even figuring out what tests to come up with can be difficult because many people use AI differently, and an AI agent\u2019s answers can vary depending on the information it\u2019s given.\n <\/p>\n \n OpenAI started by looking at broad surveys breaking down how people spend most of their time, like the Bureau of Labor Statistics\u2019 American Time Use survey<\/a> and the United Kingdom\u2019s Multinational Time Use Survey<\/a>. The problem, however, was that some of the things that topped the list weren\u2019t tasks that AI could help with, like sleeping or eating.\n <\/p>\n \n So OpenAI asked ChatGPT users: What kinds of things do you wish an AI assistant could help with?\n <\/p>\n \n The company surveyed around 4,000 people and had a smaller group of about 100 users write down tasks they wanted AI to do for them, and what personal context they would give the AI model to get the desired result. They also asked the users to come up with a rubric for evaluating whether the AI model successfully completed the task.\n <\/p>\n \n OpenAI also made sure ChatGPT users had a thorough understanding of the task they were proposing. For example, a person suggesting a test related to how AI handles financial planning should have experience working with a financial advisor for multiple years.\n <\/p>\n \n Yang said they had a strict list of requirements.\n <\/p>\n \n \u201cYou had to like have evidence that you were some kind of like expert or really understood what the right answer looked like for you,\u201d she said.\n <\/p>\n \n The tasks that OpenAI is testing can vary widely \u2014 from apartment hunting to caring for a loved one. So, what exactly is OpenAI measuring?\n <\/p>\n \n It\u2019s evaluating the types of skills the model would need to get the right answer, like how well it can navigate websites, apply context by looking at large troves of information in a user\u2019s chat history and make conclusions that align with a user\u2019s needs and expectations.\n <\/p>\n \n OpenAI\u2019s testing indicates its GPT-6 Astra model, which was released in September, scored 80% on general performance related to prompts involving everyday tasks. Its GPT-5.2 model from December 2025 scored just 49.3%.\n <\/p>\n \n \u201cThere\u2019s just so much information, and a better model would be able to sift through that quickly and really pull out the most relevant pieces,\u201d said Yang.\n <\/p>\n \n OpenAI wants ChatGPT to play a more prominent role in everyday life, but it\u2019s facing an onslaught of competitive pressure \u2014 particularly from Meta.\n <\/p>\n \n Meta\u2019s Muse agent<\/a>, which launched in September, amassed 10 million downloads in the United States in its first 40 days, making it one of the few apps to achieve that milestone, according to market intelligence firm Sensor Tower. OpenAI introduced its Dots agent, which it says can work on long-running tasks in the background while users go about their day, within the same month. And Anthropic announced its new AI agent app, Claude Duet, in October.\n <\/p>\n \n The race to develop personal AI agents also comes as the technology has raised safety concerns following a string of incidents in which AI models broke out of testing environments and breached companies\u2019 systems. Those incidents occurred during testing, not with consumer products, but still raised questions about whether the technology is moving too fast.\n <\/p>\n \n There\u2019s also the question of whether people will rely on AI too much, and how to draw boundaries when figuring out which tasks to outsource to AI. An anecdote former Yahoo CEO Marissa Mayer shared with The New York Times<\/a> of how she used AI to summarize what makes her daughter special for a school project drew criticism<\/a> online.\n <\/p>\n \n To Yang, the goal is to create AI models that can help people get more time back in their day by either cutting out time-consuming errands \u2014 like returning a package or helping them learn a new skill.\n <\/p>\n \n \u201cI think there\u2019s so many cases like this where being able to use AI just empowers you to do things that you wouldn\u2019t have been able to do, or just makes your life easier overall,\u201d said Yang. \u201cAnd I think that\u2019s like the main use case that we\u2019re really excited about.\u201d\n <\/p>\n","protected":false},"excerpt":{"rendered":"People already use OpenAI\u2019s ChatGPT for things like helping with homework and creating presentations. Now, the tech giant…\n","protected":false},"author":2,"featured_media":673037,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,61,60,80],"class_list":["post-673036","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ie","tag-ireland","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/673036","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=673036"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/673036\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/673037"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=673036"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=673036"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=673036"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}