The leaps in performance between LLMs released by companies across the sector, such as OpenAI, Google and Elon Musk\u2019s xAI, have been slowing, despite the vast sums invested in their development.\u00a0<\/p>\n
The potential market for world models could be huge, almost the size of the global economy, according to Rev Lebaredian, vice-president of Omniverse and simulation technology at Nvidia, as it brings the\u00a0technology into the physical domain, such as\u00a0the\u00a0manufacturing and healthcare\u00a0sectors.<\/p>\n
\u201cWhat is the opportunity for world foundation models? Essentially\u2009.\u2009.\u2009.\u2009$100tn if we can make an intelligence that can understand the physical world and operate in the physical world,\u201d he said. <\/p>\n
World models are trained using data streams of real or simulated environments. They are viewed as an important step in pushing forward progress in self-driving cars, robotics and so-called AI agents,\u00a0but require a huge amount of data and computing power to train and are considered an unsolved technical challenge.<\/p>\n
This focus on an alternative approach to LLMs has become visible as several AI groups have unveiled a series of advancements in world models in recent months. <\/p>\n
Last month, Google DeepMind previewed Genie 3, which generates video frame by frame and takes past interactions into account. Previously, video generation models have typically created the entire video at once, rather than step-by-step. <\/p>\n
Recommended<\/p>\n
\u201cAI\u2009.\u2009.\u2009.\u2009remains very much limited to the digital domain,\u201d said Shlomi Fruchter, co-lead of Genie 3 at Google DeepMind. \u201cBy building environments that look like or behave like the real world, we can have much more scalable ways to train the AI\u2009.\u2009.\u2009. without the real implications of making a mistake in the real world.\u201d<\/p>\n Meta is attempting to replicate how children learn passively by observing the world around them, training its V-JEPA models on raw video content.<\/p>\n Its Facebook Artificial Intelligence Research (Fair) lab, led by Meta chief AI scientist Yann LeCun and focused on longer-term AI projects, released its second version of the model in June, which it has been testing on robots. <\/p>\n LeCun, considered one of the \u201cgodfathers\u201d of modern AI, has been one of the most vocal proponents<\/a> of the new architecture, warning that LLMs would never achieve the ability to reason and plan like humans. <\/p>\n Despite this, Meta\u2019s chief, Mark Zuckerberg, has recently increased investment in top AI talent, with an elite team<\/a> now pushing to make breakthroughs on its next Llama LLM models. This has included hiring Alexandr Wang, the founder of data labelling group Scale AI, to head all of Meta\u2019s AI work, with LeCun now reporting to Wang.<\/p>\n One near-term application of world models is in the entertainment industry, where they can create interactive and realistic scenes. World Labs, a start-up founded by AI pioneer Fei-Fei Li, is developing a model that generates video game-like 3D environments from a single image. <\/p>\n Runway, a video generation start-up that has deals with Hollywood studios, including Lionsgate, launched a product last month that uses world models to create gaming settings, with personalised stories and characters generated in real time.<\/p>\n \u201cTraditional video methods [are a] brute-force approach to pixel generation, where you\u2019re trying to squeeze motion in a couple of frames to create the illusion of movement, but the model actually doesn\u2019t really know or reason about what\u2019s going on in that scene,\u201d said Crist\u00f3bal Valenzuela, chief executive officer at Runway. <\/p>\n Previous video-generation models had physics that were unlike the real world, he added, which general-purpose world model systems help to address.<\/p>\n To build these models, companies need to collect a huge amount of physical data about the world. <\/p>\n San Francisco-based Niantic has mapped 10mn locations, gathering information through games including Pok\u00e9mon Go, which has 30mn monthly players interacting with a global map. <\/p>\n Recommended<\/p>\n Niantic ran Pok\u00e9mon Go for nine years and, even after the game was sold to US-based Scopely in June, its players still contribute anonymised data through scans of public landmarks to help build its world model. <\/p>\n \u201cWe have a running start at the problem,\u201d said John Hanke, chief executive of Niantic Spatial, as the company is now called following the Scopely deal.<\/p>\n Both Niantic and Nvidia are working on filling gaps by getting their world models to generate or predict environments. Nvidia\u2019s Omniverse platform creates and runs such simulations, assisting the $4.3tn tech giant\u2019s push towards robotics and building on its long history of simulating real-world environments in video games.<\/p>\n![\"Illustrated](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2025\/09\/https:\/\/www.ft.com\/__origami\/service\/image\/v2\/images\/raw\/https%3A%2F%2Fd1e00ek4ebabms.cloudfront.net.jpeg\")
<\/a><\/p>\n<\/a><\/p>\n