Dally, now Nvidia\u2019s chief scientist, started consulting for Nvidia in 2003 while he was working at Stanford. When he was ready to step down from being the department chair of Stanford\u2019s computer science department a few years later, he planned to take a sabbatical. Nvidia had a different idea.<\/p>\n
![\"\"](\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2025\/08\/NEW-Bill-Dally.jpg\")
Bill DallyImage Credits:Nvidia<\/p>\n
David Kirk, who was running the research lab at the time, and Nvidia CEO Jensen Huang, thought a more permanent position at the research lab was a better idea. Dally told TechCrunch the pair put on a \u201cfull-court press\u201d on why he should join Nvidia\u2019s research lab and eventually convinced him.<\/p>\n
\u201cIt wound up being kind of a perfect fit for my interests and my talents,\u201d Dally said. \u201cI think everybody\u2019s always searching for the place in life where they can make the biggest contribution to the world. And I think for me, it\u2019s definitely Nvidia.\u201d<\/p>\n
When Dally took over the lab in 2009, expansion was first and foremost. Researchers started working on areas outside of ray tracing right away, including circuit design and VLSI, or very large-scale integration, a process that combines millions of transistors on a single chip.<\/p>\n
The research lab hasn\u2019t stopped expanding since.<\/p>\n
Techcrunch event<\/p>\n
\n\t\t\t\t\t\t\t\t\tSan Francisco
\n\t\t\t\t\t\t\t\t\t\t\t\t\t|
\n\t\t\t\t\t\t\t\t\t\t\t\t\tOctober 27-29, 2025\n\t\t\t\t\t\t\t<\/p>\n
\u201cWe try to figure out what will make the most positive difference for the company because we\u2019re constantly seeing exciting new areas, but some of them, they do great work, but we have trouble saying if [we\u2019ll be] wildly successful at this,\u201d Dally said.<\/p>\n
For a while that was building better GPUs for artificial intelligence. Nvidia was early to the future AI boom and started tinkering with the idea of AI GPUs in 2010 \u2014\u00a0more than a decade before the current AI frenzy.<\/p>\n
\u201cWe said this is amazing, this is gonna completely change the world,\u201d Dally said. \u201cWe have to start doubling down on this and Jensen believed that when I told him that. We started specializing our GPUs for it and developing lots of software to support it, engaging with the researchers all around the world who were doing it, long before it was clearly relevant.\u201d<\/p>\n
Physical AI focus<\/p>\n
Now, as Nvidia holds a commanding lead in the AI GPU market, the tech company has started to seek out new areas of demand beyond AI data centers. That search has led Nvidia to physical AI and robotics.<\/p>\n
\u201cI think eventually robots are going to be a huge player in the world and we want to basically be making the brains of all the robots,\u201d Dally said. \u201cTo do that we need to start developing the key technologies.\u201d<\/p>\n
That\u2019s where Sanja Fidler, the vice president of AI research at Nvidia, comes in. Fidler joined Nvidia\u2019s research lab in 2018. At the time, she was already working on simulation models for robots with a team of students at MIT. When she told Huang about what they were working on at a researchers\u2019 reception, he was interested.<\/p>\n
\u201cI could not resist joining,\u201d Fidler told TechCrunch in an interview. \u201cIt\u2019s just such a great topic fit and at the same time was also such a great culture fit. Jensen told me, come work with me, not with us, not for us.\u201d<\/p>\n
She joined Nvidia and got to work creating a research lab in Toronto called Omniverse, an Nvidia platform, that was focused on building simulations for physical AI.<\/p>\n
![\"\"](\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2025\/08\/SanjaFidler_1-2.jpg\")
Sanja FidlerImage Credits:Nvidia<\/p>\n
The first challenge to building these simulated worlds was finding the necessary 3D data, Fidler said. This included finding the proper volume of potential images to use and building the technology needed to turn these images into 3D renditions the simulators could use.<\/p>\n
\u201cWe invested in this technology called differentiable rendering, which essentially makes rendering amendable to AI,\u201d Fidler said. \u201cYou go [from] rendering means from 3D to image or video. And we want it to go the other way.\u201d<\/p>\n
World models<\/p>\n
Omniverse released the first version of its model that turns images into 3D models, GANverse3D<\/a>, in 2021. Then it got to work on figuring out the same process for video. Fidler said they used videos from robots and self-driving cars to create these 3D models and simulations through its Neural Reconstruction Engine<\/a>, which the company first announced in 2022.<\/p>\n She added these technologies were the backbone of the company\u2019s Cosmos family of world AI models<\/a> that were announced at CES in January.<\/p>\n Now, the lab is focused on making these models faster. When you play a video game or simulation you want the tech to be able to respond in real time, Fidler said, for robots they are working to make the reaction time even faster.<\/p>\n \u201cThe robot doesn\u2019t need to watch the world in the same time, in the same way as the world works,\u201d Fidler said. \u201cIt can watch it like 100x faster. So if we can make this model significantly faster than they are today, they\u2019re going to be tremendously useful for robotic or physical AI applications.\u201d<\/p>\n The company continues to make progress on this goal. Nvidia announced at the SIGGRAPH computer graphics conference on Monday a fleet of new world AI models<\/a> designed for creating synthetic data that can be used to train robots. Nvidia also announced new libraries and infrastructure software aimed at robotics developers too.<\/p>\n Despite the progress \u2014\u00a0and the current hype about robots, especially humanoids \u2014\u00a0the Nvidia research team remains realistic.<\/p>\n Both Dally and Fidler said the industry is still at least a few years off from having a humanoid in your home, with Fidler comparing it to the hype and timeline regarding autonomous vehicles.<\/p>\n \u201cWe\u2019re making huge progress and I think AI has really been the enabler here,\u201d Dally said. \u201cStarting with visual AI for the robot perception, and then generative AI, that\u2019s being hugely valuable for task and motion planning and manipulation. As we solve each of these individual little problems and as the amount of data we have to train our networks grows, these robots are going to grow.\u201d<\/p>\n