{"id":626489,"date":"2026-04-23T21:07:24","date_gmt":"2026-04-23T21:07:24","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/626489\/"},"modified":"2026-04-23T21:07:24","modified_gmt":"2026-04-23T21:07:24","slug":"google-unveils-two-new-tpus-designed-for-the-agentic-era","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/626489\/","title":{"rendered":"Google unveils two new TPUs designed for the &#8220;agentic era&#8221;"},"content":{"rendered":"<p>So the new chips allow for faster training, but Google also says you get more useful computation for every volt you pump into a TPU 8t. The company claims a \u201cgoodpute\u201d rate of 97 percent, which means less waiting and wasted effort. With better handling of irregular memory access, automatic handling of hardware faults, and real-time telemetry across all connected chips, TPU 8t spends more time actively advancing model training.<\/p>\n<p>When training is done, AI models run in inference mode to generate tokens\u2014that\u2019s the process happening behind the scenes when you tell a model to do something. This doesn\u2019t require as much horsepower, so using the same hardware for both parts of the AI lifecycle is inefficient. That\u2019s why inference is the purview of TPU 8i, which is designed to be more efficient when running multiple specialized agents, with less waiting time. TPU 8i chips also run in larger pods of 1,152 chips versus just 256 for the last-gen Ironwood inference clusters. That works out to 11.6 EFlops per pod, much lower than TPU 8t pods.<\/p>\n<p>            <a class=\"cursor-zoom-in\" data-pswp-width=\"3840\" data-pswp-height=\"2160\" data-pswp- data-cropped=\"false\" href=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/04\/TPU-8i-chip.jpg\" target=\"_blank\"><br \/>\n              <img width=\"3840\" height=\"2160\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/04\/TPU-8i-chip.jpg\" class=\"fullwidth full\" alt=\"TPU 8i chip\" decoding=\"async\" loading=\"lazy\"  \/><br \/>\n            <\/a><\/p>\n<p>              The TPU 8i has less raw power than TPU 8t.<\/p>\n<p>\n                  Credit:<br \/>\n                                      Google\n                                  <\/p>\n<p>\n      The TPU 8i has less raw power than TPU 8t.<\/p>\n<p>          Credit:<\/p>\n<p>          Google<\/p>\n<p>Google has tripled the amount of on-chip SRAM for each TPU 8i to 384 MB. This allows the company\u2019s new chips to keep a larger key value cache on the chip, speeding up models with longer context windows. The eighth-gen AI accelerators are also the first from Google to rely solely on Google\u2019s custom Axion ARM CPU host, featuring one CPU for every two TPUs. In Ironwood, each x86 CPU serviced four TPU chips. Google says this \u201cfull-stack\u201d ARM-based approach allows for much greater efficiency.<\/p>\n<p>An efficiency play<\/p>\n<p>It makes sense that efficiency is a core part of Google\u2019s new TPU setup. Training and running frontier AI models is expensive, and the return on investment is unclear. Companies are still burning money on generative AI in the hopes that efficiency will turn the corner at some point. Maybe Google\u2019s new TPUs will help get there and maybe not, but the company has made notable improvements.<\/p>\n","protected":false},"excerpt":{"rendered":"So the new chips allow for faster training, but Google also says you get more useful computation for&hellip;\n","protected":false},"author":2,"featured_media":626490,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-626489","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/626489","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=626489"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/626489\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/626490"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=626489"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=626489"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=626489"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}