{"id":761401,"date":"2026-06-26T11:10:29","date_gmt":"2026-06-26T11:10:29","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/761401\/"},"modified":"2026-06-26T11:10:29","modified_gmt":"2026-06-26T11:10:29","slug":"openai-and-broadcom-announce-chip-designed-for-llm-inference-at-scale","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/761401\/","title":{"rendered":"OpenAI and Broadcom announce chip designed for LLM inference at scale"},"content":{"rendered":"<p>OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon supplier, have <a href=\"https:\/\/openai.com\/index\/openai-broadcom-jalapeno-inference-chip\/\" rel=\"nofollow noopener\" target=\"_blank\">announced<\/a> a new chip, called Jalape\u00f1o, designed specifically for large language model inference in data centers.<\/p>\n<p>The companies intend to deploy the chip at large data centers and claim this is just the first generation in a long-term project that will see chips refined over time.<\/p>\n<p>Broadcom says that this ASIC (Application-Specific Integrated Circuit) was designed from scratch for LLM inference, based on \u201cdetailed insights\u201d from the company\u2019s conversations with researchers at OpenAI, and that the chip\u2019s development was informed by OpenAI\u2019s own roadmap for future models and products. The design and production of the chip took nine months.<\/p>\n<p>The promise is that this chip is more specialized for the current needs of LLMs than those that inference systems currently run on in existing data centers.<\/p>\n<p>OpenAI claims that \u201cearly testing shows that Jalape\u00f1o will deliver performance per watt substantially better than current state-of-the-art,\u201d but notes that it is not done measuring performance, and that a \u201cdetailed technical report will be presented in the coming months.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"OpenAI, the company behind ChatGPT and Codex and the models those tools use, and Broadcom, an established silicon&hellip;\n","protected":false},"author":2,"featured_media":761402,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-761401","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/761401","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=761401"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/761401\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/761402"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=761401"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=761401"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=761401"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}