{"id":169778,"date":"2025-09-30T06:14:11","date_gmt":"2025-09-30T06:14:11","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/169778\/"},"modified":"2025-09-30T06:14:11","modified_gmt":"2025-09-30T06:14:11","slug":"famed-gamer-creates-working-5-million-parameter-chatgpt-ai-model-in-minecraft-made-with-439-million-blocks-ai-trained-to-hold-conversations-working-model-runs-inference-in-the-game","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/169778\/","title":{"rendered":"Famed gamer creates working 5 million parameter ChatGPT AI model in Minecraft, made with 439 million blocks \u2014 AI trained to hold conversations, working model runs inference in the game"},"content":{"rendered":"

A developer and enthusiast Minecrafter has showcased a project dubbed CraftGPT on GitHub<\/a>. In an amazing feat of Minecraft Redstone engineering, Sammyuri \u2014 famed for building a 1Hz CPU inside the game \u2014 has built a small language model that runs on a computer inside Minecraft<\/a>, trained on the TinyChat dataset. The CraftGPT project is hewn from 1,020 x 260 x 1,656 blocks in the game (439 million in total), and functions as advertised, but a major usability drawback is that you will have to \u201cwait a couple [of] hours for the response to be generated.\u201d<\/p>\n

The video above shows the colossal in-game computer that was built to run CraftGPT. Sammyuri explains that the game\u2019s Distant Horizons mod was needed to capture this \u2018fly-by\u2019 footage of the computer build.<\/p>\n

<\/p>\n

Naturally, even with such an impressive Redstone project, CraftGPT isn\u2019t going to replace more traditional methods of getting an LLM up and running on your PC. Sammyuri asks users\/testers to temper their expectations. \u201cThe model is very prone to going off-topic, producing responses that are not grammatically correct, or simply outputting garbage,\u201d admits the project developer.<\/p>\n

You may like<\/p>\n

So, how did Sammyuri use Redstone to put this project together? Redstone provides electronic components within the Minecraft environment. The video shows the in-game CraftGPT contraption being put together component-by-component. It has tokenizers, matrix multipliers, and so on. Sammyuri explains that the small language model used was created without command blocks or data packs in Minecraft. Moreover, \u201cthe model has 5,087,280 parameters, trained in Python <\/a>on the TinyChat dataset of basic English conversations,\u201d says the developer.<\/p>\n

AI-wranglers may also be interested to know that the 5-million parameter CraftGPT \u201chas an embedding dimension of 240, vocabulary of 1920 tokens, and consists of 6 layers. The context window size is 64 tokens, which is enough for (very) short conversations.\u201d Sammyuri adds that \u201cMost weights were quantized to 8 bits, although the embedding and LayerNorm weights are stored at 18 and 24 bits respectively.\u201d<\/p>\n

The need for speed<\/p>\n

CraftGPT is admittedly not in any way a rival to the chatbot sites and apps you may use day to day. We already mentioned some limitations of chat quality, depth, and even accuracy. But probably by far its largest wrinkle is performance-related.<\/p>\n

A Minecraft Redstone constructed processor or computer might be a modern marvel, but it pales in comparison to real hardware. Thus, the CraftGPT chat experience is severely hampered by response time. Typically, the system will need about two hours to answer a simple prompt, says Sammyuri. This is even with the tick rate increased to about 40,000x speed using MCHPRS (the Minecraft High Performance Redstone Server).<\/p>\n

Get Tom’s Hardware’s best news and in-depth reviews, straight to your inbox.<\/p>\n

Previously mind-blowing Minecraft Redstone feats include standalone 16-bit CPUs and the IRIS Computer<\/a>, which was capable of running a version of DOOM (1993) in Minecraft.<\/p>\n

Follow Tom’s Hardware on Google News<\/a>, or add us as a preferred source<\/a>, to get our up-to-date news, analysis, and reviews in your feeds. Make sure to click the Follow button!<\/p>\n","protected":false},"excerpt":{"rendered":"A developer and enthusiast Minecrafter has showcased a project dubbed CraftGPT on GitHub. In an amazing feat of…\n","protected":false},"author":2,"featured_media":169779,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-169778","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/169778","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=169778"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/169778\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/169779"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=169778"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=169778"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=169778"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}