{"id":786915,"date":"2026-07-27T07:51:25","date_gmt":"2026-07-27T07:51:25","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/786915\/"},"modified":"2026-07-27T07:51:25","modified_gmt":"2026-07-27T07:51:25","slug":"a-modders-rtx-4080-was-enough-to-play-aaa-games-but-not-for-running-llms-so-he-integrated-nvidias-tesla-v100-at-a-throwaway-price-to-run-27b-ai-models","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/786915\/","title":{"rendered":"A Modder\u2019s RTX 4080 Was Enough To Play AAA Games, But Not For Running LLMs, So He Integrated NVIDIA\u2019s Tesla V100 At A Throwaway Price To Run 27B AI Models"},"content":{"rendered":"

Running higher-quality AI models means your existing GPU will have to be equipped with a ton of VRAM to make the experience enjoyable. For one RTX 4080<\/a>\u00a0owner, playing the most visually taxing and graphically demanding games might be a walk in the park, but for running LLMs, it\u2019s a Herculean task. Wanting to accomplish both feats in a single gaming PC, a modder successfully ran NVIDIA\u2019s Tesla V100 in his system, but encountered a few challenges along the way.<\/p>\n

Adding the Tesla V100 grants the modder 32GB of usable VRAM, sufficient for running significantly improved AI models like Qwen 3.6 at 32 tokens\/second<\/p>\n

Before you ask, it\u2019s impossible to attach the Tesla V100 to a desktop motherboard like a \u201cplug and play\u201d job, requiring Tymscar to purchase an SXM2-to-PCIe adapter. Sourcing the GPUs with 16GB of HBM2 memory and the accessory cost him \u00a3200, which translates into roughly $266. On eBay, you can grab these for only $100 apiece<\/a>. With the Tesla V100\u2019s 5,120 CUDA cores and 4,096-bit bus width that delivers 900GB\/s of bandwidth, the GPU still has some computing juice remaining.<\/p>\n

\"An<\/a><\/p>\n

\"An<\/a><\/p>\n

Successfully sourcing an SXM2-to-PCIe adapter wasn\u2019t the most difficult of challenges, but it isn\u2019t simple either, especially when you find out later that the Tesla V100 doesn\u2019t have a PCIe slot, display inputs, or PCIe power connectors. As you can see in the image below, attaching the GPU to the vapor chamber-style cooler might be perfectly fine for those who don\u2019t mind the excessive noise, but at 82dB, it\u2019ll make anyone uncomfortable.<\/p>\n

\"An<\/a>How the V100 was made to find in a desktop motherboard \/ Image credits – Tymscar<\/p>\n

With a little tweaking here and there to reduce the fan noise by using a 9V battery and a PWM jumper, the V100\u2019s modded cooler was now operating at 10 percent of the original maximum RPM. With this problem out of the way, the modder had successfully found a way to get 32GB of usable VRAM into his system. Now, no game will ever require a whopping 32GB of video memory, unless you decide to run a newer title at 16K resolution, so the best use case would be to fire up Qwen3.6 27B.<\/p>\n

\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t<\/a><\/p>\n

\t\t\t\"An<\/a>The noise level was insane<\/p>\n

The modder was running Qwen3.6-27B-MTP quantized at Q5_K_M, which comes in at 19GB, and with a context size of 128K tokens, there was sufficient VRAM to run the LLM at 32 tokens per second. Prompt processing was between 133 and 160 tokens per second, making it decent performance if you happen to stumble across previous-generation AI GPUs for home-computing purposes. Best of all, for less than $300, you can have your very own small to medium-sized AI models running at home, free of cost and without any internet connection.<\/p>\n

News Source: Tymscar<\/a><\/p>\n

\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\"Omar
\n\t\t\t\t\t<\/a><\/p>\n

\n\t\t\t\t\tAbout the author<\/a>: Omar Sohail is a reporter and analyst for Wccftech’s mobile<\/a> section, specializing in the technology and business of the mobile industry. His expertise lies in the intricate hardware supply chain, covering developments in semiconductor manufacturing, chip lithography, and camera sensor technology.\t\t\t\t<\/p>\n

\n\t\t\t\tFollow Wccftech on Google<\/a> to get more of our news coverage in your feeds.\n\t\t\t<\/p>\n","protected":false},"excerpt":{"rendered":"Running higher-quality AI models means your existing GPU will have to be equipped with a ton of VRAM…\n","protected":false},"author":2,"featured_media":786916,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,74],"class_list":["post-786915","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/786915","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=786915"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/786915\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/786916"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=786915"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=786915"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=786915"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}