{"id":390862,"date":"2026-01-04T10:25:12","date_gmt":"2026-01-04T10:25:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/390862\/"},"modified":"2026-01-04T10:25:12","modified_gmt":"2026-01-04T10:25:12","slug":"pocket-sized-supercomputer-turns-14-year-old-pc-into-offline-ai-engine","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/390862\/","title":{"rendered":"Pocket-sized supercomputer turns 14-year-old PC into offline AI engine"},"content":{"rendered":"<p>US deep-tech AI startup Tiiny AI has released a groundbreaking demonstration showing a 14-year-old PC running a 120-billion-parameter AI model smoothly without any internet connection. <\/p>\n<p>Captured in a single uninterrupted take, the demo features OpenAI\u2019s GPT-OSS 120B running on Pocket Lab, the company\u2019s proprietary personal supercomputer.<\/p>\n<p>Tiiny AI aims to make cloud-grade large language model intelligence accessible to everyone, regardless of internet connection, cloud access, or GPU upgrades. The company\u2019s Pocket Lab PC recently gained recognition as \u201cThe Smallest MiniPC (100B LLM Locally)\u201d, post its launch on December 10.<\/p>\n<p>Equipped with a 65W power capacity, it supports installation of popular open-source models like Llama, Qwen, DeepSeek, MIstral, Phi, and GPT-OSS.<\/p>\n<p>More on the experiment<\/p>\n<p lang=\"en\" dir=\"ltr\">See 120B LLM Running Locally on an Old PC<br \/>in One Continuous Take<\/p>\n<p>No cloud. No GPU upgrade. No expensive computer.<\/p>\n<p>\ud83d\ude0e We just ran OpenAI GPT-OSS 120B on a computer from 14 years ago \u2014 powered by Tiiny AI Pocket Lab.<\/p>\n<p>See what personal AI actually looks like. <a href=\"https:\/\/t.co\/6uaAOMH0oP\" rel=\"noopener noreferrer nofollow\" target=\"_blank\">pic.twitter.com\/6uaAOMH0oP<\/a><\/p>\n<p>\u2014 Tiiny AI (@TiinyAILab) <a href=\"https:\/\/twitter.com\/TiinyAILab\/status\/2004220599384920082?ref_src=twsrc%5Etfw\" rel=\"noopener noreferrer nofollow\" target=\"_blank\">December 25, 2025<\/a><\/p>\n<p>For the demo, the Tiiny AI team used a 2011 PC with an Intel Core i3-530 processor, 2GB of DDR3 RAM, and a CRT monitor. After connecting Pocket Lab to the old PC, the machine successfully <a href=\"https:\/\/interestingengineering.com\/ai-robotics\/code-plugins-get-ai-chatbots-high-on-drugs\" target=\"_blank\" rel=\"dofollow noopener\">operated ChatGPT<\/a>, with an average token processing speed of 20 tokens per second.<\/p>\n<p>The team ran reasoning and analytical tasks on the PC in the demo. The chat started with a question prompt asking, \u201cWho are you?\u201d Next, the team queried \u201cWhy does 1+1=2\u201d, and <a href=\"https:\/\/interestingengineering.com\/ai-robotics\/brainbody-llm-algorithms-make-robots-think\" target=\"_blank\" rel=\"dofollow noopener\">the LLM launched<\/a> into a detailed explanation of the question without any interruptions. It used 1582 tokens to answer the question with a speed of 18.6 tokens per second.<\/p>\n<p>\u201cThis demonstration proves something the AI industry long assumed was impossible,\u201d said Samar Bhoj, GTM Director of Tiiny AI.<\/p>\n<p>\u201cWe are showing that large-model intelligence no longer needs massive GPU clusters or cloud infrastructure. With Tiiny AI Pocket Lab, advanced AI can run privately, offline, and on everyday hardware, even a 14-year-old PC. The future of AI belongs to people, not data centers,\u201d he added further.<\/p>\n<p>By moving inference fully to the device, the demonstration proves that even older hardware can now deliver performance previously believed to require advanced AI systems.<\/p>\n<p>What makes the AI supercomputer tick?<\/p>\n<p>At its base, <a href=\"https:\/\/interestingengineering.com\/ai-robotics\/us-world-smallest-ai-supercomputer\" rel=\"dofollow noopener\" target=\"_blank\">Pocket Lab<\/a> is powered by Tiiny AI\u2019s proprietary technologies, named TurboSparse and PowerInfer. Together, these systems enable large-scale language models to run locally at a power level far below that of traditional GPU-based systems.<\/p>\n<p>TurboSparse boosts efficiency by activating only the required neurons without reducing model intelligence. At the same time, PowerInfer spreads AI workloads across the CPU and NPU to improve performance while using far less power.<\/p>\n<p>In terms of specifications, the Pocket Lab supercomputer comes with an ARMv9.2 12-core CPU. It has 80GB of LPDDR5X memory and a 1TB SSD, weighing about 300 grams.<\/p>\n<p>A glance at the use cases<\/p>\n<p>Pocket Lab is designed to support a wide range of personal AI applications, empowering creators, developers, researchers, students, and other professionals alike. <\/p>\n<p>It enables multi-step reasoning, deep contextual understanding, agent-based workflows, content generation, and secure data handling without needing an internet connection.<\/p>\n<p>User data, preferences, and documents are stored locally with bank-grade encryption, providing persistent memory and significantly stronger privacy than traditional cloud-based AI systems.<\/p>\n<p><script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n","protected":false},"excerpt":{"rendered":"US deep-tech AI startup Tiiny AI has released a groundbreaking demonstration showing a 14-year-old PC running a 120-billion-parameter&hellip;\n","protected":false},"author":2,"featured_media":390863,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,209312,254,255,64,63,5004,51688,19941,38825,5044,105,209313,209314,209315],"class_list":["post-390862","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-ai-pocket-lab","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-chatgpt","tag-gpus","tag-large-language-models","tag-llms","tag-openai","tag-technology","tag-tiiny-ai","tag-tiiny-ai-has-released-a-groundbreaking-demonstration","tag-worlds-smallest-ai-supercomputer"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/390862","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=390862"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/390862\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/390863"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=390862"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=390862"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=390862"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}