{"id":639675,"date":"2026-10-08T01:32:08","date_gmt":"2026-10-08T01:32:08","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/639675\/"},"modified":"2026-10-08T01:32:08","modified_gmt":"2026-10-08T01:32:08","slug":"after-tokenmaxxing-backlash-microsoft-moves-more-agent-work-onto-the-desk","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/639675\/","title":{"rendered":"After tokenmaxxing backlash, Microsoft moves more agent work onto the desk"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-83502\" class=\"wp-image-83502 size-full\" src=\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/10\/decode.png\" alt=\"Microsoft's local MAI-Code-1.1-Flash generates roughly 60 tokens per second with short prompts on Surface Laptop Ultra, versus just under 40 at a 256K-token prompt. The figures come from Microsoft's testing on a synthetic code-generation workload. Image: Microsoft\" width=\"770\" height=\"513\"  \/><\/p>\n<p id=\"caption-attachment-83502\" class=\"wp-caption-text\">Microsoft\u2019s local MAI-Code-1.1-Flash generates roughly 60 tokens per second with short prompts on Surface Laptop Ultra, versus just under 40 at a 256K-token prompt. The figures come from Microsoft\u2019s testing on a synthetic code-generation workload. Image: Microsoft<\/p>\n<p>2026 saw the rise, and quick fall, of tokenmaxxing, the practice of enterprise companies treating AI spend volume as a yardstick for productivity. This summer, Microsoft put its divisions on AI token budgets and told engineers that \u201c<a href=\"https:\/\/www.404media.co\/microsoft-tells-engineers-tokenmaxxing-is-not-what-we-are-optimizing-for\/\" rel=\"nofollow noopener\" target=\"_blank\">tokenmaxxing is not what we are optimizing for.<\/a>\u201d<\/p>\n<p>Now, in its<a href=\"https:\/\/blogs.windows.com\/windowsexperience\/2026\/10\/07\/building-windows-for-hybrid-intelligence\/\" rel=\"nofollow noopener\" target=\"_blank\"> Oct. 7 announcements<\/a>, it offered customers a way to avoid the same sticker shock by moving more of the agents\u2019 work onto the PC. It imagines always-on mini PCs running agents, and shared Nvidia DGX Stations, desk-side AI workstations, serving 32 or more people at once. The cloud stays available for work that needs it.<\/p>\n<p>Coding is an early test of Microsoft\u2019s proposition. The company is bringing its<a href=\"https:\/\/commandline.microsoft.com\/local-models-sandboxed-tools-github-windows\/\" rel=\"nofollow noopener\" target=\"_blank\"> MAI-Code-1.1-Flash<\/a> model to local coding workflows, where an agent can write code, run tests and revise its work through repeated model calls. Running those calls locally removes a per-inference charge.<\/p>\n<p>The catch with local inference has been capability: models small enough to fit in a few dozen gigabytes have generally trailed hosted models on serious coding work. Microsoft\u2019s numbers suggest that gap is narrowing.<\/p>\n<p>In Microsoft\u2019s testing, the on-device version of MAI-Code-1.1-Flash resolved 70.8% of tasks on SWE-bench Verified, a benchmark built from GitHub issues, compared with 72.6% for its higher-precision cloud variant. The quantized model occupies about 53GB, with peak memory use reaching 75.5GB at its full 256K-token context. Microsoft compared it against another open model, a quantized version of OpenAI\u2019s gpt-oss-120b, rather than frontier models.<\/p>\n<p>Microsoft\u2019s new<a href=\"https:\/\/blogs.windows.com\/devices\/2026\/10\/07\/pre-order-our-most-powerful-surface-devices-ever\/\" rel=\"nofollow noopener\" target=\"_blank\"> Surface Laptop Ultra<\/a> uses Nvidia RTX Spark hardware and offers up to 128GB of shared memory. Preorders opened Wednesday at a starting price of $2,599, with availability scheduled for Oct. 16.<\/p>\n<p>GitHub\u2019s HydraFusion is designed to route work between local and cloud models within a coding session, with an experimental preview due later this month in the GitHub Copilot app, GitHub Copilot CLI and Visual Studio Code. The intent is for the laptop to handle the repetitive loop of edits and test runs, while larger models remain on call for harder problems. Developers can also select the local model explicitly.<\/p>\n<p>A coding agent left to keep trying also needs limits on what it can touch. Microsoft made its<a href=\"https:\/\/blogs.windows.com\/windowsdeveloper\/2026\/10\/07\/microsoft-execution-containers-policy-driven-containment-for-ai-agents\/\" rel=\"nofollow noopener\" target=\"_blank\"> Execution Containers<\/a> generally available Wednesday, providing policy-driven containment for local agent processes. Entra attribution and Agent 365 and Intune controls for local agents remain forthcoming; microVM isolation is experimental. And local inference does not make an entire session offline: remote tools and separate cloud requests can still send work beyond the PC.<\/p>\n<p>Apple already has a claim on the desk Microsoft wants to occupy. Its<a href=\"https:\/\/www.apple.com\/newsroom\/2026\/08\/apple-introduces-new-mac-studio-with-m5-max-and-m5-ultra\/\" rel=\"nofollow noopener\" target=\"_blank\"> M5 Ultra Mac Studio<\/a> began reaching customers in September, while a version with 512GB of unified memory is promised for late October.<\/p>\n","protected":false},"excerpt":{"rendered":"Microsoft\u2019s local MAI-Code-1.1-Flash generates roughly 60 tokens per second with short prompts on Surface Laptop Ultra, versus just&hellip;\n","protected":false},"author":2,"featured_media":639676,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[184338,288465,11714,25242,2675,288466,288467,85,46,288468,288469,288470,134,288471,288472,288473,67315,125,188635],"class_list":["post-639675","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-ai-coding-agents","tag-ai-token-budget","tag-code-generation","tag-copilot","tag-edge-ai","tag-execution-containers","tag-hydrafusion","tag-il","tag-israel","tag-local-ai-coding","tag-local-llms","tag-mai-code-1-1-flash","tag-microsoft","tag-nvidia-rtx-spark","tag-on-device-inference","tag-surface-laptop-ultra","tag-swe-bench","tag-technology","tag-tokenmaxxing"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/639675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=639675"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/639675\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/639676"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=639675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=639675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=639675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}