{"id":579377,"date":"2026-08-09T10:10:12","date_gmt":"2026-08-09T10:10:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/579377\/"},"modified":"2026-08-09T10:10:12","modified_gmt":"2026-08-09T10:10:12","slug":"pokee-ai-releases-pokee-isaac-28b-a-10m-token-context-agentic-model-built-to-run-inside-the-customer-boundary","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/579377\/","title":{"rendered":"Pokee AI Releases Pokee-Isaac 28B: A 10M-Token Context Agentic Model Built to Run Inside the Customer Boundary"},"content":{"rendered":"<p>&#13;<br \/>\n        &#13;<br \/>\n&#13;<br \/>\n        &#13;<br \/>\n&#13;<\/p>\n<p class=\"wp-block-paragraph\">Long-horizon agents accumulate context faster than they resolve tasks. Every tool output, observation, and intermediate reasoning step stays in the window, and the two capabilities that matter \u2014 holding that context and staying coherent across it \u2014 have so far been available almost exclusively from cloud endpoints. That excludes regulated industries, public-sector institutions, and on-device applications, where the data is not permitted to leave the boundary at all. Pokee AI released <a href=\"https:\/\/console.pokee.ai\/model\" rel=\"nofollow noopener\" target=\"_blank\">Pokee-Isaac 28B<\/a>, a 28B text-only foundation model with a 10M-token context window, designed to run inside that boundary. The Pokee research team claims 93.3% on RULER at 10M tokens, parity with the strongest cost-optimized cloud baselines on agentic benchmarks, and a serving profile that fits a single GPU.<\/p>\n<p>Is it deployable<\/p>\n<p class=\"wp-block-paragraph\">Yes \u2014 but licensed, not open-weight. Pokee AI serves Isaac through an OpenAI-compatible <a href=\"https:\/\/console.pokee.ai\/\" rel=\"nofollow noopener\" target=\"_blank\">developer API<\/a>, and licenses it for deployment inside a VPC, on-premises, or on-device. The launch announcement advertises Day-0 support for vLLM and SGLang, and single-GPU serving starting from an RTX 4090 or equivalent. The research team publishes measurements only from a single B200-class GPU, so treat the consumer-GPU claim as vendor guidance rather than a reported result.<\/p>\n<p>Company level: This fits organizations that already own their inference stack \u2014 mid-size and enterprise teams with a platform group, plus device OEMs. A solo practitioner without on-prem hardware should use the hosted API instead; the boundary argument only pays off if you have a boundary.<\/p>\n<p>Industries: Healthcare and payors, financial services and insurance, defense and public sector, legal and e-discovery, and pharma or semiconductor R&amp;D. The common trait is a rule that the data cannot cross an external API boundary, not a preference for privacy.<\/p>\n<p>Applications: Whole-repository code review, multi-year contract and claims analysis, incident forensics over full log archives, and long-running tool agents that never need summarization or context pruning. The research paper makes this second point explicitly: when enough usable context is available in-boundary, memory hierarchies and compression become optional rather than required.<\/p>\n<p>&#8216;+names[i]+&#8217;<\/p>\n<p>&#8216;+<br \/>\n       &#8221;+<br \/>\n       &#8216;<\/p>\n<p>$&#8217;+costs[i].toFixed(0)+&#8217;<\/p>\n<p>&#8216;;<br \/>\n  }<br \/>\n  $(&#8216;#cmBars&#8217;).innerHTML=h;<br \/>\n  requestAnimationFrame(function(){requestAnimationFrame(function(){<br \/>\n    [].forEach.call($(&#8216;#cmBars&#8217;).querySelectorAll(&#8216;.fil&#8217;),function(f){f.style.width=f.getAttribute(&#8216;data-w&#8217;)+&#8217;%&#8217;});<br \/>\n  })});<br \/>\n  var sav=costs[1]-costs[0];<br \/>\n  $(&#8216;#cmWhy&#8217;).innerHTML=&#8217;At &#8216;+vin+&#8217;M input tokens a month with &#8216;+rat+&#8217;% output, Isaac lists at $&#8217;+costs[0].toFixed(0)+<br \/>\n    &#8216; against $&#8217;+costs[1].toFixed(0)+&#8217; for GPT-5.6 Luna and $&#8217;+costs[2].toFixed(0)+&#8217; for Gemini 3.5 Flash Lite, a difference of $&#8217;+sav.toFixed(0)+<br \/>\n    &#8216; a month versus Luna. The report argues the per-token comparison still understates the gap, because Isaac is licensed to run inside the customer boundary, where cost is a fixed function of provisioned hardware rather than a variable function of tokens consumed.&#8217;;<br \/>\n}<br \/>\n$(&#8216;#cmSlide&#8217;).oninput=cm;$(&#8216;#cmRatio&#8217;).oninput=cm;<\/p>\n<p>lc();sp();ag();dt();cm();<br \/>\nfunction rz(){var h=document.getElementById(&#8216;pk&#8217;).offsetHeight+40;<br \/>\n  try{parent.postMessage({pkHeight:h},&#8217;*&#8217;)}catch(e){}}<br \/>\nsetInterval(rz,400);window.addEventListener(&#8216;load&#8217;,rz);rz();<br \/>\n})();<\/p>\n<p>&#8221; style=&#8221;width:100%;border:0;overflow:hidden;display:block&#8221; height=&#8221;600&#8243; scrolling=&#8221;no&#8221; loading=&#8221;lazy&#8221;&gt;<\/p>\n<p>Long-context results<\/p>\n<p class=\"wp-block-paragraph\">On <a href=\"https:\/\/arxiv.org\/abs\/2404.06654\" rel=\"nofollow noopener\" target=\"_blank\">RULER<\/a>, Isaac stays above 93.3% at every tested length, ending at 93.3% at 10M. GPT-5.6 Luna and Gemini 3.5 Flash Lite track it to 512K, then hit context-overflow at 1M. <\/p>\n<p class=\"wp-block-paragraph\">On <a href=\"https:\/\/arxiv.org\/abs\/2409.12640\" rel=\"nofollow noopener\" target=\"_blank\">MRCR v2<\/a> with 8 needles, Isaac scores 0.607, 0.743, and 0.500 at 256K, 512K, and 1M. Its margin over Gemini widens from 0.133 to 0.295 across that sweep. <\/p>\n<p>Agentic and security results<\/p>\n<p class=\"wp-block-paragraph\">Isaac leads <a href=\"https:\/\/gorilla.cs.berkeley.edu\/leaderboard.html\" rel=\"nofollow noopener\" target=\"_blank\">BFCL v4<\/a> at 70.94 against Luna\u2019s 70.61. The report calls that parity rather than a lead, which is the correct read. On <a href=\"https:\/\/github.com\/sierra-research\/tau2-bench\" rel=\"nofollow noopener\" target=\"_blank\">\u03c4\u00b3-bench<\/a> it averages 0.662 across four domains, ahead of Gemini\u2019s 0.631, with banking at 0.186 for everyone\u2019s difficulty. On <a href=\"https:\/\/arxiv.org\/abs\/2602.00933\" rel=\"nofollow noopener\" target=\"_blank\">MCP-Atlas<\/a> it places third at 74.59% coverage, but uses 9.10 turns per task against Gemini\u2019s 14.99. On <a href=\"https:\/\/arxiv.org\/abs\/2601.11868\" rel=\"nofollow noopener\" target=\"_blank\">Terminal-Bench 2.1<\/a> it resolves 56 of 86 text-compatible tasks (65.1%), behind Luna\u2019s 60. That is the one benchmark a cloud baseline wins, and the report states it plainly.<\/p>\n<p class=\"wp-block-paragraph\">On <a href=\"https:\/\/arxiv.org\/abs\/2605.04808\" rel=\"nofollow noopener\" target=\"_blank\">DTAP<\/a> red-teaming, Isaac records the lowest direct (36.0), indirect (35.2), and combined (35.6) attack success rates, with 82.5 benign success. One condition differs: baselines ran under the stock runner, Isaac under the Pokee harness.<\/p>\n<p>Efficiency, pricing, and portability<\/p>\n<p class=\"wp-block-paragraph\">Under the RULER workload on one B200-class GPU, TTFT is 23.6s at 1M and 72.9s at 10M. Prefill throughput rises with context, from 42,400 to 137,200 tokens\/s, so a ten-fold longer prompt costs roughly three times the TTFT. List pricing is $0.15\/$1.00 per million input\/output tokens, marked provisional. Isaac also runs fully on-device on Intel Arc Pro B70 and Core Ultra Series 3 (Panther Lake), and on Qualcomm Snapdragon X2 Elite. <\/p>\n<p>Key Takeaways<\/p>\n<p>Pokee-Isaac 28B scores 93.3% on RULER at 10M tokens; every baseline in its panel returns 0.0 beyond 2M.<\/p>\n<p>Prefill reaches 137,200 tokens\/s at 10M context on one B200; decode holds flat near 335 tokens\/s.<\/p>\n<p>It leads BFCL v4 (70.94) and \u03c4\u00b3-bench (0.662 avg), places second on Terminal-Bench 2.1, third on MCP-Atlas.<\/p>\n<p>Lowest combined attack success rate on DTAP (35.6) while keeping 82.5 benign task success.<\/p>\n<p>Weights are not published; deployment is licensed into VPC, on-premises, or on-device.<\/p>\n<p class=\"wp-block-paragraph\">Check out the\u00a0<a href=\"https:\/\/console.pokee.ai\/model\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Blog<\/a> and <a href=\"https:\/\/console.pokee.ai\/pokee-isaac-28b-v0-technical-report.pdf\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Paper<\/a>.\u00a0Also,\u00a0feel free to follow us on\u00a0<a href=\"https:\/\/x.com\/intent\/follow?screen_name=marktechpost\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Twitter<\/a>\u00a0and don\u2019t forget to join our\u00a0<a href=\"https:\/\/www.reddit.com\/r\/machinelearningnews\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">150k+ML SubReddit<\/a>\u00a0and Subscribe to\u00a0<a href=\"https:\/\/www.aidevsignals.com\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">our Newsletter<\/a>. Wait! are you on telegram?\u00a0<a href=\"https:\/\/t.me\/machinelearningresearchnews\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">now you can join us on telegram as well.<\/a><\/p>\n<p class=\"wp-block-paragraph\">Need to partner with us for promoting your GitHub Repo OR Hugging Face Page OR Product Release OR Webinar etc.?\u00a0<a href=\"https:\/\/forms.gle\/wbash1wF6efRj8G58\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Connect with us<\/a><\/p>\n<p><a class=\"m-a-box-avatar-url\" href=\"https:\/\/www.marktechpost.com\/author\/michal-sutter\/\" rel=\"nofollow noopener\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" width=\"150\" height=\"150\" src=\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/08\/a-professional-linkedin-headshot-photogr_0jcmb0R9Sv6nW5XK-zkPHw_uARV5VW1ST6osLNlunoVWg-150x150.png\" class=\"attachment-150x150 size-150x150\" alt=\"\" itemprop=\"image\"   data-attachment-id=\"72715\" data-permalink=\"https:\/\/www.marktechpost.com\/a-professional-linkedin-headshot-photogr_0jcmb0r9sv6nw5xk-zkphw_uarv5vw1st6oslnlunovwg\/\" data-orig-file=\"https:\/\/www.marktechpost.com\/wp-content\/uploads\/2025\/07\/a-professional-linkedin-headshot-photogr_0jcmb0R9Sv6nW5XK-zkPHw_uARV5VW1ST6osLNlunoVWg.png\" data-orig-size=\"832,960\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}\" data-image-title=\"a-professional-linkedin-headshot-photogr_0jcmb0R9Sv6nW5XK-zkPHw_uARV5VW1ST6osLNlunoVWg\" data-image-description=\"\" data-image-caption=\"\" data-large-file=\"https:\/\/www.marktechpost.com\/wp-content\/uploads\/2025\/07\/a-professional-linkedin-headshot-photogr_0jcmb0R9Sv6nW5XK-zkPHw_uARV5VW1ST6osLNlunoVWg.png\"\/><\/a><\/p>\n<p>Michal Sutter is a data science professional with a Master of Science in Data Science from the University of Padova. With a solid foundation in statistical analysis, machine learning, and data engineering, Michal excels at transforming complex datasets into actionable insights.<\/p>\n","protected":false},"excerpt":{"rendered":"&#13; &#13; &#13; &#13; &#13; Long-horizon agents accumulate context faster than they resolve tasks. Every tool output, observation,&hellip;\n","protected":false},"author":2,"featured_media":579378,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,85,46,125],"class_list":["post-579377","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-il","tag-israel","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/579377","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=579377"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/579377\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/579378"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=579377"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=579377"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=579377"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}