{"id":63794,"date":"2025-10-09T14:39:08","date_gmt":"2025-10-09T14:39:08","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/63794\/"},"modified":"2025-10-09T14:39:08","modified_gmt":"2025-10-09T14:39:08","slug":"tiny-ai-model-outperforms-o3%e2%80%91mini-and-gemini-2-5-pro-in-arc%e2%80%91agi-benchmark","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/63794\/","title":{"rendered":"Tiny AI model outperforms o3\u2011mini and Gemini\u202f2.5\u202fPro in ARC\u2011AGI benchmark"},"content":{"rendered":"


\n \"summary\"
\n Summary
\n <\/a><\/p>\n

A new mini-model called TRM shows that recursive reasoning with tiny networks can outperform large language models on tasks like Sudoku and the ARC-AGI test – using only a fraction of the compute power.<\/p>\n

Researchers at Samsung SAIL Montreal introduced the “Tiny Recursive Model” (TRM), a compact design that outperforms large models such as o3-mini and Gemini 2.5 Pro on complex reasoning tasks, despite having just seven million parameters. By comparison, the smallest language models typically range from 3 to 7 billion parameters.<\/p>\n

According to the study “Less is More: Recursive Reasoning with Tiny Networks,”\u00a0TRM reaches 45 percent on ARC-AGI-1<\/a> and 8 percent on ARC-AGI-2<\/a>, outperforming much larger models including o3-mini-high (3.0 percent on ARC-AGI-2), Gemini 2.5 Pro (4.9 percent), DeepSeek R1 (1.3 percent), and Claude 3.7 (0.7 percent). The authors say TRM achieves this with less than 0.01 percent of the parameters used in most large models. More specialized systems such as Grok-4-thinking (16.0 percent) and Grok-4-Heavy (29.4 percent) still lead the pack.<\/p>\n

In other benchmarks, TRM boosted test accuracy on Sudoku-Extreme from 55.0 to 87.4 percent and on Maze-Hard from 74.5 to 85.3 percent compared to the “Hierarchical Reasoning Model”<\/a> that inspired its design.<\/p>\n

Ad<\/p>\n

THE DECODER Newsletter<\/p>\n

The most important AI news straight to your inbox.<\/p>\n

\u2713 Weekly<\/p>\n

\u2713 Free<\/p>\n

\u2713 Cancel at any time<\/p>\n

Small model, big impact<\/p>\n

TRM functions like a tight, repeating correction loop. It maintains two pieces of short-term memory: the current solution (“y”) and a sort of scratchpad for intermediate steps (“z”). At each stage, the model updates this scratchpad by reviewing the task, its current solution, and its prior notes, then produces an improved output based on that information.<\/p>\n

This loop runs multiple times, gradually refining earlier mistakes without requiring a massive model or lengthy chains of reasoning. The researchers say a small network with only a few million parameters is enough to make this process work.<\/p>\n

During training, TRM receives step-by-step feedback and learns to estimate a stop probability, preventing unnecessary iterations. Depending on the task, it uses either simple MLPs (for fixed-size grids like Sudoku) or self-attention (for larger structures such as ARC-AGI).<\/p>\n

What the results do – and don’t – mean<\/p>\n

TRM demonstrates that small, targeted models can be extremely efficient on narrow, structured reasoning tasks. It improves its answers incrementally and benefits greatly from data augmentation. The paper also emphasizes that architecture choices – such as preferring MLPs over attention for smaller grids – depend on the dataset, and TRM consistently beats larger general-purpose systems in those scenarios.<\/p>\n

However, the findings don’t imply that large language models are obsolete as a path toward more general capabilities. TRM operates within well-defined grid problems and it isn’t suited for open-ended, text-based, or multimodal tasks since it\u2019s not a generative system.<\/p>\n

Recommendation<\/p>\n

<\/p>\n

\t\t\t<\/p>\n

\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"Wait
\n\t\t\t\t\t\t\t<\/a><\/p>\n

\t\t\t<\/p>\n

\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"Wait
\n\t\t\t\t\t\t\t<\/a><\/p>\n

Instead, it represents a promising building block for reasoning tasks, not a replacement for transformer-based language models. Further experiments adapting TRM to new domains are already underway and could expand its potential applications.<\/p>\n

Independent replication and tests using the private ARC-AGI datasets from the ARC Institute are still pending.<\/p>\n","protected":false},"excerpt":{"rendered":"Summary A new mini-model called TRM shows that recursive reasoning with tiny networks can outperform large language models…\n","protected":false},"author":2,"featured_media":63795,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[12918,46828,46829,85,46,125],"class_list":["post-63794","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-ai-training","tag-arc","tag-arc-agi","tag-il","tag-israel","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/63794","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=63794"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/63794\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/63795"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=63794"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=63794"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=63794"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}