{"id":572571,"date":"2026-08-03T01:18:18","date_gmt":"2026-08-03T01:18:18","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/572571\/"},"modified":"2026-08-03T01:18:18","modified_gmt":"2026-08-03T01:18:18","slug":"latest-open-artifacts-23-laguna-s2-1-inkling-kimi-k3-show-the-utility-of-open-models-on-the-pareto-frontier","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/572571\/","title":{"rendered":"Latest open artifacts (#23): Laguna S2.1, Inkling, & Kimi K3 show the utility of open models on the Pareto frontier"},"content":{"rendered":"

Consolidation has been one of the paths that many astute observers predicted for the near-future of labs training models. It was labelled as inevitable, as training costs are increasing by orders of magnitude every year. Yet, as someone who in 2024 would\u2019ve predicted consolidation really picking up come 2026 or 2027, where are we? We\u2019re at a place where more companies are training strong models \u2014 easily investing hundreds of millions to billions of dollars in the total effort still \u2014 and an increasing number of organizations are releasing these models openly.<\/p>\n

The demand for tokens is incredibly high, and likely to increase as models get more efficient and unlock more possible use cases. All of these labs we thought would need to consolidate are realizing that building token machines is a likely path to value, and more companies will identify that source of value over time. <\/p>\n

The prime example is Thinking Machines \u2014 when they announced their company in February 2025, very few people would\u2019ve put them in the bucket of an open models company, myself included. Now their open model finetuning service is making hundreds of millions in revenue per year and they\u2019re releasing the best open-weight models built in the U.S.A. \u2014 ahead of the early leaders in NVIDIA with Nemotron and Arcee\u2019s Trilogy. <\/p>\n

Share<\/a><\/p>\n

On the other side of the ecosystem is the sustained pace from the Chinese labs, with newer entrants like Xiaomi still accumulating mindshare in the broader AI economy. Having predicted consolidation for a long time, it now seems like a safer bet is to predict continued adoption, and try to imagine the role that open models play there. How much can revenue-share licenses like Kimi K3 stick? How much market share can open models take? We\u2019re entering the decisive era. <\/p>\n

This is one of the most packed recaps of open models we\u2019ve ever had, we\u2019re excited!<\/p>\n

Inkling<\/a> by thinkingmachines<\/a>: The first model from Thinking Machines is a 975B-A41B multimodal MoE that supports text, images, and audio as inputs and produces text as output. While it is not the strongest model among peers (in China) in its size class, it is positioned to be a great base for fine-tuning, e.g., through their commercial offering, Tinker. They also release a smaller version<\/a> (276B-A12B), which is really competitive for its size.<\/p>\n

Hy3<\/a> by tencent<\/a>: A 295B-A21B MoE from Tencent. It improves over its predecessor across all metrics. Most notable, however, is the license change: While the previous version (covered in Artifacts 21<\/a>) used a custom and rather restrictive license, Tencent switched to Apache\u202f2 for this release. The model was also able to proof a 50 year old math problem<\/a> (with a dedicated harness and Sol as a judge, although it is unclear how important the latter really is).<\/p>\n

\"\"<\/a><\/p>\n

Laguna-S-2.1<\/a> by poolside<\/a>: Poolside quickly rose out of nowhere to become a frequent guest at Artifacts, marking its third appearance in three consecutive months. S2.1 is a newly pre- and post-trained version of the 118B-A8B MoE that fits on a DGX Spark, which brought it a lot of attention. Poolside also adopted the OpenMDW license, which is an Apache 2.0-like free license but has better legal backing for AI models specifically. The company also goes into more detail in its blog<\/a>, which includes all the evaluation trajectories<\/a>. This is a lot of transparency for an open model release!<\/p>\n

DeepSeek-V4-Flash-0731<\/a> by deepseek-ai<\/a>: Just one day after OpenAI has dropped the prices of their smallest model by 80%<\/a>, the whale dropped an update to their V4 Flash model, beating Luna at the pareto frontier. The bigger model is not updated yet, so it remains to be seen where it will land in terms of performance. For the initial V4 releases, the Flash version was the star of the show in terms of performance per parameter, while Pro was rather underwhelming.<\/a><\/p>\n

\"\"<\/a><\/p>\n

Kimi-K3<\/a> by moonshotai<\/a>: This is the biggest open model release in some time, and we covered it in a separate post<\/a> and a podcast episode<\/a>. It was released under a noncommercial license, requiring inference and fine-tuning providers to enter into a commercial agreement. Kevin Xu and Graham Webster argue in a post<\/a> that these licenses enable potential future government action against US entities doing business with Chinese AI companies:<\/p>\n

But if a US company needs a contract with Moonshot to provide the inference tokens that Kimi K3 generates, the picture looks different. Some of the policy tools US officials and others have debated as potential levers to restrict Chinese open model use would more clearly apply.<\/p>\n

LongCat-2.0<\/a> by meituan-longcat<\/a>: The Chinese DoorDash is back again. This time, the company released another big MoE with 1.6T parameters. While the model itself is not the most capable for its size beyond benchmarks, it was trained entirely on Ascend 910s, making it the first non-Huawei, non-toy model trained entirely on Chinese accelerators. Other Chinese chips are mostly used for inference (if at all).<\/p>\n

Laguna-XS-2.1<\/a> by poolside<\/a>: An update to the small (33B-A3B) MoE from Poolside.<\/p>\n

Motif-3-Beta<\/a> by Motif-Technologies<\/a>: A preview of a 314B-A13B MoE by the Korean Motif. This is by far the company\u2019s most ambitious model, as it is considerably larger and introduces some architectural innovations like GDLA and mHC.<\/p>\n

Apertus-v1.5-70B<\/a> by swiss-ai<\/a>: A continued pre-train of the fully open-source Apertus 1.0, using 2T more tokens.<\/p>\n

Instella-MoE-16B-A3B-Think<\/a> by amd<\/a>: A 16B-A3B MoE trained by AMD on Instinct cards. AMD also provides all the different stages, from the base<\/a> to the SFT<\/a> checkpoints, as well as MidTrain<\/a> and DPO<\/a>.<\/p>\n

\"Instella-MoE<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Consolidation has been one of the paths that many astute observers predicted for the near-future of labs training…\n","protected":false},"author":2,"featured_media":572572,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[345,343,344,85,46,125],"class_list":["post-572571","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-il","tag-israel","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/572571","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=572571"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/572571\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/572572"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=572571"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=572571"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=572571"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}