Category narrowing to this degree really has diluted the term "SOTA" quite a lot
You mean it's state of the art for this subset of benchmarks you're targeting? No? Well surely it's state of the art for models of a certain size category? Huh, what about models that are available for local inference? O, state of the art for open models of a certain size made in the US specifically. Uh. Neat!
stewartparkyesterday at 8:36 PM
It's great to see another competitive open weight model. Congratulations!
But as is, it's probably hard to become popular amongst hobbyists and local model enthusiasts like Qwen's 27B class models or MOE models because it's a 65B dense model and inference will be prohibitively slow on consumer grade hardware, and seems like the goal/mission of the company behind this model is to automate chip design.
So if I have to assume and connect the dots, this is for the companies who want to use AI in air-gapped environments for chip design so that they protect their IPs (not leaking to third party AI labs/hostile parties) and can afford lots of server grade inference hardware for a quick unlock with the big dense model.
Neat!
wmfyesterday at 7:41 PM
Congratulations I guess but it's a pretty bad look to not even mention those other open weight models.
bluejay2387yesterday at 9:10 PM
There are several situations where some of us are explicitly prohibited from using models from companies not under the jurisdiction of the United States. It doesn't mean these models are competitive when looked at from a global view but it is also not an irrelevant differentiation.
pcweldertoday at 8:26 AM
The hosted GMI cloud model on openrouter does not invoke confidence. Ignoring 131k context length limit the tool call failure rate is not acceptable.
When asked to call 'submit_html' tool for our bench it wrote the whole page as plain reply text, then called submit_html with "This is the complete submit trigger." 4/8 tools failed.
2001zhaozhaoyesterday at 7:52 PM
This model scores 80.5 on Terminal Bench 2.1
For reference Qwen 3.8 Flash Next (which is bigger than this model but probably cheaper to run due to MoE) scores 84.3, and Qwen 3.8-27B scores 73.0.
I think this model could be competitive, depending on how much it was benchmaxxed compared to Qwen?
antoineMoPayesterday at 9:49 PM
I trained a tiny LLM earlier this year, it's fits under 10mb and it's completely useless, can I call it SOTA for my neighborhood?
syntaxingyesterday at 7:45 PM
When a post doesn’t mention Qwen for comparison, you know the performance isn’t going to be great.
a11ryesterday at 9:39 PM
I understand the desire to look the best in some self defined category. But not showing any comparison against the actual leaders in open weight renders all of the benchmarking completely information-less for the actual end users (who care about real performance comparison against the real field).
deletedtoday at 8:25 AM
namjhtoday at 5:16 AM
New model is always a good news!
However, the chart comparing the score-by-parameters with existing models is misleading, because the others are all MoE, and this model is not. The article describes it as an architectural decision to optimize against NVIDIA cards(which sounds reasonable, as US labs are relatively easy to gain access to these high-performance chips) but the chart should've been adjusted to reflect the difference, say, by using the heuristic that `effective param size ≈ sqrt(total param size * activiated param size` on MoEs.
minimaxayesterday at 9:17 PM
Agentic coding benchmarks look great.
I think we will find the market is going to move into omni multi-modal models: text, moe, agentic tasks, voice, images, and video all in one LLM.
soohamrtoday at 3:34 AM
Wasn't ricursive's sthick to automate EDA and chip design with LLMs? Why are they releasing open weight agentic coding models and benchmarking on everything but EDA and chip design?
thesnarkitechtyesterday at 9:20 PM
Speaking as someone who has High-Memory Mac Studios, it is great that there is finally a model that will run at usable speeds with high quality. In my experience, the sweet spot for Mac Clusters is around 200GB of weights, which this is far under. Congratulations to the recursive team for building an open model that will actually run!
RandyOriontoday at 3:23 AM
Nice to see another open weight model.
I cannot evaluate how valuable this model is based on the performance table alone because the comparison is kind of narrow. Waiting for third-party benchmarks to provide more information.
I do not have the hardware to run it properly without super-heavy quantization (about q2). Besides, the architecture is not optimized for local usage (sliding window attention also requires KV cache). I think I will just move on.
Not comparing to Qwen3.8 27B gives cherry-picked benchmark comparison energy. Still, Ripple-65B outscores Qwen3.8 27B, according to the reported benchmarks.
jszymborskiyesterday at 7:54 PM
Would love a 27B model. Wonder if we'll get a distillation.
Showing a terminal bench 2.1 score at the top is very misleading when terminalbench 4.0 is the current metric as a very quick glance for anything we care about for 30B to 180B size possible to locally-host models.
RGS1811yesterday at 7:42 PM
The comparison chart is befuddling.
kylehotchkisstoday at 12:19 AM
Ouh this is the size of model I want to see more of (just got a 98gb m5u studio)
kylehotchkisstoday at 12:04 AM
Ouh that fits right on a base M5U Studio! Excited to try it.
cyberaxyesterday at 9:41 PM
So the model is "meh" at best, but the cost of the training is interesting. So we can extrapolate that in 3 years the cost will be below $5m for a model like this.
It's very well within the capabilities of any reasonable organization, maybe even crowd-funded.
ltbarcly3yesterday at 11:09 PM
What is this thing where model comparisons blatantly pick other crap models and show themselves at the top left (cheap and effective)? Put all the open models, or put all the cheap models, or whatever, but just cherry picking is egregious.
oxcartctltoday at 11:44 AM
[dead]
RemingtonDaviestoday at 3:16 AM
[dead]
johnnyApplePRNGyesterday at 8:33 PM
[flagged]
6thbityesterday at 8:17 PM
I'm sorry but what is "U.S." implying here?
Is this sponsored by the us gov? did it only train on US data? does it only work on the US?