Too bad you probably need something like an 8x B300 node to run this. Black Friday is coming soon though, but I fear this open intelligence will be pacing anyone's liquidity frontier so I'll probably keep trailing the frontier for a while with nvidia/qwen3.8-27B-NVFP4 on dual RTX PRO 4000 in TP=2. I can almost fit 450k context in there.
dmckinnotoday at 6:31 PM
Lots of chatter about how this model is benchmaxxed, but didn’t observe this in our testing.
Very strong open model release that is a bit off the frontier but totally amazing for most use-cases.
Doesn't seem to outpace DeepSeekV4.1-Flash by much. Hy4 also announced their models and they have tons of internal benchmark, and K3.1 doesn't score that high on those benchmarks whereas Opus5.5 does, so it seems K3.1 is benchmaxxed.
Together appears to have double throughput of the Moonshot AI endpoint at the same price point (with Modal having double that throughput), so I suspect there is room for inference providers to optimize...and therefore headroom to cut costs for competition.
speedpingtoday at 6:29 PM
Even if you can’t run this at home, this is still a step toward commoditization & diversification of inference and breaking up of concentrated power.
Being able to serve a frontier-class model with 1M$ of capital in GPUs instead of multi-year billion dollar investment in training & research is a big difference
purplemantistoday at 6:24 PM
3T parameters! I've been really impressed with Kimi's coding performance. It's replaced a lot of my Claude Code workflows, which just got way too expensive. Wonder how big Fable and Opus are in comparison.
lacooljtoday at 6:30 PM
I love this
But i also get the immediate "but how is anyone supposed to run this locally" feeling
Maybe we need a new network. Like, Nextdoor + counterstrike pub servers, but for local LLM. We can call it semilocal
:)
throwa356262today at 6:01 PM
These releases are meant for companies, not average Joe:
Now let's see this on some abliterated APIs. I'm sick and tired of Claude standing guard for copyright after Anthropic stole everything there was to steal and got away with it.
kmaiitoday at 7:01 PM
[dead]
tgtweaktoday at 5:11 PM
If someone released a 0.1bit quant I can run it. /s