← 返回日报
精读 预计 5 分钟

Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA

摘要

文章在 SWE、终端操作、算法、多语言、法律五类共约 1030 个真实 agent 任务上对比 Kimi K3(开源)与 Fable 5(闭源)。两者整体解决率相近,K3 在终端安全加密任务有 11 个独胜,Fable 在多语言上略强;oracle routing 选择 K3 处理 72-96% 任务,整体准确率达 93%,成本因 token 定价、prompt caching 及任务努力量差异最高可比单独用 Fable 低 50 倍。作者指出单一模型已不再 SoTA,建议以 K3 为默认、路由器动态选择以实现最高性价比。

荐读理由

它用 1030 个 agentic 任务的拆分基准证明 K3 在 72-96% 场景被 oracle 选中、组合路由达 93% 准确率,你在构建 agent 系统时可把 K3 设为默认、仅必要时路由 Fable,从而把成本压到单模型的 1/50 以内。

原文

Announcing our Series D and $1B ARR

Fireworks Logo

Log In

Get Started

Blog

Kimik3 Fable

Kimi K3 is competitive with Fable; Kimi K3 + Fable is SoTA.

PUBLISHED 7/21/2026

Table of Contents

  • How We Measured

  • K3 is a good model.

  • Two Models is Better than One

  • K3 can be up to 50x lower cost on Fireworks. 🫳🎤

  • Don't pick a model. Route.

  • K3 is cost optimized on all work types

  • Single Models Are Wasteful and No Longer SoTA

Why Routing Kimi K3 and Fable Outperforms the Rest

K3 is a frontier quality open model at a fraction of the cost. Even bigger is that it complements Fable predictably, which makes it possible to get the highest quality intelligence by routing tasks.

🧭 tl;dr: We ran Kimi K3 (open) against Fable 5 (closed) on ~1,000 agentic tasks finding:

  1. We achieved 93% accuracy with routing between K3 and Fable.

  2. Results were up to ~50X more cost effective than Fable alone on long agentic loops, and consistently lower cost across every use case.

How We Measured

We averaged benchmarks, each aimed at a different kind of work, and ran K3 and Fable 5 through the same harness. About 1,030 tasks in all, in real agent loops.

Family What it tests Tasks
SWE Real repo bug-fixes (SWE-bench style) 460
Terminal Long agentic ops: security, crypto, reverse-eng, sysadmin 89
Algorithmic LeetCode / AtCoder-style problems 100
Multi-Language Implementation across six languages 225
Legal A legal-agent benchmark (lawyer-graded tasks) 120

One quick definition before we get into the results. Oracle routing is a method for measuring the best theoretical performance by running the task through each model and then picking the cheapest correct option (the cost/performance ceiling). In a practical router, you don’t get to run your task against multiple models. The router makes a prediction of which model has the best cost and quality trade off, but ultimately it’s a guess.

In this study, oracle routing demonstrated K3 is selected for 72-96% of tasks. This suggests a near-perfect router might be achievable, by learning the difference between day-to-day tasks and the true long tail of frontier work. It will require an order of magnitude more routing data, and real world performance to say definitively.

K3 is a good model.

From a 10,000 foot view, it can be easy to look at both models and call the head-to-head a tie. For example, if you look at SWE, the headline benchmark, K3 gets 92.4%, Fable 92.6%. Across the five types of tasks we benchmarked on, the two models tend to stay within a few points of each other, with Fable pulling slightly ahead on its coding-language breadth (Multi-lang).

Chart of Benchmarks

Fig 1 · Task solve rate by category. Near-identical on the overall average; good at different things underneath.

It’s easy to stop there and say “they’re roughly even”. The news is that they have discretely better performance across different task types.

Two Models is Better than One

If you take a peek inside a single benchmark, there’s more to see than just a top-line accuracy number. Take SWE, where the two are dead even overall. If you split SWE by problem domain you can see where each model shines. K3 is sharpest on symbolic math and dev tooling; Fable wins on web & data visualization work. The same pattern runs through the multi-language set, where Fable's breadth carries Java, Python and C++, while K3 draws even on JavaScript and Rust.

Benchmarks for Fable and K3 that show Even the tie is jagged

Fig 2 · Point margin by SWE domain (K3 minus Fable). Tied on the benchmark as a whole, the two still specialize domain by domain.

For long-horizon work at a terminal, driving a shell and prodding at systems across dozens of turns, K3 showed its true colors. It cleared a batch of tasks Fable never cracked: a 7z hash, FEAL cryptanalysis, leaked secrets, a live vulnerability, runaway async jobs.

K3 owns the agentic terminal

Fig 3 · Of 89 terminal tasks, K3 has 11 solo wins to Fable's 7, and takes the security and crypto cluster outright.

K3 can be up to 50x lower cost on Fireworks. 🫳🎤

While quality is a near-tie at a high level, price isn't close.

Where the models really diverge is cost chart showing cost difference

Fig 4 · Cost advantage per task. Two things behind it: token pricing, and the fact that which model runs longer depends on the task.

So where's this huge price gap coming from? token pricing, prompt caching, and effort-per-task. On SWE for example, K3 works much harder than Fable: roughly 55 turns and 1.3M tokens a task versus 21 turns and 130K. On the long terminal tasks it's the other way around: Fable is the one that spirals, running up 64 turns and 1.5M tokens (sometimes straight into a timeout).

Effort is Jagged Too and it Drives Cost Chart

Fig 5 · Turns (linear) and tokens (log) per task. Neither model is leaner across the board; the extra work falls on SWE for K3 and on the terminal tasks for Fable. Note the y-axis for the tokens graph is task solve rate.

Prompt caching does most of the work of turning that effort into K3's price advantage: even when K3 reads ten times the tokens, with cache hits that means that SWE runs still come in lower cost than Fable. There’s a tradeoff. Tasks with extra turns generally mean more wall-clock time per run i.e. slower runs. If you need an answer in two seconds, that matters; if you're running agents in the background at scale, a bill that's a fraction of the size matters a lot more.

Don't pick a model. Route.

If you send every task to whoever handles it best, you don't land somewhere between the two models, you land above both.

Per-task routing always out performs any single model run:

Route the best model and you beat both chart

Fig 6 · Per-task oracle routing vs each model alone. Green tags = points gained over the best single model in that category.

The oracle router choose K3, 72-96% of task traffic. By architecting a router this way, you end up with overall quality above either model alone at a cost close to just using just the cost-optimized one.

The cost optimized model does most of the work

Fig 7 · Where an oracle router sends each task. A strong, cost optimized model like K3 becomes the default; the premium model is the exception, not the rule.

K3 is cost optimized on all work types

Put both quality and cost on one plot. K3 in blue lands to the left (the more cost-effective side) of Fable in red in all five task-families. Accuracy trades back and forth: Fable pulls ahead on multi-language, K3 on terminal and legal, the rest roughly level.

Lower Cost on every kind of work chart

Fig 8 · Cost (log scale) vs. accuracy for each family. K3 is left of Fable, lower cost in all five. The vertical gaps show which model is stronger where.

Single Models Are Wasteful and No Longer SoTA

Kimi K3 + Fable routed together unlocks their best qualities at the best price.

The single model provider, token maxxing days, are coming to an end. The task-level data says these models are specialists at very different prices. The best AI no longer comes out of a single lab, it’s a mixture of models.

What this means in practice:

  1. Open as the default. A 50x lower cost open model like K3 should be your base case, since the oracle sends it most of the traffic anyway.

  2. The router is your moat. A router must be tailored to your workload and learning that task/model split continuously is the best chance you’ll have at staying ahead.

Hacker News · 243 赞 · 125 评 讨论 → 阅读原文 →

这条对你有帮助吗?