Model Review

Kimi K3 Review: What Is Real vs Vendor-Reported (Launch-Day Test)

Moonshot AI announced Kimi K3 on July 16, 2026 as the largest open-weight model unveiled to date — roughly 2.8 trillion parameters, a sparse Mixture-of-Experts design, a 1M-token context window, and a headline table showing it beating Claude Opus 4.8 and GPT-5.5. Most write-ups are republishing that same vendor table plus one arena result. We did something different: we ran K3 against our hidden-test coding harness on launch day. This review separates what is independently verified from what is vendor-reported, then adds our own first-party numbers so you can decide with clear eyes. As of July 17, 2026.

Kimi K3 review: vendor-reported, independent and first-party evidence compared

What Kimi K3 actually is

Kimi K3 is Moonshot AI's July 16, 2026 flagship, and the pitch is size. Multiple reputable outlets (Fortune, MarkTechPost, Tom's Hardware, CNBC, Simon Willison) describe it as the largest open-weight model announced so far, at roughly 2.8 trillion total parameters. Fortune printed 2.7T; 2.8T is the figure across most primary and secondary coverage, so treat it as approximately 2.8 trillion and do not over-specify.

Architecturally it is a sparse Mixture-of-Experts model that activates 16 of 896 routed experts per token, so only a fraction of those parameters fire on any given step. The attention stack is the interesting part: Moonshot calls it Kimi Delta Attention (KDA), a hybrid linear-attention scheme — linear attention for most layers with periodic full-attention layers, plus Attention Residuals — reported to deliver up to about 6.3x faster decoding at 1M context. The window is 1M tokens, and the model accepts multimodal input (text, image, video). If you have followed Moonshot's trajectory, this is the successor lineage to the models we covered in our Kimi K2.7-Code review and Kimi K2 Thinking write-up.

The headline claim, repeated everywhere, is that on Moonshot's own tests K3 beats Claude Opus 4.8 and GPT-5.5 on most benchmarks and lands just under the top two, Claude Fable 5 and GPT-5.6 Sol. That is the sentence you should slow down on, because it is vendor-reported — and this review is mostly about telling vendor claims apart from verified ones.

Vendor vs independent vs first-party

Almost every launch-day article collapses three very different kinds of evidence into one number. We keep them in separate columns. That separation is the single most useful thing you can carry out of this review.

Evidence tierWhat it claimsHow much to trust it (July 17, 2026)
Vendor-reported
(Moonshot)
Beats Opus 4.8 and GPT-5.5; under Fable 5 and GPT-5.6 Sol. Per-suite: ProgramBench 77.8, SWE Marathon 42.0, DeepSWE 67.5, FrontierSWE 81.2, Terminal-Bench 2.1 88.3, BrowseComp 91.2, GPQA-Diamond 93.5. Moonshot's own figures, not independently reproduced per-suite. Medium confidence; may shift as third parties re-run them.
Independent
(third-party)
Frontend Code Arena (blind human A/B) ranked K3 #1 at 1,679 points, ahead of Fable 5 — a jump from #18 (K2.6) to #1, ~76% average pairwise win rate, first in 6 of 7 domains. Artificial Analysis Intelligence Index v4.1 = 57, #4 of 189. Genuinely independent, but aggregate. No standalone third-party SWE-bench Verified or LiveCodeBench run exists yet.
First-party
(DataLLM Lab)
8 of 8 executed tasks passed on our hidden-test harness; ~$4 per 1,000 tasks; ~150 reasoning tokens/task; ~10–16s latency. Reproducible and run on launch day, but a small nine-task suite. High confidence within its scope.

The correction worth stating plainly: it is not true that no independent benchmarks exist. Two aggregate independent signals do — the Frontend Code Arena and the Artificial Analysis Index. What is still missing is an independent, standalone coding suite (SWE-bench Verified, LiveCodeBench) run by someone other than Moonshot. Artificial Analysis, notably, also calls K3 more expensive and more verbose than its price-tier peers, which lines up with what we saw. For the wider field, see our best open-source LLM of 2026 guide and the overall best LLM 2026 ranking.

Our launch-day executed run

Here is the part nobody else has. On K3's launch day we ran it through OpenRouter using our nine-task, generate-code-then-run-hidden-tests harness — the same one behind our 13-model coding cost benchmark.

Result: K3 passed every task that actually executed — 8 distinct tasks across two runs (two_sum, valid_parentheses, merge_intervals, roman_to_int, lcs_len, flatten, top_k_words, token_bucket), all correct. The ninth task, parse_csv_line, never completed: the day-old model was repeatedly rate-limited upstream (HTTP 429) across all retries in both runs. To be scrupulous: that is a launch-day capacity signal, not a capability miss. We are not claiming 9/9, and we are not calling the ninth a clean failure — it simply could not be evaluated.

The calibration that matters: in our 13-model benchmark, 10 of 13 models already score a perfect 9/9 on this suite. So a frontier model clearing every executable standard task is table stakes, not a headline. Do not let anyone sell you single-shot correctness on common tasks as a differentiator. The real, defensible signals from launch day are three:

Run K3 against your own tasks

K3 is live on our gateway today (OpenRouter-backed, one key, 300+ models). Point your harness at it and reproduce our numbers before you trust anyone's table — including ours.

Where K3 lands on cost

Because correctness on standard tasks is a wash across frontier models, cost is where the decision actually gets made. The chart below places our measured K3 cost against Claude Opus 4.8 and the broad field of high-scoring models from our benchmark.

Cost per 1,000 tasks — K3 sits in frontier-price territory DataLLM Lab launch-day harness. Field band is illustrative. $1 $2 $3 $4 Kimi K3 $4.37/1k Claude Opus 4.8 $4.05/1k Typical 9/9 model well under $2 (illustrative)
Chart: DataLLM Lab. K3 and Opus 4.8 costs are measured on our nine-task harness; the field band is illustrative, since 10 of 13 models score 9/9 while sitting far below $4/1k. K3 is frontier-priced, not budget.

The takeaway is uncomfortable for a hype cycle: K3 is excellent and expensive. If your workload is standard coding, you are paying frontier rates for output that cheaper models also nail. K3 earns its price on the hard tail — long-horizon agentic work and frontend generation, where the independent Arena result actually differentiates it.

Pricing, access and open weights

API pricing is $3 per 1M input, $15 per 1M output, and about $0.30 per 1M cache-hit input, flat across the full 1M context. On OpenRouter the slug is moonshotai/kimi-k3, currently served by a single provider, and reasoning_effort only supports max right now. For the full Moonshot price history and how K3 compares to earlier Kimi releases, see our Kimi API pricing guide. K3 does not have a dedicated model page on our gateway yet, so pricing and access live on our pricing page.

On open weights, be careful. Some promotional coverage phrases K3 as the largest open-weight model available today. It is not available today. The weights are a promise for July 27, 2026 under a Modified MIT license, and as of July 17 they are not downloadable. So “open” is a near-term commitment, not a fact you can build on this week. If self-hosting is your reason to care, wait for the drop and verify the license terms then.

Should you use it (a decision rule)

Here is the checklist we would actually apply:

Kimi K3 is a real and impressive release. The honest summary is narrower than the headlines: two independent signals point up, the per-suite coding numbers are still Moonshot's own, the model is frontier-priced, and the “open” label is a date on a calendar, not a download link — yet.

FAQ

Is Kimi K3 open source or open weights?

Not yet. As of July 17, 2026 the weights are not downloadable. Moonshot has promised to release them by July 27, 2026 under a Modified MIT license, so open weights are a near-term promise, not something you can act on today.

Does Kimi K3 really beat Claude Opus 4.8 and GPT-5.5?

On Moonshot's own benchmarks, yes, and it lands just under Claude Fable 5 and GPT-5.6 Sol. But those per-suite numbers are vendor-reported. The strongest independent signals are the Frontend Code Arena (blind human A/B, K3 #1 at 1,679 points ahead of Fable 5) and the Artificial Analysis Intelligence Index, which independently placed it at 57, fourth of 189.

How much does Kimi K3 cost to run?

API pricing is $3 per 1M input, $15 per 1M output, and about $0.30 per 1M cache-hit input, flat across the full 1M context. In our launch-day benchmark that came to roughly $4 per 1,000 tasks, essentially the same as Claude Opus 4.8 at about $4.05 per 1,000 tasks.

What did the DataLLM Lab launch-day test find?

Across two runs of our nine-task generate-then-run-hidden-tests harness, K3 passed all 8 tasks that actually executed. The ninth, parse_csv_line, could not be evaluated because of repeated upstream 429 rate-limiting in both runs — a launch-day capacity signal, not a capability miss.

Are there independent benchmark results for Kimi K3?

Two aggregate ones exist: the Frontend Code Arena blind ranking and the Artificial Analysis Intelligence Index of 57. What does not exist yet is an independent standalone SWE-bench Verified or LiveCodeBench third-party run, so treat the per-suite coding numbers as vendor-reported until reproduced.

Should I switch to Kimi K3 for coding today?

For everyday coding, our benchmark shows 10 of 13 models already score a perfect 9 of 9, so clearing standard tasks is table stakes. K3 is worth trying for hard, long-horizon or frontend work where the independent Arena win matters, but it is frontier-priced at about $4 per 1,000 tasks, so cheaper models may be the better default until the weights ship.

Written by
Kevin Fan

Founder of DataLLM Lab, the unified LLM gateway. Kevin tests models the boring way — same prompts, real costs, unedited outputs — and writes up what the runs actually show.

One API for every model

One API, every model.

Get a single API key for Claude Opus 4.7, GPT-5.4, and 300+ more — with automatic price comparison and routing to the best model for every request.