Model Review

Kimi K2 Thinking: Specs, Benchmarks (and the Cost Number Nobody Publishes)

Kimi K2 Thinking is Moonshot AI open-weights reasoning model: a 1-trillion-parameter Mixture-of-Experts with 32B active parameters, a 256K context window, and a Modified MIT license. But there are now several Kimi releases with confusingly similar names, and the benchmark that actually matters — cost per completed task — is one no vendor publishes. Here is what is real, what is vendor-reported, and one first-party number that puts Kimi on a same-tasks cost ladder against Claude, GPT, and DeepSeek.

Executed cost-per-1000-tasks ladder for Kimi K2.7-Code against Claude, GPT, DeepSeek and GLM

What Kimi K2 Thinking actually is

Kimi K2 Thinking is the reasoning and agentic variant of Moonshot AI open-weights K2 model family. According to its Hugging Face model card, it is a Mixture-of-Experts network with 1 trillion total parameters and 32 billion active per token — 384 experts, 8 selected plus 1 shared, 61 layers, MLA attention, and a 160k vocabulary. The context window is 256K tokens.

Two things make it interesting for builders. First, it ships with native INT4 quantization via Quantization-Aware Training, which Moonshot says roughly doubles generation speed with lossless quality. Second, it is released under a Modified MIT License with open weights on Hugging Face and an API at platform.moonshot.ai that exposes OpenAI- and Anthropic-compatible endpoints. In other words, you can self-host it or hit it through a gateway without rewriting your client.

The design intent is long agentic tool-calling chains — the kind of workload where a model plans, calls tools, reads results, and keeps going for dozens of steps. That framing matters when you read its benchmarks, because most of its best numbers are reported with tools enabled.

The naming trap: Thinking vs K2.7-Code

Before any benchmark makes sense, you have to untangle the names. Moonshot has shipped roughly five K2 releases in under a year, and the search-popular ones do not share numbers.

This is the single biggest source of misinformation about Kimi right now. The SWE-bench 71.3 figure belongs to K2 Thinking. The executed-cost datapoint later in this article belongs to K2.7-Code. Mixing them is how you end up quoting a coding score for the wrong model. We keep them labeled throughout.

Skip the naming headache — one key, both models

DataLLM Lab is an OpenAI-compatible gateway with 300+ models, including the Kimi releases, DeepSeek, Claude, and GPT, on a single API key. Swap models with one string change and compare them on your own tasks.

Specs and vendor benchmarks

Here are the core specs alongside Moonshot own reported benchmark figures for K2 Thinking. Everything in the benchmark rows is vendor-reported — Moonshot self-published, mostly with tools enabled — so read it as a capability signal, not an independent ranking.

AttributeKimi K2 ThinkingKimi K2.7-CodeSource type
Total / active params1T / 32B MoE1T / 32B MoEHugging Face
Context window256K256KHugging Face
QuantizationNative INT4 (QAT)Hugging Face
LicenseModified MITModified MITHugging Face
ReleasedK2 familyJun 12, 2026Vendor coverage
HLE (with tools)44.9n/aVendor-reported
SWE-bench Verified (tools)71.3vendor-reported at launchVendor-reported
LiveCodeBench V683.1vendor-reported at launchVendor-reported
GPQA84.5vendor-reported at launchVendor-reported
AA Intelligence Index (est.)4142Artificial Analysis

Independent tracker Artificial Analysis places K2 Thinking at 41 on its current Intelligence Index — above the roughly 30 open-weights average, and it registered 67 at its November launch on the prior scale — but flags a real cost hazard: it is unusually verbose. It burned about 100M tokens to complete the index, among the most Artificial Analysis has recorded and roughly 2.5x the average model. That matters because a low per-token price can still produce a high per-task bill if the model writes far more tokens. Headline pricing hides this; executed-cost benchmarks do not.

K2.7-Code, by contrast, leaned at launch on Moonshot-proprietary benchmarks: Kimi Code Bench v2 62.0 (vs 50.9 for K2.6), Program Bench 53.6, and MLS Bench Lite 35.1, plus a claim of roughly 30% fewer reasoning tokens than K2.6. Those launch figures cannot be reproduced or compared to SWE-bench, so we do not rank on them; independent Intelligence Index and public-suite numbers have only appeared since. For a broader view of open models, see our best open-source LLM 2026 roundup.

The cost number nobody publishes

Every outlet reports either Moonshot proprietary benchmarks or generic vendor SWE-bench numbers. Nobody puts Kimi on a same-tasks, actually-executed cost ladder against closed frontier models. That is the gap the DataLLM Lab first-party benchmark fills.

In July 2026 we ran 13 models against 9 tasks where each model must generate code, then have it pass hidden tests. Cost is measured in real dollars per 1,000 tasks; latency is average seconds per task. Kimi K2.7-Code scored a perfect 9/9 at $1.34 per 1,000 tasks and 10.4s per task — squarely mid-pack.

Cost per 1,000 tasks — all models below scored 9/9 DataLLM Lab executed benchmark, July 2026 (USD, log-ish scale) Qwen3 Coder Next $0.10 DeepSeek V4-Flash $0.13 Mistral Medium 3.5 $0.87 Kimi K2.7-Code $1.34 Claude Sonnet 5 $1.67 GLM 5.2 $1.99 Claude Opus 4.8 $4.05 GPT-5.5 $8.83 Bars illustrative to scale. 10 of 13 models scored a perfect 9/9 — an 88x cost spread for identical quality. Chart: DataLLM Lab
Kimi K2.7-Code (highlighted) lands between Mistral Medium 3.5 and Claude Sonnet 5 — about 3x cheaper than Claude Opus 4.8 and ~6.6x cheaper than GPT-5.5 at the same 9/9, while being open-weight. Chart: DataLLM Lab.

The headline is not Kimi rank — it is that 10 of 13 models scored a perfect 9/9. Quality has converged on standard coding tasks, so the decision variable is no longer the leaderboard; it is cost per completed task, where the spread is 88x for the same result. Full methodology is in our LLM coding cost benchmark.

Where it sits: DeepSeek, GLM, Claude

On the open-weights reasoning/coding landscape, Kimi K2, DeepSeek V4, and GLM sit within a few points of one another on composite trackers. On the current Artificial Analysis Intelligence Index, K2.6 registers 44, with DeepSeek V4 and GLM close behind, and all three land near 80% on vendor SWE-bench Verified. These are directional, secondary-source numbers — treat them as a cluster, not a precise order.

The differences are practical, not on the scoreboard: Kimi is often favored for single-shot, hard tickets; DeepSeek for long-horizon agentic runs and the cheapest API coding. If you are weighing those two directly, our Kimi vs DeepSeek comparison goes deeper, and DeepSeek vs Claude covers the open-versus-frontier tradeoff. For token pricing specifics, see Kimi API pricing.

On pricing as of July 2026: Moonshot-direct K2 Thinking runs about $0.60 per 1M input and $2.50 per 1M output. K2.7-Code is higher — observed reseller rates are roughly $1.10 input and $4.80 output. All of this is provider-dependent and moving fast, so state it qualitatively and re-check before you commit.

A decision rule for picking Kimi

Given quality convergence, here is a simple rule that survives the next Moonshot release:

Because Moonshot ships fast, do not memorize a score. Memorize the framing: benchmarks have saturated on standard tasks, so measure cost per completed task on your workload before choosing.

FAQ

What is Kimi K2 Thinking?

Kimi K2 Thinking is Moonshot AI open-weights reasoning variant of the K2 family — a 1-trillion-parameter Mixture-of-Experts with 32B active parameters, a 256K context window, native INT4 quantization, and a Modified MIT license, built for long agentic tool-calling chains and available with open weights on Hugging Face.

How is Kimi K2 Thinking different from K2.7-Code?

They are different releases. K2 Thinking is the reasoning and agentic variant with published public-suite scores such as SWE-bench Verified 71.3 (vendor-reported, with tools). K2.7-Code shipped June 12, 2026 as a newer coding-focused release whose headline numbers at launch were Moonshot-proprietary benchmarks, with independent public-suite results only appearing afterward. Do not attribute one release scores to the other.

How much does Kimi K2 Thinking cost to run?

As of July 2026, Moonshot-direct pricing for K2 Thinking is roughly $0.60 per 1M input tokens and $2.50 per 1M output. The newer K2.7-Code runs higher, around $1.10 input and $4.80 output per 1M at observed reseller rates. Pricing is provider-dependent and changes often, so treat these as directional and dated.

Are Kimi K2 benchmark scores independently verified?

Partly. K2 Thinking has vendor-reported public-suite scores plus an independent Artificial Analysis Intelligence Index placement of 41 (estimated on the current scale; 67 at its November launch on the prior scale). K2.7-Code launched with headline gains on Moonshot-proprietary benchmarks (Kimi Code Bench v2, Program Bench, MLS Bench Lite); an independent AA placement of 42 and public-suite numbers appeared only afterward, so treat the launch figures as vendor-reported.

How does Kimi K2 compare to DeepSeek and GLM?

On composite trackers they sit within a few points of one another — on the current Artificial Analysis Intelligence Index K2.6 registers 44, with DeepSeek V4 and GLM close behind — and all three land near 80% on vendor SWE-bench Verified. Differences are practical: Kimi is often favored for single-shot hard tickets, DeepSeek for long-horizon agentic work and cheapest API coding.

What did the DataLLM Lab benchmark find for Kimi?

In the DataLLM Lab first-party executed benchmark (July 2026, 13 models, 9 generate-then-run-hidden-tests tasks), Kimi K2.7-Code scored a perfect 9/9 at $1.34 per 1,000 tasks and 10.4 seconds per task — mid-pack on cost. Ten of thirteen models hit 9/9, meaning quality has converged and the real spread is 88x in cost for identical results.

Written by
Kevin Fan

Founder of DataLLM Lab, the unified LLM gateway. Kevin tests models the boring way — same prompts, real costs, unedited outputs — and writes up what the runs actually show.

One API for every model

One API, every model.

Get a single API key for Claude Opus 4.7, GPT-5.4, and 300+ more — with automatic price comparison and routing to the best model for every request.