返回全部资讯
Kimi 博客 (月之暗面)T1·基座大模型

Kimi K2 发布:多项基准超越主流模型

原标题:Kimi K2
85AI 研判分

月之暗面发布 Kimi K2-Instruct 模型,在代码生成、智能体工具使用及复杂推理等关键基准测试中表现卓越。数据显示其性能匹敌甚至超越 DeepSeek-V3、Claude Sonnet 4 及 GPT-4.1 等主流开源与闭源模型,尤其在 SWE-bench Verified 和 LiveCodeBench 上取得显著突破。

报道正文

下表详细列出了 Kimi-K2-Instruct 的性能表现,显示其在多种任务上均能与最新的开源及专有模型相媲美,甚至超越后者。该模型在知识密集型和推理基准测试中表现尤为出色,在自然语言理解、数学与科学、代码生成以及智能体工具调用等方面均取得了卓越成果。

BenchmarkIntroKimi-K2-InstructDeepSeek-V3-0324Qwen3-235B-A22B (Non-thinking)Claude Sonnet 4 (w/o extended thinking)Claude Opus 4 (w/o extended thinking)GPT-4.1Gemini 2.5 Flash Preview (05-20)
Coding Tasks
LiveCodeBench v6Pass@153.746.937.048.547.444.744.7
OJBenchPass@127.124.011.315.319.619.519.5
MultiPL-EPass@185.783.178.288.689.686.785.6
SWE-bench VerifiedSingle Patch without Test (Acc)51.836.639.450.253.040.832.6
SWE-bench VerifiedSingle Attempt (Acc)65.838.834.472.7*72.5*54.6—
SWE-bench VerifiedMultiple Attempts (Acc)71.6——80.2*79.4*——
SWE-bench MultilingualSingle Attempt (Acc)47.325.820.951.0—31.5—
TerminalBenchInhouse Framework (Acc)30.0——35.543.28.3—
TerminalBenchTerminus (Acc)25.016.36.6——30.316.8
Aider-PolyglotAcc60.055.161.856.470.752.444.0
Tool Use Tasks
Tau2 retailAvg@470.669.157.075.081.874.864.3
Tau2 airlineAvg@456.539.026.555.560.054.542.5
Tau2 telecomAvg@465.832.522.145.257.038.616.9
AceBenchAcc76.572.770.576.275.680.174.5
Math & STEM Tasks
AIME 2024Avg@6469.659.4*40.1*43.448.246.561.3
AIME 2025Avg@6449.546.724.7*33.1*33.9*37.046.6
MATH-500Acc97.494.0*91.2*94.094.492.495.4
HMMT 2025Avg@3238.827.511.915.915.919.434.7
CNMO 2024Avg@1674.374.748.660.457.656.675.0
PolyMath-enAvg@465.159.551.952.849.854.049.9
ZebraLogicAcc89.084.037.7*79.759.358.557.9
AutoLogiAcc89.588.983.3*89.886.188.284.1
GPQA-DiamondAvg@875.168.4*62.9*70.0*74.9*66.368.2
SuperGPQAAcc57.253.750.255.756.550.849.6
Humanity's Last ExamAcc4.75.25.75.87.13.75.6
General Tasks
MMLUEM89.589.487.091.592.990.490.1
MMLU-ReduxEM92.790.589.2*93.694.292.490.6
MMLU-ProEM81.181.2*77.383.786.681.879.4
IFEvalPrompt Strict89.881.183.2*87.687.488.084.3
Multi-ChallengeAcc54.131.434.046.849.036.439.5
SimpleQACorrect31.027.713.215.922.842.323.3
LivebenchPass@176.472.467.674.874.669.867.8