AI 智能体评估
AI 编码智能体在 Nuxt 代码生成任务上的性能结果,衡量成功率和执行时间。
智能体性能结果
| 模型 | 智能体 | 平均耗时 | 成功率 | 首次成功率 | |
|---|---|---|---|---|---|
Claude Sonnet 5 | Claude Code | 292.09s | 100% | 100% | |
Cursor Composer 2.0 | Cursor | 273.91s | 100% | 97% | |
Claude Fable 5 | Claude Code | 298.81s | 100% | 97% | |
GPT 5.3 Codex (xhigh) | Codex | 276.52s | 100% | 90% | |
Gemini 3 Pro Preview | OpenCode | 291.65s | 100% | 90% | |
Claude Opus 4.8 | Claude Code | 261.37s | 100% | 90% | |
Kimi K2.7 Code | OpenCode | 327.00s | 100% | 83% | |
GPT 5.5 Pro | Codex | 666.02s | 97% | 93% | |
Cursor Composer 2.5 | Cursor | 263.31s | 97% | 90% | |
Claude Opus 4.7 | Claude Code | 215.73s | 97% | 90% | |
MiniMax M3 | OpenCode | 224.89s | 97% | 86% | |
Gemini 3.1 Pro Preview | OpenCode | 289.46s | 97% | 83% | |
Claude Opus 4.6 | Claude Code | 244.85s | 97% | 83% | |
Claude Sonnet 4.6 | Claude Code | 254.11s | 93% | 83% | |
Kimi K2.6 | OpenCode | 285.47s | 93% | 79% | |
GPT 5.4 (xhigh) | Codex | 302.57s | 90% | 76% | |
Claude Sonnet 4.5 | Claude Code | 240.76s | 59% | 48% | |
MiniMax M2.7 | OpenCode | 204.88s | 48% | 31% |
每次评估最多尝试 4 次。成功率是指至少有一次尝试通过的评估百分比;首次成功率是指在第一次尝试中通过的百分比,用于打破成功率相同的模型之间的平局。平均耗时是智能体每次评估所花费的平均时间。展开行可查看每次评估的结果,其中 1/3 徽标表示评估在通过前失败了两次。