AI Flash Report

TAU2-bench leaderboard

61 models ranked, highest score first.

TAU2-bench leaderboard — 61 models ranked by score
# Model Company Score
1 JT-35B-Flash China Mobile 99.1%
2 Claude Fable 5 Anthropic 98.5%
3 Step 3.7 Flash StepFun 98.5%
4 GLM 5V Turbo Z AI 98.5%
5 Grok 4.3 xAI 97.7%
6 GLM-5.1 Z AI 97.7%
7 Qwen3.6 Plus Alibaba 97.7%
8 DeepSeek V4 Pro DeepSeek 96.2%
9 Qwen3.6 Max Preview Alibaba 95.9%
10 Kimi K2.6 Kimi 95.9%
11 Qwen3.6 35B A3B Alibaba 95.3%
12 DeepSeek V4 Flash DeepSeek 95.0%
13 Qwen3.7 Max Alibaba 94.7%
14 Claude Opus 4.8 Anthropic 94.4%
15 Mistral Medium 3.5 Mistral 94.2%
16 Qwen3.6 27B Alibaba 94.2%
17 MiMo-V2.5-Pro Xiaomi 94.2%
18 GPT-5.5 OpenAI 93.9%
19 Qwen3.7 Plus Alibaba 93.0%
20 JT-MINI China Mobile 93.0%
21 Grok 4.20 0309 v2 xAI 93.0%
22 Hy3-preview Tencent 92.7%
23 Ring-2.6-1T InclusionAI 92.4%
24 Muse Spark Meta 91.5%
25 MiMo-V2.5 Xiaomi 90.6%
26 DeepSeek V3.2 DeepSeek 90.6%
27 Trinity Large Thinking Arcee AI 90.1%
28 Ling-2.6-1T InclusionAI 89.8%
29 Claude Opus 4.5 Anthropic 89.5%
30 MiniMax-M3 MiniMax 88.9%
31 Claude Opus 4.7 Anthropic 88.6%
32 MiniCPM-V 4.6 1.3B OpenBMB 87.7%
33 Step 3.5 Flash 2603 StepFun 87.4%
34 Solar Pro 3 Upstage 86.3%
35 Ling 2.6 Flash InclusionAI 86.0%
36 GPT-5.3 Codex OpenAI 86.0%
37 GPT-5.2 OpenAI 84.8%
38 Qwen3.5 Omni Flash Alibaba 84.5%
39 GPT-5.1 OpenAI 81.9%
40 MiniCPM5-1B OpenBMB 81.0%
41 Claude Sonnet 4.6 Anthropic 78.9%
42 EXAONE 4.5 33B LG AI Research 78.1%
43 GPT-5 OpenAI 67.0%
44 HyperNova 60B 2605 Multiverse Computing 63.2%
45 Gemma 4 31B Google 59.9%
46 Gemini 3.5 Flash Google 58.8%
47 GPT-5.5 Instant OpenAI 49.4%
48 Gemma 4 26B A4B Google 43.6%
49 Granite 4.1 30B IBM 42.1%
50 North Mini Code Cohere 37.4%
51 Gemma 4 12B Google 36.3%
52 Gemini 2.5 Flash Google 31.6%
53 Gemini 2.0 Flash Google 29.5%
54 Granite 4.1 8B IBM 27.8%
55 Mistral Large 3 Mistral 24.6%
56 DeepSeek-V3 DeepSeek 22.8%
57 Claude 3 Haiku Anthropic 21.1%
58 Gemma 4 E4B Google 20.8%
59 Gemma 4 E2B Google 20.8%
60 Granite 4.1 3B IBM 19.6%
61 LFM2.5-8B-A1B Liquid AI 16.1%