ALL EVALUATED HOSTS· [77] MODELS

Google

[17]▾

Google

Gemini 3.5 Flash

15.5

/20

Google

Gemini 3.6 Flash

15.5

/20

Google

Gemma 4 31B

14.5

/20

OPEN WEIGHTS

Google

Gemma 4 26B A4B

14

/20

OPEN WEIGHTS

Google

Gemma 4 12B

13.4

/20

OPEN WEIGHTS

Google

Gemini 3.1 Pro

13.1

/20

Google

Gemma 4 E4B

12.8

/20

OPEN WEIGHTS

Google

Gemini 3 Pro

12.7

/20

Google

Gemini 3 Flash

12.7

/20

Google

Gemini 2.5 Deep Think

12.5

/20

Google

Gemini 3.1 Flash Lite

12.4

/20

Google

Gemma 4

12.4

/20

OPEN WEIGHTS

Google

Gemma 4 E2B

12.1

/20

OPEN WEIGHTS

Google

Gemini 2.5 Pro

11.9

/20

Google

Gemma 3

11.1

/20

OPEN WEIGHTS

Google

Gemini 2.5 Flash

10.6

/20

Google

Gemini 1.5 Pro

8.4

/20

Anthropic

[14]▾

Anthropic

Claude Opus 5

15.8

/20

Anthropic

Claude Fable 5

14.7

/20

Anthropic

Claude Mythos 5

14.6

/20

Anthropic

Claude Sonnet 5

14

/20

Anthropic

Claude Opus 4.8

13.6

/20

Anthropic

Claude Opus 4.5

13.2

/20

Anthropic

Claude Sonnet 4.6

13

/20

Anthropic

Claude Opus 4.7

12.3

/20

Anthropic

Claude Opus 4.6

11.6

/20

Anthropic

Claude Sonnet 4

11.1

/20

Anthropic

Claude 3.7 Sonnet

10.8

/20

Anthropic

Claude Haiku 4.5

10.5

/20

Anthropic

Claude Opus 4

10.1

/20

Anthropic

Claude 3.5 Sonnet

9.2

/20

OpenAI

[14]▾

OpenAI

GPT-5.6 Sol

15.1

/20

OpenAI

GPT-5.6 Terra

15.1

/20

OpenAI

GPT-5.6 Luna

15

/20

OpenAI

GPT-5.2

12.9

/20

OpenAI

GPT-5.5

12.7

/20

OpenAI

GPT-5.4

12.4

/20

OpenAI

GPT-5.3 Codex

12.3

/20

OpenAI

GPT-5.5 Pro

12.3

/20

OpenAI

GPT-5.1

11.7

/20

OpenAI

GPT-5.4 mini

11.5

/20

OpenAI

o3

10.6

/20

OpenAI

GPT-5

10.6

/20

OpenAI

GPT-4o

10.5

/20

OpenAI

o1

8.8

/20

Other

[10]▾

Other

SWE-1.6

11.9

/20

Other

SWE-1.5

11.5

/20

Other

Kimi K2

11.5

/20

OPEN WEIGHTS

Other

Cursor Composer 1

11.4

/20

COMMERCIAL USE RESTRICTED

Other

Cursor Composer 1.5

11.2

/20

COMMERCIAL USE RESTRICTED

Other

Cursor Composer 2.5

10.9

/20

COMMERCIAL USE RESTRICTED

Other

Kimi K2.5

10.8

/20

OPEN WEIGHTS

Other

Kimi K2.7-Code

10.7

/20

COMMERCIAL USE RESTRICTED

Other

Kimi K2.6

10.7

/20

OPEN WEIGHTS

Other

Cursor Composer 2

10.5

/20

COMMERCIAL USE RESTRICTED

Meta

[4]▾

Meta

Muse Spark

11.4

/20

Meta

Llama 4 Scout

11

/20

OPEN WEIGHTS

Meta

Llama 4 Maverick

9.3

/20

OPEN WEIGHTS

Meta

Llama 3.1 405B

9

/20

OPEN WEIGHTS

xAI

[4]▾

xAI

Grok 4.5

14.4

/20

xAI

Grok 4.20

11.9

/20

xAI

Grok 4

10.8

/20

xAI

Grok 3

10.2

/20

DeepSeek

[3]▾

DeepSeek

DeepSeek V4 Flash

14.3

/20

OPEN WEIGHTS

DeepSeek

DeepSeek V3.2

13.1

/20

OPEN WEIGHTS

DeepSeek

DeepSeek R1

9.4

/20

OPEN WEIGHTS

Mistral

[3]▾

Mistral

Mistral Small 4

11.5

/20

OPEN WEIGHTS

Mistral

Mistral Large 3

10.8

/20

OPEN WEIGHTS

Mistral

Mistral Large 2

7.9

/20

COMMERCIAL USE RESTRICTED

Zhipu AI

[3]▾

Zhipu AI

GLM-5.2

12.7

/20

OPEN WEIGHTS

Zhipu AI

GLM-5.1

12.1

/20

OPEN WEIGHTS

Zhipu AI

GLM-5

9.9

/20

OPEN WEIGHTS

Alibaba

[2]▾

Alibaba

Qwen 3.5

12

/20

OPEN WEIGHTS

Alibaba

Qwen3 Max Instruct

11.9

/20

OPEN WEIGHTS

MiniMax

[2]▾

MiniMax

MiniMax M2.7

11.2

/20

COMMERCIAL USE RESTRICTED

MiniMax

MiniMax M2.5

10.1

/20

Cohere

[1]▾

Cohere

Command R+

6.5

/20

COMMERCIAL USE RESTRICTED