HOST DIAGNOSTIC · OpenAI
o1
o1· GPT· PROPRIETARY
ACTIVE
HOST IDENTIFICATION
OpenAI
o1
ACTIVE
AVG SCORE
[8.8]
LIMITED
STRONGEST
Mathematical Precision
[14]
WEAKEST
Speed
[4]
MAXED (20/20)
0
of 20 attributes
20-DIMENSION EVALUATION
ATTRIBUTE SCORES · 20 DIMENSIONS
Cognitive
Bulk Apperception
9
Reasoning
12
Mathematical Precision
14
World Knowledge
9
Scientific Acumen
13
Technical
Code Generation
10
Tool Use
7
Multimodal Fluency
6
Speed
4
Cost Efficiency
4
Behavioral
Candor
9
Creativity
6
Tenacity
9
Self-Correction
9
Calibration
10
Operational
Instruction Following
9
Context Fidelity
8
Multi-turn Coherence
8
Planning and Execution
9
Safety Alignment
10
SCORING METHODOLOGY
RECALIBRATED. Arena ~1350 maps to bottom of 12-14 band. Reasoning 11→12. Math 11→14 (o1 was a math reasoning specialist, AIME 2024 83.3%). Scientific 10→13 (strong STEM reasoning). Speed 4 + Cost 4 kept (very slow + expensive reasoning model). Superseded by o3.