HOST DIAGNOSTIC · Meta

Llama 3.1 405B

Llama 3.1 405B· Llama· OPEN WEIGHTS
ACTIVE
HOST IDENTIFICATION
Meta
Llama 3.1 405B
ACTIVE
AVG SCORE
[9.0]
LIMITED
STRONGEST
Cost Efficiency
[16]
WEAKEST
Multimodal Fluency
[5]
MAXED (20/20)
0
of 20 attributes
20-DIMENSION EVALUATION
Bulk Apperception
[9]
Reasoning
[10]
Math Precision
[8]
Code Generation
[10]
World Knowledge
[10]
Scientific Acumen
[9]
Instruction Following
[10]
Context Fidelity
[9]
Candor
[9]
Creativity
[8]
Multi-turn Coherence
[9]
Multimodal Fluency
[5]
Tool Use
[8]
Planning
[8]
Self-Correction
[8]
Tenacity
[8]
Safety Alignment
[8]
Calibration
[9]
Speed
[8]
Cost Efficiency
[16]
Llama 3.1 405B
ATTRIBUTE SCORES · 20 DIMENSIONS
Cognitive
Bulk Apperception
9
Reasoning
10
Mathematical Precision
8
World Knowledge
10
Scientific Acumen
9
Technical
Code Generation
10
Tool Use
8
Multimodal Fluency
5
Speed
8
Cost Efficiency
16
Behavioral
Candor
9
Creativity
8
Tenacity
8
Self-Correction
8
Calibration
9
Operational
Instruction Following
10
Context Fidelity
9
Multi-turn Coherence
9
Planning and Execution
8
Safety Alignment
8
SCORING METHODOLOGY
RECALIBRATED. Arena ~1320 maps to 9-11 band. Prior scores 6-8 were under by 2-3 pts. Reasoning 7→10, Code 8→10. Legacy model released July 2024, largest open model of its gen (405B params). Speed 8 (slow due to size). Cost 16 validated (self-hosting value).