AI Flash Report
Update Anthropic · Released

Claude 2.1

What is Claude 2.1?

Claude 2.1 is a Update AI model from Anthropic, released on November 21, 2023. It has a 200K tokens context window, costs $0.00 per million input tokens, and scores 73.1% on MMLU. It is available via the company's API.

Claude 2 update — 200K context and reduced hallucinations

Significant improvements in accuracy and honesty over Claude 2

Key features

  • 200K context window
  • Reduced hallucination rates
  • Enhanced accuracy
  • Tool use capabilities

How much does Claude 2.1 cost?

Claude 2.1 pricing
Metric Price
input $8/M
output $24/M
input per mtok $0.00
output per mtok $0.00

Pricing data verified .

What context window does Claude 2.1 have?

Context window
200K tokens
Input modalities
text
Output modalities
text

How does Claude 2.1 score on benchmarks?

Claude 2.1 benchmark scores
Benchmark Score
MMLU 73.1%
HumanEval 15.9%
MMLU-Pro 49.5%
GPQA Diamond 31.9%
LiveCodeBench 19.5%
MATH-500 37.4%
AIME 2025 3.3%
HLE 4.2%
SciCode 18.4%
AA Intelligence Index 9.3

Benchmark scores verified .

What's new

  • 200K context (2× Claude 2)
  • 50% fewer hallucinations
  • Tool use beta

How does Claude 2.1 compare to Claude 2?

  • HumanEval: 71.2% → 15.9% (-55.3pt)
  • Context window: 100K tokens → 200K tokens

Compare Claude 2.1 with