AI Flash Report
Update Anthropic · Released

Claude 2.1

What is Claude 2.1?

Claude 2.1 is a Update AI model from Anthropic, released on November 21, 2023. It has a 200K tokens context window, and scores 73.1% on MMLU. It is available via the company's API.

Claude 2 update — 200K context and reduced hallucinations

Significant improvements in accuracy and honesty over Claude 2

Key features

  • 200K context window
  • Reduced hallucination rates
  • Enhanced accuracy
  • Tool use capabilities

How much does Claude 2.1 cost?

Claude 2.1 pricing
Metric Price
input $8/M
output $24/M

Pricing data verified .

What context window does Claude 2.1 have?

Context window
200K tokens
Input modalities
text
Output modalities
text

How does Claude 2.1 score on benchmarks?

Claude 2.1 benchmark scores
Benchmark Score
MMLU 73.1%
HumanEval 70.0%

Benchmark scores verified .

What's new

  • 200K context (2× Claude 2)
  • 50% fewer hallucinations
  • Tool use beta

How does Claude 2.1 compare to Claude 2?

  • MMLU: 78.5% → 73.1% (-5.4pt)
  • Context window: 100K tokens → 200K tokens

Compare Claude 2.1 with