AI Flash Report
Major Release Google · Released

Gemini Ultra

What is Gemini Ultra?

Gemini Ultra is a Major Release AI model from Google, released on December 6, 2023. It has a — context window, and scores 90.0% on MMLU. It is available via Limited Access.

Google's first model to beat GPT-4 on MMLU — 90%+ with CoT

Google's most capable multimodal AI model

Key features

  • Multimodal reasoning
  • Text, image, audio, video understanding
  • Advanced mathematical reasoning
  • Code generation

How much does Gemini Ultra cost?

Gemini Ultra pricing
Metric Price
Gemini Advanced $19.99/month

Pricing data verified .

What context window does Gemini Ultra have?

Input modalities
text, image, audio, video
Output modalities
text

How does Gemini Ultra score on benchmarks?

Gemini Ultra benchmark scores
Benchmark Score
MMLU 90.0%
HumanEval 74.4%
MATH 53.2%

Benchmark scores verified .

What's new

  • First model to exceed human expert on MMLU
  • Native multimodal
  • 32K context

How does Gemini Ultra compare to PaLM 2?

  • MATH: 34.3% → 53.2% (+18.9pt)

Compare Gemini Ultra with