Major Release xAI LLM Apache 2.0

xAI Grok-1

xAI's open-source release — 314B MoE, first frontier model fully open-sourced

Released 2023-12-07 · ~314B · 8K tokens context

Overview

xAI's first major language model with real-time internet access

Specifications

DeveloperxAI
Release date2023-12-07
Model typeLLM
Parameters~314B
ArchitectureMoE Transformer
Context window8K tokens
LicenseApache 2.0
Input modalitiestext
Output modalitiestext

Benchmarks

Benchmark Grok-1
MMLU 73.0%
HumanEval 63.2%
GSM8K 62.9%

Availability

Platform Exclusive Self-hosted (HuggingFace)

Official references