Research Google LLM Proprietary (research)

Google PaLM

Google's 540B pathways model — first to demonstrate chain-of-thought at scale

Released 2022-04-04 · 540B

Overview

Google's 540-billion parameter language model demonstrating breakthrough capabilities

Specifications

DeveloperGoogle
Release date2022-04-04
Model typeLLM
Parameters540B
ArchitecturePathways Transformer
Training tokens780B tokens
LicenseProprietary (research)
Input modalitiestext
Output modalitiestext

Benchmarks

Benchmark PaLM
MMLU 69.3%
HumanEval 26.2%
MATH 8.8%
BIG-bench 58.1%

Availability

Research Only

Official references