Cohere model benchmarks.

Compare Cohere models across answer quality, coding, complex tasks, speed, price, and context size.

Cohere

Quality

Highest overall scores

  1. 1Cohere: Command A22.5
  2. 2Cohere: Command R+ (08-2024)0
  3. 3Cohere: Command R7B (12-2024)0

Response speed

Fastest output in this sample

  1. 1Cohere: Command R7B (12-2024)76 t/s
  2. 2Cohere: Command A68 t/s
  3. 3Cohere: Command R+ (08-2024)41 t/s

Input price

Lowest price per 1M tokens

  1. 1Cohere: Command R7B (12-2024)$0.04/1M
  2. 2Cohere: Command A$2.50/1M
  3. 3Cohere: Command R+ (08-2024)$2.50/1M

Highlights

Quality

Overall capability · Higher is better

Speed

Output tokens per second · Higher is better

Input price

USD per 1M tokens · Lower is better

Quality benchmarks

Compare Cohere model capability.

Performance and price

Compare practical tradeoffs.

All Cohere models.

3 models in the current catalogue.

Cohere technical benchmarks.

Compare named evaluation records available for Cohere models. Missing results remain blank rather than being estimated.

BenchmarkAreaCommand ACommand R+ (08-2024)Command R7B (12-2024)Source
Intelligence IndexoverallQuality22.5OpenRouter / artificial-analysis
Coding Indexcoding27.8OpenRouter / artificial-analysis
Agentic Indexagentic9.2OpenRouter / artificial-analysis
GPQAGPQA Diamond76.1OpenRouter model benchmarks
Humanity's Last ExamHLE11.4OpenRouter model benchmarks
IFBenchIFBench73.9OpenRouter model benchmarks
τ²-Bench Telecomτ²-Bench Telecom80.7OpenRouter model benchmarks
AA-LCRAA-LCR46OpenRouter model benchmarks
GDPval-AAGDPval-AA10.9OpenRouter model benchmarks
CritPtCritPt0.3OpenRouter model benchmarks
SciCodeSciCode37.8OpenRouter model benchmarks
Terminal-Bench HardTerminal-Bench Hard25OpenRouter model benchmarks
AA-Omniscience AccuracyAA-Omniscience Accuracy8.8OpenRouter model benchmarks
AA-Omniscience Non-Hallucination RateAA-Omniscience Non-Hallucination Rate85.9OpenRouter model benchmarks