Warp

Llama 3.1 8B Instruct

ChatInput: TextReleased Jul 23, 2024

Built by Meta · United States · llama.com

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...

How to use

Just add the suffix. Hard questions still come back from this model; only easy ones drop to something cheaper, and nothing pricier than it gets used.

model: "meta-llama/llama-3.1-8b-instruct:auto"

Sets no behavior — whatever your key already stores stays in effect.

Without the suffix, the bare name always goes to this model — no routing, so nothing saved.

Context

16K

Max output

131K

Input $/1M

$0.02

Output $/1M

$0.05

Features

Providers

NovitaW&B Inference

Providers

Price, latency, and uptime per provider serving this model. Warp tries them in order of how each host has just been behaving, moving to the next on failure. Click a row for regions and data policies.

Loading provider metrics…

Performance

Benchmark quality scores, and measured speed per provider.

Quality

GPQA DiamondPhD-level science questions
25.9%
AIMECompetition mathematics
2.5%
SciCodeScientific code generation
13.2%

At each model's best reasoning effort

Speed

Loading provider metrics…

Parameter support

What Warp actually does with each parameter when you call this model. The answer differs by serving provider and by API surface.

Provider