Warp

Llama 3 8B Instruct

ChatInput: TextReleased Apr 25, 2024

Built by Meta · United States · llama.com

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations.

How to use

Just add the suffix. Hard questions still come back from this model; only easy ones drop to something cheaper, and nothing pricier than it gets used.

model: "meta-llama/llama-3-8b-instruct:auto"

Sets no behavior — whatever your key already stores stays in effect.

Without the suffix, the bare name always goes to this model — no routing, so nothing saved.

Context

8K

Max output

8K

Input $/1M

$0.04

Output $/1M

$0.04

Features

Providers

Novita

Providers

Price, latency, and uptime per provider serving this model. Warp tries them in order of how each host has just been behaving, moving to the next on failure. Click a row for regions and data policies.

Loading provider metrics…

Performance

Measured latency (lower is better) and throughput (higher is better) per provider.

Speed

Loading provider metrics…

Parameter support

What Warp actually does with each parameter when you call this model. The answer differs by serving provider and by API surface.