Llama 3.1 70B Instruct pricing & benchmarks
Released Jul 23, 2024 · served by 3 providers
What Llama 3.1 70B Instruct is
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
- Model ID:
meta-llama/llama-3.1-70b-instruct - Modality: text->text
- Knowledge cutoff: 2023-12-31
- Tool calling: supported · Structured output: supported
- Weights:
meta-llama/Meta-Llama-3.1-70B-Instructon Hugging Face
Providers and prices for Llama 3.1 70B Instruct
The same model costs different amounts depending on who serves it. Prices are per 1M tokens, cheapest first. Uptime and throughput are OpenRouter's rolling measurements, not vendor claims.
| Provider | Input | Output | Context | Quant | Uptime 24h | Throughput |
|---|---|---|---|---|---|---|
| DeepInfracheapest | $0.400 | $0.400 | 131K | fp8 | 99.4% | — |
| Amazon Bedrock | $0.720 | $0.720 | 131K | — | 100.0% | — |
| CoreWeave | $0.800 | $0.800 | 128K | bf16 | 99.3% | — |
FAQ
How much does the Llama 3.1 70B Instruct API cost?
$0.400 per 1M input tokens and $0.400 per 1M output tokens. A typical workload of 1M input + 300K output tokens costs about $0.52.
Is Llama 3.1 70B Instruct free?
No. It is a paid model starting at $0.400 per 1M input tokens, though some providers offer trial credits.
Which provider is cheapest for Llama 3.1 70B Instruct?
DeepInfra at $0.400 input / $0.400 output per 1M tokens (fp8 quantization).
Can I self-host Llama 3.1 70B Instruct?
Yes — weights are published as meta-llama/Meta-Llama-3.1-70B-Instruct on Hugging Face, so you can run it on your own hardware.