Foundation Model ยท Amazon BedrockTextMulti-Tier Pricing
Llama 3 70B
Amazon Bedrock token pricing and cost optimization reference for Llama 3 70B.Rates normalized to USD per 1 Million Tokens ($/1M) with prompt caching and batch API discounts across 7 AWS regions.
ProviderMeta
ModalityText
Prompt CachingSave 75%
Batch APISave 50%
AWS Regions7 Global
Bedrock Model ID
meta.llama-3-70b-v1:0Input / Prompt
$2.65/ 1M tokens
$0.0027 per 1K tokens
Output / Completion
$3.50/ 1M tokens
$0.0035 per 1K tokens
Prompt Cache Read
$0.66/ 1M tokens
Save 75% vs prompt
Batch Inference
$1.32/ 1M in
Save 50% via Batch API
Price Ratio
1 : 1.3
Prompt to completion factor
Llama 3 70B Spend Estimator
Model inference spend by prompt volume, cache hit rate, and batch processing.
M tokens
M tokens
30%
Estimated Monthly Spend
$0.00
Fresh Prompts:$0.00
Cached Prompts:$0.00
Completions:$0.00
Active: Input: $2.65/1M ยท Output: $3.50/1M
Key Cost Levers & Architecture
Practical mechanisms to reduce inference costs with Llama 3 70B on AWSPrompt CachingSave ~75%
Caches repetitive system instructions, schemas, and document prefixes in memory with a 5-minute TTL.
- Read Rate: $0.66 / 1M tokens
- Write Rate: $3.31 / 1M tokens
- Ideal for: Multi-turn conversations, RAG document queries, structured schemas
Batch InferenceSave 50%
Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.
- Batch Input: $1.32 / 1M tokens
- Batch Output: $1.75 / 1M tokens
- Ideal for: Offline classification, synthetic data generation, benchmark evals
Cross-Region & Tiers7 Regions
AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.
- Standard: Lowest latency, pay-per-token with zero commitments
- Cross-Region Routing: Automatically burst traffic to available regional capacity
- GovCloud: Dedicated isolated compliance partitions with +20% uplift
Regional Pricing Matrix
Live rates across all 7 available AWS cloud regionsBaseline: $2.65/1M inGovCloud: $4.45/1M in7 Global Regions
| AWS Region | Prompt Input | Completion Output | Cache Read | Batch Input | Pricing Tier |
|---|---|---|---|---|---|
| $2.65/1M | $3.50/1M | โ/1M | โ/1M | Baseline | |
| $2.65/1M | $3.50/1M | โ/1M | โ/1M | Baseline | |
| $2.65/1M | $3.50/1M | โ/1M | โ/1M | GovCloud | |
| $3.18/1M | $4.20/1M | โ/1M | โ/1M | +20% vs Baseline | |
| $3.05/1M | $4.03/1M | โ/1M | โ/1M | +15% vs Baseline | |
| $3.45/1M | $4.55/1M | โ/1M | โ/1M | +30% vs Baseline | |
| $4.45/1M | $5.88/1M | โ/1M | โ/1M | +68% vs Baseline |
No AWS regions found matching your filter.
Developer Quickstart
Invoke Llama 3 70B via Amazon Bedrock Converse APIPython (boto3) ยท Amazon Bedrock Runtime
import boto3
# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")
response = client.converse(
modelId="meta.llama-3-70b-v1:0",
messages=[
{
"role": "user",
"content": [{"text": "Summarize key features and cost levers of Llama 3 70B."}]
}
],
inferenceConfig={
"maxTokens": 1024,
"temperature": 0.7
}
)
output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")Compare Llama 3 70B with Alternatives
Open Multi-Model Estimator →Llama 3 70B vsQwen3 235B A22B 2507Alibaba (Qwen)
Input Rate:$0.11/1M
Output Rate:$0.44/1M