Input / Prompt
$2.65/ 1M tokens
$0.0027 per 1K tokens
Output / Completion
$3.50/ 1M tokens
$0.0035 per 1K tokens
Prompt Cache Read
$0.66/ 1M tokens
Save 75% vs prompt
Batch Inference
$1.32/ 1M in
Save 50% via Batch API
Price Ratio
1 : 1.3
Prompt to completion factor
Regional Reach
7AWS Regions

Llama 3 70B Spend Estimator

Model inference spend by prompt volume, cache hit rate, and batch processing.

Workload Presets:
M tokens
M tokens
30%
Estimated Monthly Spend
$0.00
Fresh Prompts:$0.00
Cached Prompts:$0.00
Completions:$0.00
Active: Input: $2.65/1M ยท Output: $3.50/1M

Key Cost Levers & Architecture

Practical mechanisms to reduce inference costs with Llama 3 70B on AWS
Prompt CachingSave ~75%

Caches repetitive system instructions, schemas, and document prefixes in memory with a 5-minute TTL.

  • Read Rate: $0.66 / 1M tokens
  • Write Rate: $3.31 / 1M tokens
  • Ideal for: Multi-turn conversations, RAG document queries, structured schemas
Batch InferenceSave 50%

Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.

  • Batch Input: $1.32 / 1M tokens
  • Batch Output: $1.75 / 1M tokens
  • Ideal for: Offline classification, synthetic data generation, benchmark evals
Cross-Region & Tiers7 Regions

AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.

  • Standard: Lowest latency, pay-per-token with zero commitments
  • Cross-Region Routing: Automatically burst traffic to available regional capacity
  • GovCloud: Dedicated isolated compliance partitions with +20% uplift

Regional Pricing Matrix

Live rates across all 7 available AWS cloud regions
Baseline: $2.65/1M inGovCloud: $4.45/1M in7 Global Regions
Showing 6 benchmark regions
AWS RegionPrompt InputCompletion OutputCache ReadBatch InputPricing Tier
$2.65/1M$3.50/1Mโ€”/1Mโ€”/1MBaseline
$2.65/1M$3.50/1Mโ€”/1Mโ€”/1MBaseline
$2.65/1M$3.50/1Mโ€”/1Mโ€”/1MGovCloud
$3.18/1M$4.20/1Mโ€”/1Mโ€”/1M+20% vs Baseline
Canada (Central)ca-central-1
$3.05/1M$4.03/1Mโ€”/1Mโ€”/1M+15% vs Baseline
EU (London)eu-west-2
$3.45/1M$4.55/1Mโ€”/1Mโ€”/1M+30% vs Baseline
$4.45/1M$5.88/1Mโ€”/1Mโ€”/1M+68% vs Baseline

Developer Quickstart

Invoke Llama 3 70B via Amazon Bedrock Converse API
Python (boto3) ยท Amazon Bedrock Runtime
import boto3

# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")

response = client.converse(
    modelId="meta.llama-3-70b-v1:0",
    messages=[
        {
            "role": "user",
            "content": [{"text": "Summarize key features and cost levers of Llama 3 70B."}]
        }
    ],
    inferenceConfig={
        "maxTokens": 1024,
        "temperature": 0.7
    }
)

output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")

Compare Llama 3 70B with Alternatives

Open Multi-Model Estimator →
Llama 3 70B vsJamba 1.5 LargeAI21 Labs
Input Rate:$2.00/1M
Output Rate:$8.00/1M
Compare Side-by-Side →
Llama 3 70B vsJamba 1.5 MiniAI21 Labs
Input Rate:$0.20/1M
Output Rate:$0.40/1M
Compare Side-by-Side →
Llama 3 70B vsQwen3 235B A22B 2507Alibaba (Qwen)
Input Rate:$0.11/1M
Output Rate:$0.44/1M
Compare Side-by-Side →