Input / Prompt
$0.30/ 1M tokens
$0.0003 per 1K tokens
Output / Completion
$0.60/ 1M tokens
$0.0006 per 1K tokens
Prompt Cache Read
$0.07/ 1M tokens
Save 75% vs prompt
Batch Inference
$0.15/ 1M in
Save 50% via Batch API
Price Ratio
1 : 2.0
Prompt to completion factor
Regional Reach
7AWS Regions

Llama 3 8B Spend Estimator

Model inference spend by prompt volume, cache hit rate, and batch processing.

Workload Presets:
M tokens
M tokens
30%
Estimated Monthly Spend
$0.00
Fresh Prompts:$0.00
Cached Prompts:$0.00
Completions:$0.00
Active: Input: $0.30/1M ยท Output: $0.60/1M

Key Cost Levers & Architecture

Practical mechanisms to reduce inference costs with Llama 3 8B on AWS
Prompt CachingSave ~75%

Caches repetitive system instructions, schemas, and document prefixes in memory with a 5-minute TTL.

  • Read Rate: $0.07 / 1M tokens
  • Write Rate: $0.38 / 1M tokens
  • Ideal for: Multi-turn conversations, RAG document queries, structured schemas
Batch InferenceSave 50%

Asynchronous bulk processing submitted via Amazon S3 with a standard 24-hour turnaround SLA.

  • Batch Input: $0.15 / 1M tokens
  • Batch Output: $0.30 / 1M tokens
  • Ideal for: Offline classification, synthetic data generation, benchmark evals
Cross-Region & Tiers7 Regions

AWS Bedrock supports standard on-demand inference, priority reserved throughput, and cross-region routing.

  • Standard: Lowest latency, pay-per-token with zero commitments
  • Cross-Region Routing: Automatically burst traffic to available regional capacity
  • GovCloud: Dedicated isolated compliance partitions with +20% uplift

Regional Pricing Matrix

Live rates across all 7 available AWS cloud regions
Baseline: $0.30/1M inGovCloud: $0.50/1M in7 Global Regions
Showing 6 benchmark regions
AWS RegionPrompt InputCompletion OutputCache ReadBatch InputPricing Tier
$0.30/1M$0.60/1Mโ€”/1Mโ€”/1MBaseline
$0.30/1M$0.60/1Mโ€”/1Mโ€”/1MBaseline
$0.30/1M$0.60/1Mโ€”/1Mโ€”/1MGovCloud
$0.36/1M$0.72/1Mโ€”/1Mโ€”/1M+20% vs Baseline
Canada (Central)ca-central-1
$0.35/1M$0.69/1Mโ€”/1Mโ€”/1M+17% vs Baseline
EU (London)eu-west-2
$0.39/1M$0.78/1Mโ€”/1Mโ€”/1M+30% vs Baseline
$0.50/1M$1.01/1Mโ€”/1Mโ€”/1M+67% vs Baseline

Developer Quickstart

Invoke Llama 3 8B via Amazon Bedrock Converse API
Python (boto3) ยท Amazon Bedrock Runtime
import boto3

# Amazon Bedrock Converse API invocation
client = boto3.client("bedrock-runtime", region_name="us-east-1")

response = client.converse(
    modelId="meta.llama-3-8b-v1:0",
    messages=[
        {
            "role": "user",
            "content": [{"text": "Summarize key features and cost levers of Llama 3 8B."}]
        }
    ],
    inferenceConfig={
        "maxTokens": 1024,
        "temperature": 0.7
    }
)

output_text = response["output"]["message"]["content"][0]["text"]
usage = response["usage"]
print(f"Response: {output_text}")
print(f"Usage: {usage['inputTokens']} in, {usage['outputTokens']} out")

Compare Llama 3 8B with Alternatives

Open Multi-Model Estimator →
Llama 3 8B vsJamba 1.5 LargeAI21 Labs
Input Rate:$2.00/1M
Output Rate:$8.00/1M
Compare Side-by-Side →
Llama 3 8B vsJamba 1.5 MiniAI21 Labs
Input Rate:$0.20/1M
Output Rate:$0.40/1M
Compare Side-by-Side →
Llama 3 8B vsQwen3 235B A22B 2507Alibaba (Qwen)
Input Rate:$0.11/1M
Output Rate:$0.44/1M
Compare Side-by-Side →