AWS Amazon EC2

inf2.24xlarge

⚡ 6x GPU • 192 GB

Part of the INF2 Accelerated Computing family — Hardware accelerators (GPUs, FPGAs) for specialized compute.

Name:infAWS Inferentia Accelerators22nd Generation24xlarge24 Extra Large

On-demand, Linux

$6.4906/ hr

~$4,738.16/mo · lowest in US East (N. Virginia), us-east-1

Savings Plan, Linux

$3.50494/ hr

From, with a 3-year Compute Savings Plan, No Upfront: −46% vs on-demand rate (us-east-1)

Per unit

$0.0676/ vCPU-hr

$0.0169/GB-hr

Compute

96vCPUs

48 cores • x86_64

Memory

384GB

4.0 GB / vCPU

Network

50 Gbps

Baseline: 50 Gbps

Storage & EBS

3,750MB/s

Max: 120,000 IOPS

Alternatives to inf2.24xlarge

Option	Price vs inf2.24xlarge	Why look at it
g5.24xlarge Compare →	+25%+$1.65/hr Linux on-demand, us-east-1	Newer generation, same vCPU and RAM
g6.24xlarge Compare →	+3%+$0.185/hr Linux on-demand, us-east-1	Newer generation, same vCPU and RAM

On Google Cloud

inf2.24xlarge is an accelerated machine. Those are compared by the accelerator, not by vCPU and memory, so this page doesn't pick a match. Browse Google Cloud machines.

Technical Specifications & Limits

Hardware specs, container thresholds, and system limits

Compute & Processor

ProcessorAMD EPYC 7R13 Processor

Architecturex86_64 (x86_64)

vCPUs / Threads96 vCPUs

Physical Cores48

Clock Speed2.95 GHz

Intel AVX / AVX2No

Intel Turbo BoostNo

Bare MetalNo (Virtualized)

Performance & Benchmarks

CoreMark Score1,914,734

CoreMark / vCPU19,945.2 / core

FFmpeg Transcoding249 FPS

CoreMark per Dollar295,000 score / $

Cost per vCPU-hr$0.0676

Cost per GB-hr$0.0169

Containers & Kubernetes

EKS Max Pods737 pods

Max ENIs15

IPv4/v6 per ENI50

Total Addressable IPs750 total IPs

CNI Prefix DelegationSupported (High Density)

Networking & Bandwidth

Network Performance50 Gbps

Baseline Bandwidth50 Gbps

Burst / Peak Bandwidth50 Gbps

Enhanced NetworkingYes

EFA SupportNo

IPv6 SupportNative Dual-Stack Supported

Storage & EBS Optimization

Storage ConfigurationEBS only

Local NVMe DiskNone (EBS only)

EBS Baseline Throughput3750 MB/s

EBS Max Throughput3750 MB/s

EBS Baseline IOPS120,000

EBS Max / Burst IOPS120,000

Dedicated EBS Throughput30 Gbps

GPU & Hardware Acceleration

GPU Model—

Accelerator Count6x GPU(s)

Total GPU Memory192.0 GB

Memory Architecture—

Acceleration Runtimes—

Platform & Architecture Details

Hypervisor / SystemAWS Nitro System (PCIe Offload)

Nitro EnclavesSupported (Isolated security enclaves)

Normalization Factor8.560582329

Generation StatusCurrent Generation (Recommended)

Rates by region

Live on-demand rates across all global AWS cloud regions

Lowest Price Region

$6.4906/ hr

US East (N. Virginia) (us-east-1)

Highest Price Region

$11.0341/ hr

South America (Sao Paulo) (sa-east-1)

Global Fleet Average

$8.4628/ hr

Across all active regions

Regional Coverage

13regions

Available worldwide

Linux — Available in all 13 regions
Region	On-Demand Price	% vs On-Demand Rate
ap-south-1 Asia Pacific (Mumbai)	$8.4378
ap-southeast-1 Asia Pacific (Singapore)	$9.0869
ap-southeast-2 Asia Pacific (Sydney)	$8.4378
ap-northeast-1 Asia Pacific (Tokyo)	$9.7360
eu-central-1 EU (Frankfurt)	$9.7360
eu-west-1 EU (Ireland)	$8.1133
eu-west-2 EU (London)	$9.7360
eu-west-3 EU (Paris)	$9.0869
eu-north-1 EU (Stockholm)	$7.1397
sa-east-1 South America (Sao Paulo) Highest	$11.0341
us-east-1 US East (N. Virginia) Lowest	$6.4906
us-east-2 US East (Ohio) Lowest	$6.4906
us-west-2 US West (Oregon) Lowest	$6.4906

Savings Plans: what to know

A Savings Plan commits you to a dollar amount per hour of spend for one or three years, not to an instance: usage up to that amount is billed at the plan's rates and the rest at on-demand, and unused commitment is still billed.
A Compute Savings Plan follows your usage across instance families, sizes, regions and operating systems; an EC2 Instance Savings Plan is locked to one family in one region in exchange for a lower rate (what that flexibility costs).
In US East (N. Virginia) (us-east-1), the 3-year Compute Savings Plan rate (No Upfront) for inf2.24xlarge on Linux is 54% of the on-demand rate, so the instance has to run at least 54% of the hours for the commitment to cost less than on-demand.
Rates are AWS's effective hourly rate for each payment option; All Upfront pays the whole term's commitment at purchase, which is why its hourly rate is lower; Partial Upfront (at least half up front) isn't shown on this page. The Savings Plans calculator has all three and sizes a commitment for this instance or a mix of them. How AWS applies a plan each hour: how Compute Savings Plans decide what they cover. Sizing one for elastic workloads: managing Compute Savings Plans.