Cloud price guide

AWS H100 Instance Price Guide

Compare total AWS instance rates with per-GPU rates for H100 to understand pricing at both levels.

Catalogue observed

1
AWS H100 instances tracked
$2.00/GPU/hr
Lowest single-GPU on-demand H100 price elsewhere

AWS instance prices

Recorded on-demand catalogue rates. Check the observation date and confirm a current quote; other GPU price tables can use a newer snapshot.

AWS instanceGPUsRegion / observed$/hr$/GPU/hr
p5.48xlarge 8x H100 us-east-1
$98.32 $12.29
Single-GPU on-demand elsewhere per GPUSource: - $2.00

Alternative-provider rates cover single-GPU on-demand offers across this GPU family. They do not establish the cost of an equivalent instance or the same exact variant.

When an AWS instance belongs on your shortlist

Start with the deployment constraint: whether the job must use AWS networking, data access or operational tooling. If those requirements are essential, compare the exact AWS configuration and its full instance rate. If the job can run elsewhere, first check whether an alternative supplies the same usable GPU count, topology and software environment.

Compare the billable configuration

Budget a run using the full instance hourly rate and billed duration. The per-GPU figure divides that total across the attached GPUs; it is not an offer to rent a fraction of the instance. Include idle GPUs in the decision when the job cannot use the whole machine.

Validate before moving the workload

Check the recorded region and source date, then obtain a current quote and confirm quota and capacity. Test access to your dataset, a representative workload and checkpoint recovery where needed. Compare storage and transfer terms before interpreting a lower accelerator rate as a lower total bill.

Limitations

The AWS catalogue snapshot and alternative-provider observations have separate collection dates. They do not establish equivalent configurations, live capacity or measured application performance.

Should the workload stay in this cloud?

  1. List the deployment dependencies

    Check required identity, networking, storage location and operational tooling. Establish which dependencies an alternative must support before comparing rates.

  2. Compare equivalent offers

    Match the exact GPU variant, sold GPU count and purchase model. A single-GPU quote elsewhere does not establish the price or topology of an equivalent multi-GPU instance.

  3. Test the move

    Confirm quota and capacity, then test data access and a bounded workload. Include transfer and persistent-storage terms in the budget before choosing a destination.

Frequently asked questions

Is the listed AWS price for one GPU or the whole instance?

The total price applies to the whole instance. The table separately calculates the per-GPU rate so the two pricing views can be compared.

Does the listed region prove live AWS capacity?

No. The region and catalogue price identify the observed listing, not live capacity. Check the provider directly for current capacity information.

View all GPU prices

Marlin beta

Find a suitable H100 configuration with Marlin

Marlin matches your workload to the lowest-priced suitable GPU across supported providers.

Get started with Marlin