Rent an NVIDIA A100 SXM 80GB from $0.19 per GPU-hour
NVIDIA A100 SXM 80GB price per hour: $0.19 per GPU-hour on spot, $0.29 on-demand, $0.19 reserved, billed by the minute. Still the workhorse of fine-tuning. 80 GB of HBM2e and NVLink make it comfortable for models an RTX card cannot hold, at a fraction of the price of Hopper. No FP8, so plan on FP16 or integer quantisation.
Billed per started minute. 640 GB of GPU memory on a 8× node. Persistent storage $0.08 per GB-month. No egress fees.
- GPU memory
- 80GBHBM2e · MIG capable
- Bandwidth
- 2,039GB/sSets token throughput on inference
- Node sizes
- 1× · 2× · 4× · 8×Same price per GPU at every size
- Reclaim rate
- <5%Spot instances reclaimed over 30 days
What you get with each A100 node.
| Node | GPU memory | vCPU | RAM | Local NVMe | Spot | On-demand | Action |
|---|---|---|---|---|---|---|---|
| 1× A100 | 80 GB | 16 | 128 GB | 1 TB | $0.19/h | $0.29/h | Configure |
| 2× A100 | 160 GB | 32 | 256 GB | 2 TB | $0.38/h | $0.58/h | Configure |
| 4× A100 | 320 GB | 64 | 512 GB | 4 TB | $0.76/h | $1.16/h | Configure |
| 8× A100 | 640 GB | 128 | 1,024 GB | 8 TB | $1.52/h | $2.32/h | Configure |
GPU-to-GPU link: NVLink 3, 600 GB/s; PCIe Gen4 64 GB/s. Local NVMe is scratch space wiped when the instance ends; keep anything you need on a persistent disk.
96 A100 GPUs free right now.
Straight from the capacity pool the console books against. Prices are identical in every region — pick the one closest to your data.
A region with zero free GPUs still accepts reserved capacity requests — we hold hardware for a term rather than sell what is already taken.
What fits in 80 GB — and what it costs per hour.
Weights need about 2 GB per billion parameters at FP16 / BF16, 0.5 GB per billion parameters at INT4. We keep 20% of the memory free for activations, the KV cache and the CUDA context, then take the smallest node that still fits.
| Open model | Parameters | FP16 / BF16node · spot price | INT4node · spot price |
|---|---|---|---|
| Llama 3.1 8BThe default small model for fine-tuning and agents | 8B | 1× $0.19/h | 1× $0.19/h |
| Qwen3 14BMid-size dense Qwen3 | 14.8B | 1× $0.19/h | 1× $0.19/h |
| gpt-oss-20bSmall open-weight reasoning model for local and edge serving | 21B | 1× $0.19/h | 1× $0.19/h |
| Gemma 4 31BLargest dense Gemma 4, multimodal, 256K context | 31.3B | 1× $0.19/h | 1× $0.19/h |
| Qwen3.6 35B A3BSmall hybrid-attention mixture of experts | 35B | 2× $0.38/h | 1× $0.19/h |
| Llama 3.3 70BThe common 70B baseline (same size and layout as Llama 3.1 70B) | 70.6B | 4× $0.76/h | 1× $0.19/h |
| gpt-oss-120bOpen-weight reasoning model, mixture of experts, tool use | 117B | 4× $0.76/h | 2× $0.38/h |
| Qwen3 235B A22BFlagship Qwen3 mixture of experts, the 2507 checkpoint | 235B | 8× $1.52/h | 2× $0.38/h |
| DeepSeek R1Reasoning model, the R1-0528 checkpoint | 671B | over 8× | 8× $1.52/h |
Each model links to its full sizing: KV cache by context length and every GPU that runs it — GPU requirements for 64 open models.
Real usage depends on context length, batch size and the serving engine: a long context can add tens of gigabytes of KV cache. Treat the table as the floor, not the ceiling — and if a job is close to the limit, take the next node size or quantise one step further.
What a dollar buys on an A100.
Ranked 8 of 21 data-center models in this catalogue on cost per gigabyte of GPU memory.
GPU memory you get for $1.00 of spot time, per hour.
Bandwidth decides token throughput far more often than raw FLOPS.
Spot price divided by published FP16 tensor throughput.
One GPU on spot, billed per minute, storage excluded.
Against the rest of the market
70 providers · September 2026- Median on-demand elsewhere
- $1.60Our on-demand is 82% below it
- Cheapest on-demand seen
- $0.40Our on-demand $0.29 is 28% below it
- Cheapest spot seen
- $0.29Our spot $0.19 is 34% below it
- 24 hours on one GPU
- $4.56 on spot$6.96 on-demand · $9.60 at the cheapest rate found elsewhere
Index built from published prices for the same GPU across 102 providers (provider pricing pages and public price indexes), September 2026. How the guarantee is enforced.
A100 SXM 80GB price per hour at 52 other providers.
The lowest published on-demand rate we recorded at each provider, cheapest first: $0.40 to $5.04 per GPU-hour, with a median of $1.49. Every row links to its source; a provider without a published price is left out rather than estimated.
| # | Provider | On-demandper GPU-hour | Spot | 730 h | Source |
|---|---|---|---|---|---|
| — | OnlineGPUthis site · how the price is set | $0.29 | $0.19 | $211.70 | pricing page |
| 1 | GPU Outletrecorded 15 Sep 2026 | $0.40 | not published | $292.00 | computeprices.com |
| 2 | Vast.airecorded 15 Sep 2026 | $0.53 | $0.29 | $389.82 | gpucloudcost.com |
| 3 | Denvr Dataworksrecorded 15 Sep 2026 | $0.58 | not published | $423.40 | cloud-gpus.com |
| 4 | Verdarecorded 15 Sep 2026 | $0.86 | $0.86 | $630.72 | shadeform.com |
| 5 | Hyperstackrecorded 15 Sep 2026 | $0.98 | $1.08 | $715.40 | hyperstack.cloud |
| 6 | RunPodrecorded 15 Sep 2026 | $1.00 | not published | $730.00 | runpod.io |
| 7 | AtmosComputerecorded 15 Sep 2026 | $1.01 | not published | $737.30 | computeprices.com |
| 8 | GPU.airecorded 15 Sep 2026 | $1.07 | not published | $781.10 | computeprices.com |
| 9 | Thunder Computerecorded 15 Sep 2026 | $1.09 | not published | $795.70 | getdeploying.com |
| 10 | Seewebrecorded 15 Sep 2026 | $1.14 | not published | $832.20 | computeprices.com |
| 11 | Spheronrecorded 15 Sep 2026 | $1.15 | not published | $839.50 | getdeploying.com |
| 12 | CoreWeaverecorded 15 Sep 2026 | $1.19 | $1.19 | $868.70 | coreweave.com |
| 13 | Liumrecorded 15 Sep 2026 | $1.23 | $0.35 | $897.90 | getdeploying.com |
| 14 | Massed Computerecorded 15 Sep 2026 | $1.24 | $1.24 | $905.20 | vm.massedcompute.com |
| 15 | IO.NETrecorded 15 Sep 2026 | $1.29 | not published | $941.70 | computeprices.com |
Show the other 37 providers
| # | Provider | On-demandper GPU-hour | Spot | 730 h | Source |
|---|---|---|---|---|---|
| 16 | Vultrrecorded 15 Sep 2026 | $1.29 | $1.49 | $941.70 | getdeploying.com |
| 17 | Shadeformrecorded 15 Sep 2026 | $1.35 | not published | $985.50 | computeprices.com |
| 18 | 1Legionrecorded 15 Sep 2026 | $1.36 | not published | $992.80 | computeprices.com |
| 19 | Beamrecorded 15 Sep 2026 | $1.36 | not published | $992.80 | getdeploying.com |
| 20 | Packet.airecorded 15 Sep 2026 | $1.43 | not published | $1,043.90 | getdeploying.com |
| 21 | Omega Gradientrecorded 15 Sep 2026 | $1.45 | not published | $1,058.50 | computeprices.com |
| 22 | Gcorerecorded 15 Sep 2026 | $1.46 | not published | $1,065.80 | getdeploying.com |
| 23 | Oblivusrecorded 15 Sep 2026 | $1.47 | $1.51 | $1,073.10 | getdeploying.com |
| 24 | Geoddrecorded 15 Sep 2026 | $1.49 | not published | $1,087.70 | getdeploying.com |
| 25 | Jarvis Labsrecorded 15 Sep 2026 | $1.49 | not published | $1,087.70 | computeprices.com |
| 26 | Runcraterecorded 15 Sep 2026 | $1.49 | not published | $1,087.70 | getdeploying.com |
| 27 | Sestercerecorded 15 Sep 2026 | $1.49 | not published | $1,087.70 | getdeploying.com |
| 28 | Lyceumrecorded 15 Sep 2026 | $1.59 | $0.80 | $1,160.70 | getdeploying.com |
| 29 | Koyebrecorded 15 Sep 2026 | $1.60 | not published | $1,168.00 | getdeploying.com |
| 30 | Novita AIrecorded 15 Sep 2026 | $1.60 | $0.80 | $1,168.00 | getdeploying.com |
| 31 | TensorDockrecorded 15 Sep 2026 | $1.61 | $0.67 | $1,175.30 | tensordock.com |
| 32 | Cloudzyrecorded 15 Sep 2026 | $1.64 | not published | $1,197.20 | getdeploying.com |
| 33 | EmpirioLabs AIrecorded 15 Sep 2026 | $1.70 | not published | $1,241.00 | getdeploying.com |
| 34 | Civorecorded 15 Sep 2026 | $1.79 | not published | $1,306.70 | computeprices.com |
| 35 | AceCloudrecorded 15 Sep 2026 | $1.81 | not published | $1,321.30 | computeprices.com |
| 36 | Akash Networkrecorded 15 Sep 2026 | $1.84 | not published | $1,343.20 | console.akash.network |
| 37 | Leafcloudrecorded 15 Sep 2026 | $1.85 | not published | $1,350.50 | getdeploying.com |
| 38 | Lambdarecorded 15 Sep 2026 | $1.99 | not published | $1,452.70 | shadeform.com |
| 39 | Crusoerecorded 15 Sep 2026 | $2.00 | not published | $1,460.00 | getdeploying.com |
| 40 | Google Cloudrecorded 15 Sep 2026 | $2.01 | $2.23 | $1,467.30 | cloud.google.com |
| 41 | Cyfuture AIrecorded 15 Sep 2026 | $2.01 | not published | $1,467.30 | getdeploying.com |
| 42 | Modalrecorded 15 Sep 2026 | $2.50 | not published | $1,823.54 | gpucloudcost.com |
| 43 | Hugging Facerecorded 15 Sep 2026 | $2.50 | not published | $1,825.00 | getdeploying.com |
| 44 | Together AIrecorded 15 Sep 2026 | $2.59 | not published | $1,890.70 | computeprices.com |
| 45 | AWSrecorded 15 Sep 2026 | $2.74 | $2.91 | $2,000.20 | computeprices.com |
| 46 | Oracle Cloudrecorded 15 Sep 2026 | $3.05 | not published | $2,226.50 | cloud-gpus.com |
| 47 | OVHcloudrecorded 15 Sep 2026 | $3.07 | not published | $2,241.10 | getdeploying.com |
| 48 | Prime Intellectrecorded 15 Sep 2026 | $3.14 | not published | $2,292.20 | primeintellect.ai |
| 49 | Paperspacerecorded 15 Sep 2026 | $3.18 | not published | $2,321.40 | shadeform.com |
| 50 | Microsoft Azurerecorded 15 Sep 2026 | $3.40 | $0.68 | $2,482.00 | gpucloudcost.com |
| 51 | Elastxrecorded 15 Sep 2026 | $3.75 | not published | $2,737.50 | getdeploying.com |
| 52 | Replicaterecorded 15 Sep 2026 | $5.04 | not published | $3,679.20 | gpucloudcost.com |
Recorded 15 September 2026 from published price pages (provider pricing pages and public price indexes), compute only: storage, egress and taxes excluded. Prices move — if a row is out of date, send us the link and it is corrected.
What people run on an A100 SXM 80GB.
Training and full fine-tuning
Enough memory for optimiser states and activations on models a smaller card can only run in inference.
Serving large models
A 70B model at FP8 across two GPUs, with room for a long context window.
Multi-GPU jobs over NVLink
GPU-to-GPU traffic stays off the PCIe bus, which is what makes tensor and pipeline parallelism worth it.
Partitioned serving (MIG)
The GPU can be split into isolated instances, each with its own memory and compute slice.
NVIDIA A100 SXM 80GB, as published by NVIDIA.
Taken from the vendor datasheet. Where a figure is not published, the row is absent rather than estimated.
- Vendor
- NVIDIA
- Architecture
- Ampere (2020)
- Segment
- Datacenter
- Memory
- 80 GB HBM2e
- Memory bandwidth
- 2,039 GB/s
- FP16 / BF16 tensor
- 312 TFLOPS
- FP32
- 20 TFLOPS
- CUDA cores
- 6,912
- Board power
- 400 W
- Form factor
- SXM4
- Interconnect
- NVLink 3, 600 GB/s; PCIe Gen4 64 GB/s
- Multi-instance (MIG)
- Supported by the GPU
- 8-bit float (FP8)
- Not supported — use FP16 or integer quantisation
Source: www.nvidia.com · images.nvidia.com · verified against the vendor document
Software that runs on it
8 templatesPre-built environments, pulled on the node before you land on it. Or bring any OCI image from a public or private registry.
On the spot tier
<5% reclaimed · 30 d- 2 minutes of notice on the metadata endpoint, a webhook and the console
- The instance is stopped, not deleted — disk and IP stay attached
- Auto-relaunch on the next free A100, or switch the same disk to on-demand
- You save $2.40 a day per GPU against on-demand
If the A100 is not the right fit.
Same memory or more, 53% cheaper on spot
H100 NVL 94 GB HBM3 · Hopper $0.49/h spotNext step up in memory: 94 GB instead of 80 GB
A100 40GB 40 GB HBM2 · Ampere $0.09/h spotSame Ampere generation
A10 24 GB GDDR6 · Ampere $0.09/h spotSame Ampere generation
Or put two of them side by side: A100 vs A100 PCIe · A100 vs H100 NVL · A100 vs A100 40GB
A100 SXM 80GB — the questions that come up
How much does an A100 SXM 80GB cost per hour?
Spot is $0.19 per GPU-hour and on-demand is $0.29, both billed per minute — every started minute costs the hourly price divided by 60, so $0.0032 on spot. Reserved capacity is $0.19 per GPU-hour on a monthly commitment. Storage and egress are not included in that rate: persistent disks are $0.08 per GB-month and there are no egress fees.
How many GPUs can I put in one instance?
Node sizes are 1×, 2×, 4×, 8× — up to 8 A100 SXM 80GB GPUs in a single virtual machine, with CPU, RAM and local NVMe scaled with the GPU count. The price per GPU is identical at every node size.
Can it run a 70B model?
Yes. At FP16, a 70B model needs about 140 GB for the weights, so it fits on 4× A100 SXM 80GB ($0.76 per hour on spot) with roughly 20% of the memory left for activations and the KV cache.
Which regions have it?
Available now in US East (Virginia), US West (Oregon), EU Central (Frankfurt). Prices are identical in every region; pick the one closest to your data.
How often is a spot A100 reclaimed?
Over the trailing 30 days, <5% of spot instances on this model were reclaimed. You get a 2-minute notice on the metadata endpoint, through a webhook and in the console; the instance is then stopped, never deleted, and the persistent disk stays attached.
Anything else about this model? Ask an engineer — the same people run the nodes. See also all prices, how we compare with 41 other providers and how to pay in crypto.
An A100 SXM 80GB for $0.19 an hour, running in under 60 seconds.
Prepaid in crypto, pay as you go: no card, no contract, no minimum commitment. Add credit, launch, stop whenever you want.
Billed per minute from the moment the instance is reachable. Minimum credit $30, no subscription. 96 A100 GPUs available right now.