LLM Opex

GPUs

A100: price per hour on every cloud

An hour of one A100 (80 GB) costs from $1.49 on DeepInfra. 8 clouds rent it on demand.

CloudPer GPU-hourCheapest instanceGPUs in itInstance, an hourRegionInstances with it
DeepInfra$1.49a100.1x1 × 80 GB$1.49global1
Crusoe$2.00a100-pcie.1x1 × 80 GB$2.00global2
HF Endpoints$2.50aws.nvidia-a100.x11 × 80 GB$2.50global8
AWS$2.74p4d.24xlarge8 × 40 GB$21.96us-east-12
Azure$3.40Standard_ND96asr_v48 × 40 GB$27.20eastus5
Google Cloud$3.48a2-megagpu-16g16 × 40 GB$55.74us-central19
OCI$4.00BM.GPU.A100-v2.88 × 80 GB$32.00global1
IBM watsonx$5.80deploy-on-demand.1xA1001 × 80 GB$5.80global4

What one of them can run

List prices collected 22 November 2026, refreshed every three hours. No negotiated rates or taxes.