LLM Opex

GPU prices per hour on every cloud

The on-demand list price of an hour of one GPU, on each cloud that rents it.

GPUMemoryFrom, per GPU-hourCheapest onRented by
H200141 GB$3.49DeepInfraDeepInfra, Core42, Crusoe, HF Endpoints, Nebius, Together AI, AWS, Fireworks AI, OCI, Google Cloud, Azure, IBM watsonx
H10080 GB$2.50Core42Core42, DeepInfra, Crusoe, Together AI, Nebius, AWS, Azure, Fireworks AI, OCI, Google Cloud, IBM watsonx
A10080 GB$1.49DeepInfraDeepInfra, Crusoe, HF Endpoints, AWS, Azure, Google Cloud, OCI, IBM watsonx
B200180 GB$4.89DeepInfraDeepInfra, Core42, Nebius, Together AI, Fireworks AI, OCI, AWS
L40S48 GB$1.50CrusoeCrusoe, Nebius, HF Endpoints, AWS, OCI, IBM watsonx
B300270 GB$5.89DeepInfraDeepInfra, Nebius, Fireworks AI, OCI, AWS
MI300X192 GB$3.45CrusoeCrusoe, Core42, OCI, Azure
T414 GB$0.50HF EndpointsHF Endpoints, AWS, Azure, Alibaba Cloud
A104 GB$0.454AzureAzure, Alibaba Cloud, OCI
L424 GB$0.70HF EndpointsHF Endpoints, Google Cloud, AWS
RTX PRO 600024 GB$1.44AzureAzure, Nebius, Google Cloud
A10G24 GB$1.00HF EndpointsHF Endpoints, AWS
GB200192 GB$16.00OCIOCI, Azure
GB300278 GB$18.00OCIOCI, Fireworks AI
GPU H96 GB$7.19Alibaba CloudAlibaba Cloud
L2048 GB$2.25Alibaba CloudAlibaba Cloud
L20N72 GB$6.29Alibaba CloudAlibaba Cloud
MI355X288 GB$8.60OCIOCI