LLM Opex

Models

gpt-oss-120b-Eagle3-short-context: GPU memory and hosting cost

Open weights · 0.79 billion parameters · 131,072-token context · licence other

No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.

Run it yourself

It needs 2 GB of GPU memory at bf16, the precision it ships in.

CloudCheapest instance that fitsGPUsAn hourA month, around the clock
AzureStandard_NV6ads_A10_v51 × A10 4 GB$0.454$331
HF Endpointsaws.nvidia-t4.x11 × T4 14 GB$0.50$365
AWSg4dn.xlarge1 × T4 16 GB$0.526$384
Google Cloudg2-standard-41 × L4 24 GB$0.7068$516
Alibaba Cloudecs.gn6i-c4g1.xlarge1 × T4 16 GB$1.12$816
DeepInfraa100.1x1 × A100 80 GB$1.49$1,088
Crusoel40s.1x1 × L40S 48 GB$1.50$1,095
Nebiusgpu-l40s-a.1gpu-8vcpu-32gb1 × L40S 48 GB$1.55$1,130
OCIVM.GPU.A10.11 × A10 24 GB$2.00$1,460
Core42h100.1x1 × H100 80 GB$2.50$1,825
IBM watsonxdeploy-on-demand.1xL40S1 × L40S 48 GB$4.43$3,234
Fireworks AIh100.1x1 × H100 80 GB$8.00$5,840
Together AIhgx-h100.8gpu8 × H100 80 GB$31.92$23,302

More from NVIDIA

Similar size, open weights

List prices collected 21 November 2026, refreshed every three hours. No negotiated rates or taxes.