LLM Opex

Vendors

Google Cloud

Google Cloud sells Gemini and partner models per token through Vertex AI and rents GPU machines by the hour on Compute Engine.

Google Cloud sells 0 of the compared models per token and prices 5 kinds of GPU for hosting your own.

GPUs for hosting your own

On demand.
GPUFrom, per GPU-hourCheapest instanceGPUs in it
L4$0.7068g2-standard-41 × 24 GB
A100$3.48a2-megagpu-16g16 × 40 GB
RTX PRO 6000$4.50g4-standard-481 × 96 GB
H200$10.60a3-ultragpu-8g8 × 141 GB
H100$11.06a3-highgpu-8g8 × 80 GB

Where it runs

1 region in 1 country.

CountryRegionsPer-token modelsGPU kinds
United Statesus-central1—6

Where the prices come from

Sources

List prices collected 4 November 2026, refreshed every three hours. No negotiated rates or taxes.