LLM Opex

LLM hosting by vendor

Every vendor compared: what it sells for running language models, from its public list prices, and where it runs.

VendorKindModels sold per tokenKinds of GPURegionsCountries
Alibaba CloudHyperscaler851112
AnthropicModel maker1301one price
AWSHyperscaler3493627
AzureHyperscaler3985032
CloudflareEdge network, Per-token API1601one price
Core42Sovereign cloud22443
CrusoeGPU cloud, Per-token API451one price
DatabricksData platform43011
DeepInfraInference provider, Per-token API, GPU cloud3651one price
Fireworks AIInference provider, Per-token API, GPU cloud6521
Gemini APIModel maker301one price
Google CloudHyperscaler05226
GroqInference provider, Per-token API301one price
HF EndpointsModel hub, Dedicated endpoints071one price
Huawei CloudHyperscaler, Per-token API401one price
IBM watsonxEnterprise AI platform341one price
MistralModel maker401one price
NebiusGPU cloud, Per-token API17696
OCIHyperscaler7111123
OpenAIModel maker901one price
SnowflakeData platform4601one price
TelnyxInference API8021
Together AIGPU cloud, Per-token API731one price
xAIModel maker601one price