Hermes 4 405B: price on every cloud
Open weights · 406 billion parameters · 131,072-token context · licence llama3
Per token, by cloud
| Cloud | Input, per 1M tokens | Output, per 1M tokens | Cheapest region |
|---|---|---|---|
| Nebius | $1.00 | $3.00 | eu-north1 |
| Alibaba Cloud | — | — | not sold per token |
| Anthropic | — | — | not sold per token |
| AWS | — | — | not sold per token |
| Azure | — | — | not sold per token |
| Cloudflare | — | — | not sold per token |
| Core42 | — | — | not sold per token |
| Crusoe | — | — | not sold per token |
| Databricks | — | — | not sold per token |
| DeepInfra | — | — | not sold per token |
| Fireworks AI | — | — | not sold per token |
| Gemini API | — | — | not sold per token |
| Google Cloud | — | — | not sold per token |
| Groq | — | — | not sold per token |
| HF Endpoints | — | — | not sold per token |
| Huawei Cloud | — | — | not sold per token |
| IBM watsonx | — | — | not sold per token |
| Mistral | — | — | not sold per token |
| OCI | — | — | not sold per token |
| OpenAI | — | — | not sold per token |
| Snowflake | — | — | not sold per token |
| Telnyx | — | — | not sold per token |
| Together AI | — | — | not sold per token |
| xAI | — | — | not sold per token |
Run it yourself
It needs 1014.6 GB of GPU memory at bf16, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| Crusoe | mi300x.8x | 8 × MI300X 192 GB | $27.60 | $20,148 |
| Nebius | gpu-h200-sxm.8gpu-128vcpu-1600gb | 8 × H200 141 GB | $43.20 | $31,536 |
| Together AI | hgx-h200.8gpu | 8 × H200 141 GB | $47.92 | $34,982 |
| OCI | BM.GPU.MI300X.8 | 8 × MI300X 192 GB | $48.00 | $35,040 |
| AWS | 2 × p4de.24xlarge, joined by EFA | 8 × A100 80 GB in each | $54.89 | $40,073 |
| Azure | 2 × Standard_ND96amsr_A100_v4, joined by InfiniBand | 8 × A100 80 GB in each | $65.54 | $47,844 |
| Google Cloud | a3-ultragpu-8g | 8 × H200 141 GB | $84.81 | $61,909 |
| Alibaba Cloud | 2 × ecs.gn8v-8x.16xlarge, joined by eRDMA | 8 × GPU H 96 GB in each | $116.98 | $85,397 |
Several servers: the model is sized across identical servers that hold it together, on instance types whose vendor documents a network between servers; the price is all of them. It is shown where no one server holds the model, or where it costs less than the one that does.
At the cheapest per-token price, running it on Crusoe mi300x.8x pays off above roughly 13.4 billion tokens a month.
More from Nous Research
- Hermes-3-Llama-3.1-8B
- Meta-Llama-3.1-8B-Instruct (NousResearch)
- Meta-Llama-3-8B-Instruct (NousResearch)
- Meta-Llama-3-70B-Instruct (NousResearch)
- Llama-3.2-1B (NousResearch)
- Meta-Llama-3.1-8B (NousResearch)
Similar size, open weights
Inside the UAE: no cloud sells it in-country.
List prices collected 4 November 2026, refreshed every three hours. No negotiated rates or taxes.