Qwen3.8-2.4T-A95B-FP8: GPU memory and hosting cost
Open weights · 2446.18 billion parameters · Mixture of experts · 262,144-token context · licence other
No cloud sells this model per token: to use it you run it yourself, on GPU instances you rent.
Run it yourself
It needs 3057.7 GB of GPU memory at fp8, the precision it ships in.
| Cloud | Cheapest instance that fits | GPUs | An hour | A month, around the clock |
|---|---|---|---|---|
| OCI | 2 × BM.GPU.MI300X.8, joined by RDMA cluster network | 8 × MI300X 192 GB in each | $96.00 | $70,080 |
| Nebius | 3 × gpu-h200-sxm.8gpu-128vcpu-1600gb, joined by InfiniBand | 8 × H200 141 GB in each | $129.60 | $94,608 |
| AWS | 5 × p4de.24xlarge, joined by EFA | 8 × A100 80 GB in each | $137.24 | $100,182 |
| Azure | 2 × Standard_ND96isr_MI300X_v5, joined by InfiniBand | 8 × MI300X 192 GB in each | $137.28 | $100,214 |
| Alibaba Cloud | 4 × ecs.gn8v-8x.16xlarge, joined by eRDMA | 8 × GPU H 96 GB in each | $233.96 | $170,793 |
| Google Cloud | 3 × a3-ultragpu-8g, joined by GPUDirect RDMA | 8 × H200 141 GB in each | $254.42 | $185,727 |
Several servers: the model is sized across identical servers that hold it together, on instance types whose vendor documents a network between servers; the price is all of them. It is shown where no one server holds the model, or where it costs less than the one that does.
More from Qwen
- Qwen3.8 27B
- Qwen3 32B
- Qwen3 235B A22B Instruct 2507
- Qwen3 30B A3B Instruct 2507
- Qwen3.5 397B A17B
- Qwen3 235B A22B
Similar size, open weights
List prices collected 21 November 2026, refreshed every three hours. No negotiated rates or taxes.