LLM Opex

Models

NVIDIA models: prices and the hardware each needs

52 models, 0 sold per token by 0 vendors. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.

ModelSizeSold per token byFrom, inputOutputGPU memory
diffusiongemma-26B-A4B-it-NVFP425.82 Bnot sold per token16.1 GB
Gemma-4-26B-A4B-NVFP425.81 Bnot sold per token16.1 GB
Gemma-4-31B-IT-NVFP431.27 Bnot sold per token19.5 GB
GLM-5.2-NVFP4743.38 Bnot sold per token464.6 GB
GLM-5.3-NVFP4 (nvidia)753.33 Bnot sold per token470.8 GB
gpt-oss-120b-Eagle3-short-context0.79 Bnot sold per token2 GB
gpt-oss-120b-Eagle3-v30.79 Bnot sold per token2 GB
Kimi-K2-Thinking-NVFP41026.41 Bnot sold per token641.5 GB
Kimi-K2.5-NVFP41026.88 Bnot sold per token641.8 GB
Llama-3.1-8B-Instruct-FP88.03 Bnot sold per token10 GB
Llama-3.1-Nemotron-70B-Instruct-HF70.55 Bnot sold per token176.4 GB
Llama-3.1-Nemotron-Nano-8B-v18.03 Bnot sold per token20.1 GB
Llama-3_3-Nemotron-Super-49B-v149.87 Bnot sold per token124.7 GB
Llama-3_3-Nemotron-Super-49B-v1_549.87 Bnot sold per token124.7 GB
Llama-3_3-Nemotron-Super-49B-v1_5-FP849.87 Bnot sold per token62.3 GB
MiniMax-M2.5-NVFP4228.69 Bnot sold per token142.9 GB
Mistral-Medium-3.5-128B-NVFP4127.7 Bnot sold per token79.8 GB
Mistral-NeMo-Minitron-8B-Instruct8.41 Bnot sold per token21 GB
Nemotron-3.5-Parse0.63 Bnot sold per token3.1 GB
Nemotron-H-56B-Base-8K56.32 Bnot sold per token140.8 GB
Nemotron-H-8B-Base-8K8.1 Bnot sold per token20.2 GB
Nemotron-Labs-Diffusion-14B13.51 Bnot sold per token33.8 GB
Nemotron-Labs-Diffusion-3B3.83 Bnot sold per token9.6 GB
Nemotron-Labs-Diffusion-8B8.49 Bnot sold per token21.2 GB
Nemotron-Labs-Diffusion-8B-Base8.49 Bnot sold per token21.2 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF1631.58 Bnot sold per token78.9 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-BF1631.58 Bnot sold per token78.9 GB
NVIDIA-Nemotron-3-Nano-30B-A3B-FP831.58 Bnot sold per token39.5 GB
NVIDIA-Nemotron-3-Nano-4B-BF163.97 Bnot sold per token9.9 GB
NVIDIA-Nemotron-3-Nano-4B-FP83.97 Bnot sold per token5 GB
NVIDIA-Nemotron-3-Super-120B-A12B-BF16123.61 Bnot sold per token309 GB
NVIDIA-Nemotron-3-Super-120B-A12B-FP8123.61 Bnot sold per token154.5 GB
NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4123.61 Bnot sold per token77.3 GB
NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16560.52 Bnot sold per token1401.3 GB
NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4560.52 Bnot sold per token350.3 GB
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-Base-BF1631.58 Bnot sold per token78.9 GB
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF1631.58 Bnot sold per token78.9 GB
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP432.91 Bnot sold per token20.6 GB
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-DSpark0.76 Bnot sold per token1.9 GB
NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP465.77 Bnot sold per token93.8 GB
NVIDIA-Nemotron-Nano-9B-v28.89 Bnot sold per token22.2 GB
NVIDIA-Nemotron-Nano-9B-v2-FP88.89 Bnot sold per token11.1 GB
Qwen2.5-VL-7B-Instruct-NVFP48.29 Bnot sold per token5.2 GB
Qwen3-14B-FP8 (nvidia)14.77 Bnot sold per token18.5 GB
Qwen3-14B-NVFP414.77 Bnot sold per token9.2 GB
Qwen3-30B-A3B-NVFP430.53 Bnot sold per token19.1 GB
Qwen3-8B-NVFP48.19 Bnot sold per token5.1 GB
Qwen3.5-122B-A10B-NVFP4122.56 Bnot sold per token76.6 GB
Qwen3.5-397B-A17B-NVFP4396.8 Bnot sold per token248 GB
Qwen3.6-27B-NVFP427.36 Bnot sold per token17.1 GB
Qwen3.6-35B-A3B-NVFP435.11 Bnot sold per token21.9 GB
Qwen3.8-27B-NVFP427.36 Bnot sold per token17.1 GB