LLM Opex

Models

Microsoft models: prices and the hardware each needs

19 models, 1 sold per token by 2 vendors. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.

ModelSizeSold per token byFrom, inputOutputGPU memory
maira-26.88 Bnot sold per token34.4 GB
phi-11.42 Bnot sold per token3.5 GB
phi-1_51.42 Bnot sold per token3.5 GB
phi-22.78 Bnot sold per token6.9 GB
Phi-3-medium-4k-instruct13.96 Bnot sold per token34.9 GB
Phi-3-mini-128k-instruct3.82 Bnot sold per token9.5 GB
Phi-3-mini-4k-instruct3.82 Bnot sold per token9.5 GB
Phi-3-small-8k-instruct7.39 Bnot sold per token18.5 GB
Phi-3-vision-128k-instruct4.15 Bnot sold per token10.4 GB
Phi-3.5-mini-instruct3.82 Bnot sold per token9.5 GB
Phi-3.5-MoE-instruct41.87 Bnot sold per token104.7 GB
Phi-3.5-vision-instruct4.15 Bnot sold per token10.4 GB
Phi-414 BAzure, DeepInfra$0.07$0.1436.6 GB
Phi-4-mini-instruct3.84 Bnot sold per token9.6 GB
Phi-4-mini-reasoning3.84 Bnot sold per token9.6 GB
Phi-4-multimodal-instruct5.57 Bnot sold per token13.9 GB
Phi-4-reasoning14.66 Bnot sold per token36.6 GB
Phi-mini-MoE-instruct7.65 Bnot sold per token19.1 GB
Phi-tiny-MoE-instruct3.76 Bnot sold per token9.4 GB