LLM Opex

Models

BigScience models: prices and the hardware each needs

3 models, 0 sold per token by 0 vendors. Vendors are in alphabetical order; the price is the cheapest list price among them, per million tokens.

ModelSizeSold per token byFrom, inputOutputGPU memory
bloom-1b11.07 Bnot sold per token2.7 GB
bloom-560m0.56 Bnot sold per token1.4 GB
bloomz-560m0.56 Bnot sold per token1.4 GB