u/Gaploid

litellm can pull model_prices_and_context_window.json live from github which is handy, but that file is community maintained. so prices lag, new models take a while to appear (or never do), and sometimes the numbers are just wrong until someone opens a PR. how do you all handle this, just override per model in config?

What I ended up doing is pointing litellm at my own map instead. its the same env var so it works for both the python sdk and the gateway proxy:
export LITELLM_MODEL_COST_MAP_URL="https://cloudprice.net/api/v2/ai/litellm_model_prices.json"

Same schema, we just pull straight from each provider and refresh every day. it also has image/audio/video/rerank/ocr pricing, not just chat/embeddings.

Right now around 340 models come back with pricing thats not in the litellm map at all, mostly fresh releases like openrouter/z-ai/glm-5.2, openrouter/deepseek/deepseek V4 or for vercel.

Its completely free (with some throttling to avoid issues), No key, CORS on.

litellm can pull model_prices_and_context_window.json live from github which is handy, but that file is community maintained. so prices lag, new models take a while to appear (or never do), and sometimes the numbers are just wrong until someone opens a PR. how do you all handle this, just override per model in config?

What I ended up doing is pointing litellm at my own map instead. its the same env var so it works for both the python sdk and the gateway proxy:
export LITELLM_MODEL_COST_MAP_URL="https://cloudprice.net/api/v2/ai/litellm_model_prices.json"

Same schema, we just pull straight from each provider and refresh every day. it also has image/audio/video/rerank/ocr pricing, not just chat/embeddings.

Right now around 340 models come back with pricing thats not in the litellm map at all, mostly fresh releases like openrouter/z-ai/glm-5.2, openrouter/deepseek/deepseek V4 or for vercel.

Its completely free (with some throttling to avoid issues), No key, CORS on.