Login

u/nuno6Varnish

▲ 1 r/LLMDevs

What tool do you use for choosing/comparing models?

Quick question for those who use AI models on their apps/agents.

Do you use a specific tool to find the best one for your use case? Or do it manually? What are the key metrics that you're looking at?

reddit.com
u/nuno6Varnish — 1 day ago
▲ 2 r/AI_Agents

What tool do you use to find the best model?

Quick question for those who use AI models on their apps/agents.

Do you use a specific tool to find the best one for your use case? Or do it manually? What are the key metrics that you're looking at?

reddit.com
u/nuno6Varnish — 1 day ago
▲ 2 r/OpenSourceeAI

I built Manifest, an open source LLM router that reduces AI costs

Manifest is an open source LLM router that helps you to use AI efficiently:

- Isolate each request to attach specific models to it
- Smart routing based on complexity and specificity
- Track every dollar, setup notifications and limits
- Fallback on different models

It works in Cloud or self-hosted version. Works with custom providers, pro subscriptions and local models.

Happy tinkering!

👉 https://github.com/mnfst/manifest

u/nuno6Varnish — 2 days ago
▲ 1 r/AI_Agents

10 Ways To Reduce Your LLM API Costs

Here are 10 ways to reduce LLM API costs on AI applications:

  1. Choose a well-fitted AI model
  2. Use your Pro subscriptions
  3. Reduce output tokens to cut your LLM bill
  4. Use prompt caching when you can
  5. Use Batch API for nightly workflows
  6. Use Flex modes and accept slow tiers
  7. Don't use AI
  8. Use free models and free tiers
  9. Get Big cloud providers' credits
  10. Observe your AI costs and take back control

Are you using one of those? Do you have other methods?

reddit.com
u/nuno6Varnish — 2 days ago