▲ 1 r/SideProject
Built something to lower LLM costs and improve output for devs
Whenever I'm building an AI-based feature for one of my products I always wonder which LLM is going to give me the best output for the lowest price.
And I kept building small internal tools for each one of my use cases in order to test multiple models at once.
Until a friend told me I was stupid and should just build a way for Claude or Codex to test models directly.
So I built exactly that.
LLMTest is the smart alternative to OpenRouter.
It connects to every major LLM provider (and quite a few more minor ones) and allows you to easily:
- Automatically benchmark LLM models for your specific use case and optimize for your goals (speed, quality, cost)
- Optimize your prompts so you can maintain or increase quality while consuming less tokens
- Configure fallbacks for whenever a provider is down or if a JSON is broken
- Plug only one API and connect to hundreds of models
You can start playing around with it for 5 bucks if you're interested
u/GrowthTomatoes — 20 days ago