▲ 17 r/SaaS
even a cheaper model has to earn its place
How are people deciding whether a cheaper LLM is good enough for a feature? because saving on tokens makes total sense but less so if it takes three attempts to get a usable answer. Are you testing it against your current model on real requests or just checking a few outputs before switching?
u/Particular_Car5864 — 4 days ago