Login

r/ManifestforAI

▲ 7 r/ManifestforAI+5 crossposts

What are your biggest pains running AI SDK apps in production?

I'm trying to understand what teams building with AI SDKs struggle with the most once their app is in production.

So far I've heard a few things come up. Some people don't know which model to pick for each task and don't have a week to benchmark everything. Others mentioned costs creeping up but struggling to switch to cheaper models without breaking quality on edge cases.

I'd love to hear what's on your list. If you have 30 seconds, please drop your top 1 or 2 pains in the comments with a bit of context.

reddit.com
u/stosssik — 3 days ago
▲ 26 r/ManifestforAI+6 crossposts

What's your actual use case with your agent, and which model do you pair it with?

I'm running a benchmark to figure out which models give the best price-to-quality ratio for different tasks. I will publish it once finished. While I crunch the numbers, I'd love to hear from your side:

  1. Your use case
  2. The model you use for it
  3. Why that pairing works for you
u/stosssik — 8 days ago