▲ 9 r/AISystemsEngineering+2 crossposts

As an AI engineer what is your biggest frustation

I work for a dev tool company primarily associated with observabity,evals and gateways. (am not mentioning the name of the company cause i dont want to pitch or sell you guys something). Do you guys think that something breaking in prod and getting to know it from users and then spending time on debugging is actually a frustation or pain point for you guys. Or is it something like a false belief the company has

reddit.com
u/AppropriateLock2737 — 11 days ago
▲ 7 r/LangChain+1 crossposts

How do you actually debug your AI agents?

I've been running AI agents in production for 6 months (Cursor, Claude Code, custom Mastra pipelines) and debugging them is still a nightmare.

Last week alone:

- An agent silently hallucinated a config value. Caught it 2 days later.

- A regression after updating my prompt — no idea when it broke

- $80 in API costs on a task I thought would cost $8

I'm spending more time reading logs than actually building.

How are you handling this? Are you just manually reviewing outputs? Built something internally? Given up and just accepting the chaos?

Genuinely curious if this is just me or if it's a shared pain.

reddit.com
u/AppropriateLock2737 — 5 days ago