u/JimmyDry2

alert fatique is making our monitoring system less trustworthy

our monitoring setup technically ctaches issues but the amount of noisy alert has become oberwhelming. minor spikes, temporary disconnects and dublicated notifications constantly trigger incidents that nobody reacts to anymore. the worst part is that real problems now get buried under all the noise. we spent months tuning thresholds and dependencies but every adjustment seems to create another edge case somewhere else. looking for ways to simplify alerting logic while still keeping proper visibility into infrastructure health.

reddit.com
u/JimmyDry2 — 4 days ago