I found a six figure bug in our payment processor. The fix took 10 minutes then

I got a $25 Starbucks gift card.

I was debugging a customer complaint about a duplicate charge. While tracing the code path, I noticed our retry logic was triggering on a specific timeout case where the payment had actually succeeded. We were re-charging customers when the original charge had cleared but our system hadn't gotten the confirmation in time.

I pulled the logs. It had been happening for about 14 months at a rate of roughly 200 charges per month. We'd been quietly issuing refunds when customers complained, but most of them never noticed because the duplicate posted on their statement as a separate line item.

The financial impact was somewhere around $480K in incorrect charges, plus the refund processing fees, plus the chargeback fees from the customers who escalated to their banks.

The fix was changing one boolean check and adding an idempotency key. About 10 minutes of work and a 6-line PR.

The company's response was a recognition post in the engineering Slack channel and a $25 gift card from the "shout out" program. The same program gives out gift cards for people who organize the team lunch. I left three months later.

reddit.com
u/WorkingAd9155 — 8 days ago

I hate that I got 3 of my coworkers fired

I spent 6 months building an internal tool that automated our data pipeline monitoring and before the tool 4 engineers spent roughly half their time manually checking pipeline health, investigating alerts, restarting failed jobs, and writing status reports and my tool automated all of it. I demoed it to leadership and got a standing ovation (figuratively, it was google meet). My director called it "the most impactful internal project this quarter" and the VP of engineering mentioned it in all hands plus I got a spot bonus.

Two weeks later, a reorg was announced and my own team of 6 was reduced to 3. The three who were let go were the ones whose daily work had been most automated by my tool and the reorg doc cited "operational efficiency gains" as the justification. Nobody blamed me directly but the math was obvious. I built the thing that proved their jobs could be done by software but I wanted to free my teammates from tedious work so they could focus on harder problems and leadership wanted to free themselves from my teammates' salaries.

I've built internal tools since then and I'm more careful now about how I frame the value because I learnt that efficiency in the wrong context isn't a gift to your team. That and a couple tools are still running and the team is still 3 people. They handle the same workload that 6 people did but nobody got a raise.

reddit.com
u/WorkingAd9155 — 12 days ago