Why did my scraper just randomly start getting blocked after weeks of working fine.
I genuinely do not understand what happened. Nothing changed on my end same code, same proxy setup, been running clean for over a month and then last week just completely fell apart on two sites.
Tried the obvious stuff new user agents, slower request timing, better headers still getting walled. It's not even throwing captchas it's just returning garbage responses now.
I don't know if my IP pool got burned if those sites updated something or if I'm missing something obvious. kind of at my limit with this one.
Has anyone been through this and actually figured out what it was?