I'm looking for things like restaurants, plumbers, dentists, agencies...
google maps is great but I'm curious if there are other directories people scrape that are easier to work with
I still use it all the time and love it, but it feels like every automation project on earth runs on Playwright now haha, at some point that has to make life easier for anti-bot companies...
curious if anyone switched to something else and noticed a difference
By warm up I mean just browsing around normally for a bit, opening a few pages, building cookies, spending some time on the site before doing anything
I've seen some people swear it makes a huge difference and others say it's complete bro science
Curious what your experience has been
Is it just me or do residential proxies get burned insanely fast now?
A while ago I could rotate residential IPs and scrape pretty comfortably without too many issues
Now even with “premium” residential or mobile proxies, some sites seem to flag the session almost instantly
I tested: rotating residential, mobile sticky sessions, ISP proxies, Playwright + stealth, anti-detect browser profiles, curl_cffi for lighter scraping
and weirdly sometimes the cheap ISP proxies last longer than the expensive residential ones....
Feels like a lot of anti-bot providers already know most proxy networks and score them before you even start browsing
at this point I’m starting to think session history and real browsing behavior matter more than the proxy itself.
anyone else seeing the same thing lately or am I overthinking it?
Is it just me or do residential proxies get burned insanely fast now?
A while ago I could rotate residential IPs and scrape pretty comfortably without too many issues
Now even with “premium” residential or mobile proxies, some sites seem to flag the session almost instantly
I tested: rotating residential, mobile sticky sessions, ISP proxies, Playwright + stealth, anti-detect browser profiles, curl_cffi for lighter scraping
and weirdly sometimes the cheap ISP proxies last longer than the expensive residential ones....
Feels like a lot of anti-bot providers already know most proxy networks and score them before you even start browsing
at this point I’m starting to think session history and real browsing behavior matter more than the proxy itself.
anyone else seeing the same thing lately or am I overthinking it?
Is it just me or do residential proxies get burned insanely fast now?
A while ago I could rotate residential IPs and scrape pretty comfortably without too many issues
Now even with “premium” residential or mobile proxies, some sites seem to flag the session almost instantly
I tested: rotating residential, mobile sticky sessions, ISP proxies, Playwright + stealth, anti-detect browser profiles, curl_cffi for lighter scraping
and weirdly sometimes the cheap ISP proxies last longer than the expensive residential ones....
Feels like a lot of anti-bot providers already know most proxy networks and score them before you even start browsing
at this point I’m starting to think session history and real browsing behavior matter more than the proxy itself.
anyone else seeing the same thing lately or am I overthinking it?