u/ayushdontfw

has anyone used brightdata's residentials proxies for scraping google ai overview without using serp api , browser api or unlocker api ??

i am currently creating an autonomous web crawler that can scrape response and sources from the google ai overview .

i am using camofoux , and i have some credits in brightdata wallet but when i redirect to google AIO they are constantly giving that 443 error and full access required error which requires KYC bla bla ...

i have already done the kyc last year and i am using it with full access too.

still i keep getting the same error on google domains .

does any of you know how do i overcome this issue ??

i would greatful if you can help me