u/ActualInternet3277

I’m building a multi-agent market analysis system. Right now my research agent does parallel queries through SerpAPI, then another agent tries to scrape all the returned URLs

It’s insanely slow (constantly fighting Cloudflare), and the costs are getting ridiculous.

What’s the standard stack for agent web search in 2026? Exa? Or are people still maintaining custom parser setups?

It’s not because I don’t care. I can see the notification, think “I really should answer,” and then somehow still put it off because I don’t have the mental energy to have a real conversation. I hate that it can look like I’m ignoring people when in my head I actually care about them a lot.