Which is the best web scraping API for e-commerce sites?
I'm looking for a web scraping API for a SaaS that will primarily scrape Amazon, along with some Walmart data and a few smaller e-commerce websites. We'll probably add more retailers over time, so I need something that works reliably across a broad range of domains.
I have been comparing providers like Bright Data, Zyte, ScrapingBee, ScraperAPI, and Scrape.do, but the pricing is difficult to compare.
Its not just that the prices shown on their pricing pages are different. The effective cost also seems to vary significantly depending on the website being scraped. Some APIs use more credits for particular domains, premium proxies, JavaScript rendering, etc.
Ideally, I want the cheapest API that still performs reliably across all our target websites. I don't want to save money on Amazon only to discover that the same provider is expensive or unreliable on Walmart and the smaller sites.
Is there one web scraping API that offers consistently good price-to-performance across different e-commerce domains, or do you generally need to use multiple providers?