u/MeringueUnusual9775

I vibe coded a scraper for my business, Scraping bulk urls. Two scripts, two stages:

Stage 1 Python + aiohttp. For each domain a 'GET https://domain\` then `GET http://domain\` if that fails. 50 concurrent requests n 12s timeout. Reads the first 10KB of the response, checks headers + HTML. This stage gets 750+ matches.

Stage 2 takes those 750 matches and does a deeper scrape per domain (looking for more info) using a longer 30s timeout, much lower concurrency (~10 at a time).

The confusing part: 97% of 750 urls which returned html in 12s in stage 1. Came back as "no html" in stage 2, with a longer timeout and way less concurrent load. I isolated a few of these and ran a single bare aiohttp request against them by themselves, no concurrency at all. Result: the connection dies at the raw TCP handshake. it never even completes the SYN/ACK, let alone gets to TLS or HTTP. Plain `curl` against the same domain gives the same result: connect timeout.

A month ago I posted in this community that I built a tool as a freelancer for a client and it works so well I wanted to start my SAAS business. And you guys were pretty positive about it. But now I've got results to show.

Here's the deal, You being a marketing agency needs ecommerce businesses that you can cold outreach and sell them your services, my tool gets you those leads as soon as they hit the market(Sometimes when you visit the site they have a coming soon page and you see them build the website over days) with contact details like email, phone, social media. And the best part i can get you leads from any country of the world.

You specify the platform (like shopify, WordPress, etc) and country and I'll make sure to only get you leads with those filters. I want to scale to 50 agencies signed up in the next 6 months. And If any of you want to know more about it send me a message.

Processing img rp5tifacmx1h1...

It has worked fine for me, besides It saved the file in webp and android's don't play that format well and it not recording any system or mic sound. It did the job for some part. But now the videos are getting glitched. they tear randomly, When played for the first time the glitch was at the last 2 secs, played again now it's in the first 10 secs too. It like a virus spreading. Tried using kazam but idk these screen recorders show black screen when saved. OBS works but that's a little heavy and overkill for my use case. any suggestions?

Being a freelancer building automation solutions (mainly lead gen) I built a tool which finds me e-commerce websites that were created this week( Not bragging but literally I get websites that have a "Coming Soon" page and I see them customize the website over days) and I can filter by platform and country. So if I want WordPress/Shopify stores in USA/CA, I would get 100s of businesses that just came in the market. Now I did delivered the project to the client but I was hoping If I could turn this into SAAS. Would you marketers be interested in such a tool? Because although these leads would be highly in need of marketing they aren't qualified(Not qualified in a sense that they didn't show any interest in your services), but for cold outreach.