r/apify

▲ 3 r/apify

Weekly: one cool thing

Have you come across a great Actor, workflow, post, or podcast that you want to share with the world? This is your opportunity to support someone making cool things. Drop it here with credit to the creator, and help expand the karmic universe of Apify.

reddit.com
u/AutoModerator — 13 hours ago
▲ 2 r/apify

LinkedIn Email Finder Actor for profile enrichment

I've been maintaining this Actor for a while and thought it might be useful to others here.

It takes LinkedIn profile URLs and attempts to find work email addresses, along with basic details like company and domain when available. It's built for bulk processing and works well in Apify workflows.

Feedback is always welcome.

https://apify.com/vulnv/linkedin-email-finder

u/cl-dev — 16 hours ago
▲ 3 r/apify

Weekly: no stupid questions

This is the thread for all your questions that may seem too short for a standalone post, such as, "What is proxy?", "Where is Apify?", "Who is Store?". No question is too small for this megathread. Ask away!

reddit.com
u/AutoModerator — 4 days ago
▲ 12 r/apify

The Apify has 45k scrapers now. Who's actually making money?

Last week it was 39k actors. Today it's 45k. The growth is wild but the distribution isn't.

I have 32 scrapers listed. I'm pretty happy with the quality, customers tell us they beat the competition. But only 1 generates any real revenue (~$1.5k this month, sitting at #9 in its category). The other 31 are basically invisible.

It feels more winner take all than ever. The top actors get traffic, the rest get nothing regardless of quality.

Anyone else building on the marketplace seeing the same thing? Is discoverability just broken or is there something that actually moves the needle?

reddit.com
u/Open_Ingenuity_3613 — 7 days ago
▲ 1 r/apify

I scraped the entire RapidAPI marketplace into structured data (pricing, popularity, latency, publishers). The data is JS-gated, here's the trick.

I wanted a clean dataset of every API on the RapidAPI marketplace, sortable by pricing model, popularity, reliability, and publisher, so I could actually compare options instead of clicking through cards. Nothing existed that was cheap and structured, so I built one and put it on Apify.

The interesting part (for the scraping folks): RapidAPI's listing data is not in the page HTML. It loads client-side through an internal GraphQL gateway, and a plain request to that gateway returns 403 Forbidden from upstream. Even a real, logged-in browser session gets blocked if you replay the call directly.

What actually works:

  • GET https://rapidapi.com/gateway/csrf first. It returns a { csrfToken } and sets a session cookie.
  • Then POST https://rapidapi.com/gateway/graphql with that csrf-token header (plus rapid-client: hub-service and the cookie jar) and the searchApis operation. Cursor-paginated, capped at 1000 per term.
  • For full per-API detail (billing plans, ratings, subscriber count, readme, website), the API's own page server-renders everything into the Next.js RSC flight data, so you just GET /{publisher}/api/{slug} and parse the __next_f chunks. No gateway auth needed for that path.

The nice payoff: no headless browser required. The whole thing runs in 128 MB with plain HTTP, which keeps it fast and cheap.

What it pulls per API: name, description, pricing model (FREE/FREEMIUM/PAID), category, popularity score, avg latency, success rate, publisher, billing plans, ratings, subscriber count, and the listing URL.

Useful for: finding every API for a given keyword or category, market research on how APIs price themselves, and competitive intel on who's winning a niche.

It's pay-per-result (about $0.0001 per result, roughly 6x cheaper than the other RapidAPI scrapers on the store), and it's also exposed as an MCP tool so you can hand it to an AI agent.

Link: https://apify.com/johnvc/rapidapi-marketplace-api

reddit.com
u/ApifyEnthusiast1 — 6 days ago
▲ 8 r/apify

Apify is live on x402!

We just 10x'd the number of endpoints available on x402

In partnership with Coinbase, Apify is now the first community-driven marketplace on x402: AI agents can discover, pay for, and run more than 20,000 Apify Actors on their own - no account, no subscription, no API key, no human in the loop. Just a funded wallet and an HTTP request.

x402 is the open payment standard built by Coinbase (now governed by the Linux Foundation) that lets agents pay per call in USDC. As of today, all PPE priced Actors are callable through it.

What this means if you build Actors

Agents are a new kind of customer. When an autonomous agent runs your Actor, you earn per event - no seat to sell, no subscription, no human deciding to sign up first. We're still in the first inning of the agentic economy, and Apify is the first community driven marketplace to pioneer its adoption.

One catch: x402 only works with PPE Actors

Only pay-per-event (PPE) Actors are eligible. If your Actor is still using a rental pricing model, switching to PPE is how you put it in front of autonomous agents. PPE pricing docs are here.

Try it / learn more

Help us amplify the launch

Click here to discover Apify endpoints on agentic.market

youtu.be
u/ellatronique — 6 days ago
▲ 3 r/apify+1 crossposts

I published an Apify actor for earnings call transcripts + SEC 8-K filings

For the record this is my own actor.

I have published an actor that scrapes structured earnings call transcripts and parsed SEC 8-K filings for any US public company.

What it returns:

  • 8-K filings with event classification
  • Guidance language extraction
  • Earnings call transcripts
  • Works for any US-listed ticker on demand

https://apify.com/filingapi/my-actor

https://filingapi.dev

What I need is feedback, and there is no better community than here. If you use it, let me know if it is tailored to your needs.

u/ShowEuphoric — 7 days ago
▲ 9 r/apify

What makes you trust an Apify Actor before running it?

I’ve been improving my Apify Actor portfolio and one thing became clear:

A working Actor is only half the job.

Before users run an Actor, they need to quickly understand what it does, what input it needs, what output they will get, and roughly what it may cost.

Recently I focused on:

- Ready-to-run example tasks

- Small default inputs

- Cleaner dataset columns

- Clearer pricing

- Better README and input schema text

Question for other Actor builders and users:

What matters most to you before trying a new Actor?

  1. README clarity

  2. Example task

  3. Output preview

  4. Pricing clarity

  5. Input schema simplicity

Curious to learn what makes an Actor feel trustworthy before the first run.

reddit.com
u/FickleConnection2532 — 9 days ago
▲ 1 r/apify

How to Determine if an Actor is Worth Investing in Building?

Before building an Actor, what are specific ways that can tell me if an Actor is likely to succeed (supposing it works reliably)? What makes it worth investing time and effort in building? How do I get traffic? What is the average time it takes an Actor to start picking up traffic? I hope someone answers these questions for me. Thanks.

reddit.com
u/Coding-Doctor-Omar — 8 days ago
▲ 3 r/apify

Complete Data Extraction & Automation Suites for LinkedIn, Instagram, TikTok, YouTube, Google Maps, and More, Now Available on Apify

We’re excited to announce the launch of our comprehensive crawler and automation suites on Apify, covering some of the world's most popular platforms, including LinkedIn, Instagram, TikTok, YouTube, Google Maps, and many more.

Our goal has been to build a complete ecosystem of reliable, production-ready actors that address a wide range of data extraction, lead generation, market research, competitor analysis, and business intelligence use cases. We've worked hard to cover as many real-world scenarios as possible and continue to expand our offerings based on user feedback.

You can explore our full collection here:

🔹 Apify Store: www.apify.com/crawlerbros
🔹 Website: https://www.crawlerbros.com/

If you have a specific use case that isn't currently covered, we'd love to hear from you. We regularly build custom solutions and are always looking for new ideas to help businesses, researchers, and developers automate their workflows more effectively.

Feedback, feature requests, and suggestions are always welcome.

u/_mad_gamerx — 11 days ago
▲ 18 r/apify+10 crossposts

Infranode: keyless, Open Source MCP Server for AI agents .

Hi all, I built InfraNode, an open-source (Apache-2.0) MCP server that gives AI assistants live open data for 84 German cities: weather, air quality, public transit departures, parking, bike counts, solar potential and more, all from official open-data sources.

Why it might interest this community:
- Keyless and hosted. Point your client at the remote server (mcp.infranode.dev, streamable-http) and the tools just work. No signup, no API key.
- Around 48 read-only tools, plus a get_city_overview discovery tool so an agent can see in one call which data a given city offers and which tool to use next.
- The same data is also a plain REST API, so it works outside MCP too.

Repo: https://github.com/street1983nk/infranode
Docs: https://infranode.dev

Full disclosure: I am the author. I would love feedback on the tool design and especially the discovery flow.

u/Fabulous-Rub-7301 — 11 days ago