I ran 75 Perplexity searches to see how much the cited sources change
I wanted to understand something about Perplexity that I kept noticing as a user:
When you run the same kind of search more than once, how stable are the sources?
And if you tell Perplexity to use a certain kind of source, does it actually listen?
Quick disclaimer: I’m not affiliated with Perplexity, Fathom, Fireflies, or any of the companies mentioned here. I was just curious about how Perplexity chooses and changes cited sources.
So I ran a small test.
I used one category, AI meeting note tools, and tested five queries:
- best AI meeting note taker for sales calls
- Fathom AI review
- Fathom vs Fireflies
- Fireflies AI review
- Fireflies vs Fathom
For each query, I ran five source conditions:
- normal baseline
- use official pages
- use reviews
- use Reddit / user discussions
- avoid listicles
I repeated each query + condition three times, so 75 searches total.
Then I collected and classified every cited URL: 926 citations.
The short version:
Perplexity can be nudged, but it cannot really be controlled.
The clearest result was Reddit.
When I asked Perplexity to use Reddit or user discussions, it changed the source mix on all 5 queries.
But the other instructions were much weaker:
- “use Reddit” worked on 5/5 queries
- “use official pages” worked on 3/5
- “use reviews” worked on 0/5
- “avoid listicles” worked on 1/5
By “worked,” I mean the three runs under that instruction moved outside the baseline range for the same query. I used that rule because Perplexity naturally varies between runs.
The default source mix also surprised me.
Across all 926 citations, Perplexity cited:
- vendor-owned editorial: 24.3%
- YouTube / creator videos: 14.1%
- third-party comparisons: 13.6%
- Reddit / forums: 12.4%
- third-party listicles: 11.2%
- official product pages/docs: 8.9%
- third-party reviews: 7.1%
- review platforms like G2/Capterra: 6.7%
So the normal answer was not mostly official pages or review platforms. It leaned heavily on vendor-written comparisons, YouTube, third-party comparison pages, listicles, and Reddit.
The “use reviews” result was the strangest to me.
I expected it to pull in more G2, Capterra, hands-on reviews, and user review pages. Instead, it did not create a clean shift at all.
Part of the reason: the baseline was already full of review-like sources. Another part: “review” is not one clean category. Perplexity mixed review platforms, YouTube videos, review blogs, comparison pages, and vendor-written competitor reviews.
Across the test, 50 of the 116 written review articles Perplexity cited were written by vendors themselves.
The “avoid listicles” instruction was also interesting. It only clearly worked on the broad query where listicles dominated. But when listicles were removed, the answers got thinner.
Baseline answers cited about 13.5 sources per run on average. “Avoid listicles” dropped to 9.9.
That changed how I think about source instructions.
They are not a remote control. They are more like a diagnostic.
If “use Reddit” works, there is Reddit/community evidence available.
If “use official pages” works, there is crawlable official material Perplexity can use.
If “avoid listicles” makes the answer thinner, the non-listicle evidence layer may be weak.
If “use reviews” does not move anything, the answer may already be saturated with review-like sources.
Small caveat: this was one engine, one category, 75 searches, and a short time window. I would not treat the exact percentages as universal.
But the pattern was useful:
Perplexity seems easier to nudge toward an existing source layer than to force toward a source type that is weak, missing, or already saturated.
Have you noticed the same thing? When you ask Perplexity to use specific sources, does it actually change the citations, or mostly reshuffle what it was already going to use?