Anyone else seeing LLM send traffic to URLs that don’t exist? (We did, and here’s how we addressed it)
We’ve been noticing something interesting while tracking AI referral traffic.
ChatGPT (and similar LLMs) are sending users to URLs that don’t actually exist on the site, but are close enough to real pages that they look valid.
When users click those, they land on a 404 and drop off, and we end up losing high-intent traffic without even realizing it.
What’s happening here is that LLMs don’t always link to exact URLs. They sometimes generate paths that approximate the right page, but miss the exact structure.
If AI is sending you traffic, there’s a good chance some links are breaking like this
Quick way to check:
- Pull landing pages in GA4 filtered by ChatGPT / AI sources
- Export the URLs
- Run a crawl using the site audit tool
- Check status codes
- Filter for 404s
Those are essentially hallucinated URLs.
Fix:
- Map those URLs to the closest real pages
- Implement 301 redirects
Feels like one of those early AI-search quirks that’s easy to miss if you’re not looking for it