My AI visibility tracker was silently losing 30% of its measurements
I run a small AI visibility tracker that I built myself, and last week I found something in my own pipeline that I have not seen anyone talk about.
I ask each question 7 times per platform so I can show a range instead of a single number. One week Perplexity came back much lower than usual for every domain I track. I assumed those brands had actually lost ground.
They had not. Perplexity was rate limiting me. About 30% of my requests were coming back 429, and my code was quietly counting those as "not mentioned" instead of "not measured". So that platform was being scored on 5 runs while the others got 35, and the smaller sample dragged the number down.
The fix was not sending fewer requests. It was spacing them out. The limit turned out to be roughly one request per second per account, and two scans running at the same time were stepping on each other.
Here is why I am posting it. A failed measurement and a real absence look identical once they land in a chart. My tool now prints how many runs failed right under the percentage, because I could not trust my own number until it did.
So if you are evaluating any of these tools, including mine, that is the question I would ask. Not how many platforms, not how many prompts. Ask what happens when a request fails, and whether the report tells you.
Disclosure: the tool is AnswerRadar and it is mine. Not linking it, this is not a pitch.