One shot prompt checks are noise. Here is the run count I settled on.
Early on I would prompt ChatGPT once, see my brand and call it *visible*. Then I would check the next day and it was gone. The models are non-deterministic, so a single run tells you almost nothing.
The data backs this up: studies show only around 20% of brands stay visible across five consecutive runs of the same prompt. Visible once does not mean visible.
The method that fixed it for me:
1/ Run each prompt at least 5 to 10 times (more for high-value prompts).
2/ Score it as a frequency, not a yes/no. *Appeared in 6 of 10 runs = 60%.*
3/ Spread runs across different days, because model updates and load shift results.
4/ Re-baseline after any known model version bump.
This turns a coin flip into something you can trend. It also kills the false panic when a brand *disappears* from one lucky run.
What run count is everyone else using? And do you vary temperature or keep it fixed to reduce variance?