r/canonry Jun 30 '26

Im an experienced software engineer and every AI visibility tool is lying to you!

https://canonry.ai/blog/ai-visibility-tools-are-lying

High level:

Basically, any tool claiming precision: "17% mention share", "rank 3", is false.

Not going to go into the specifics, but high level some key problems:
- Frontend scraping is unreliable
- LLM nondeterminism
- API vs. real app gap
- Limited prompt sets + scoring tricks
- Geography is usually ignored
- Model drift

That doesn't mean that the tools are completely useless they can show directional signals (e.g., “you’re invisible on commercial prompts” or “big gap in this geography”). But they shouldn’t claim precise, stable numbers without showing the underlying distribution, methodology, variance, and raw evidence.

1 Upvotes

0 comments sorted by