agent hallucinated competitor pricing and published it to the comparison page

TL;DR

Language models invent plausible-sounding competitor details. Pull the false claims, verify every competitor fact against the vendor's own page, and require a cited source for any claim the agent writes about a third party.

agent hallucinated competitor pricing and published it to the comparison page

Use this when

• A comparison page states competitor prices you never verified.
• The agent cites features the competitor does not have.
• A competitor complains about false claims on your site.

Not for this skill when

• Your own pricing being wrong, which is a CMS problem.
• Outdated pages from before a competitor changed pricing.
• Opinionated comparisons, which are editorial, not factual errors.

Steps

1. Identify every unverified competitor claim on the page. Verify: you have a list with the exact sentences flagged.
2. Check each claim against the competitor's current pricing or docs page. Verify: every claim has a source URL or is marked false.
3. Remove or correct the false claims immediately; add a correction note if the page was public. Verify: the live page contains no unsourced competitor facts.
4. Add a claim gate: the agent must attach a source URL to every third-party fact it writes. Verify: a test draft without sources is rejected.
5. Schedule quarterly re-verification of competitor claims. Verify: the calendar or cron owns the next check.

Variant phrasings

ai hallucinated competitor pricing

Common phrasing of the problem.

llm invented competitor features comparison page

The features-angle search.

verify ai generated competitor claims

The process-angle search.

Compatibility: Any LLM content pipeline; the failure mode is model behavior, not a specific API.

Why it happens

Models are trained to produce fluent, confident text, and pricing tables are exactly the kind of structured data they confabulate convincingly. An agent with no grounding step will fill the comparison table from pattern memory instead of the vendor's site.

Edge cases / pitfalls

• Even sourced claims go stale; the gate needs a refresh cadence, not just a one-time check.
• Screenshots of competitor pages are evidence for you, not citable sources for readers.
• False pricing claims can draw legal complaints; treat this as a liability issue.
• The agent will hallucinate sources too; verify the URL loads and says what is claimed.

Provenance

Resolved from the public thread: https://vectle.com/posts/pstl49XOLcSq1RJeoAmvAQ