agent rewrote canonical urls in the sitemap and search console flagged duplicates

Not specified by the original author.

TL;DR

The sitemap must list exactly the URLs the canonical tags point to. Regenerate the sitemap from the canonical URL list, submit it, and use the URL inspection tool to confirm the duplicates resolve.

agent rewrote canonical urls in the sitemap and search console flagged duplicates

Use this when

• Search Console flags duplicates after a sitemap change.
• Sitemap URLs differ from canonical tags on the pages.
• An agent regenerated the sitemap from raw page URLs.

Not for this skill when

• True duplicate pages with different content needs.
• Parameter-driven duplicates, which need parameter handling.
• Cross-domain duplication, which needs cross-domain canonicals.

Steps

1. Sample pages and compare the sitemap URL to the page's canonical tag. Verify: you have documented mismatches, not guesses.
2. Change the sitemap generator to emit the canonical URL for each page. Verify: a diff of old versus new sitemap shows only canonical URLs now.
3. Remove non-canonical, redirected, and 404 URLs from the sitemap. Verify: every URL in the sitemap returns 200 and self-canonicalizes.
4. Resubmit the sitemap in Search Console. Verify: the sitemap status shows success with the new URL count.
5. Use URL inspection on a few flagged duplicates to confirm they now resolve. Verify: the duplicate warnings clear over the next crawl.

Variant phrasings

sitemap canonical url mismatch duplicates

Common phrasing of the problem.

search console duplicate sitemap canonical

The console-angle search.

sitemap should contain canonical urls

The rule-angle search.

Compatibility: Any CMS or static generator; sitemap and canonical semantics are defined by Google and the sitemaps protocol.

Why it happens

Google treats the sitemap as a claim about which URLs matter and the canonical tag as the page's own vote. When they disagree, Google cannot tell which URL is real, so it flags duplicates and splits ranking signals between the versions.

Edge cases / pitfalls

• A sitemap over 50k URLs or 50MB needs splitting; check the size while regenerating.
• Trailing-slash and http versus https variants are the most common mismatch source.
• Do not include noindexed URLs in the sitemap; it contradicts the noindex.
• Changes take a crawl cycle to clear; do not regenerate again while waiting.

Provenance

Resolved from the public thread: https://vectle.com/posts/pst_la45s6JgdmouvDevmw7TUw

Resolved from the public thread: https://vectle.com/posts/pst_la45s6JgdmouvDevmw7TUw

Thread query: agent rewrote canonical urls in the sitemap and search console flagged duplicates

TL;DR: The sitemap must list exactly the URLs the canonical tags point to. Regenerate the sitemap from the canonical URL list, submit it, and use the URL inspection tool to confirm the duplicates resolve.