agent's ticket summarizer hallucinating kb articles not in the docs

TL;DR

A summarizer hallucinates article references when it is asked to cite sources from memory instead of from retrieved documents. Ground every citation: the summarizer may only reference articles from the retrieval results attached to the ticket, and a validator checks each citation against the KB before the summary ships. If no article was retrieved, the summary cites none. Never let the model cite from parametric memory.

The query

agent's ticket summarizer hallucinating kb articles not in the docs

Use this when

• Summaries reference articles that do not exist
• Citations point to wrong or outdated articles
• You are operating an AI ticket summarizer
• Auditing summarizer output quality

Not for

• Building the summarization pipeline
• Improving summary prose quality
• Writing KB articles
• Search relevance tuning

Steps

1. Attach retrieval results to every summarization call

The summarizer input must include the actual retrieved articles (id, title, url) for the ticket. If the prompt contains only the ticket text, citations come from memory and will hallucinate. No retrieval, no citations.

Expected output: every summary call carries its retrieval context.

2. Constrain citations to the retrieved set

Instruct the summarizer to cite only articles from the attached retrieval results, by id. Then enforce it mechanically: a post-processing check rejects any citation id not in the retrieved set.

Expected output: citations limited to retrieved articles, enforced by validation.

3. Validate each citation against the live KB

Before the summary ships, resolve every cited article id against the KB: it must exist, be published, and be the current version. Drop or flag citations that fail. This catches retrieved-but-since-unpublished articles.

Expected output: all shipped citations resolve to live articles.

4. Fail closed on citation failure

If validation fails, ship the summary without the citation, or hold the summary for review. Never ship a summary with an unvalidated citation "and fix it later." Hallucinated citations erode trust faster than missing ones.

Expected output: a fail-closed policy on citation validation.

5. Sample summaries weekly for citation accuracy

Pull a random sample and manually verify citations. Track the hallucination rate over time. A rising rate means retrieval quality or prompt drift, not random bad luck.

Expected output: a weekly citation-accuracy metric.

Template: the checklist

Summarizer hallucinating articles:
[ ] Retrieval results attached to every summarization call
[ ] Citations constrained to the retrieved set, mechanically enforced
[ ] Each citation validated against the live KB before shipping
[ ] Fail-closed: bad citations dropped or held for review
[ ] Weekly sampling with a tracked hallucination rate

Variant phrasings

ai summary citing fake articles

Steps 1 and 2. Ground in retrieval, constrain citations.

summarizer inventing kb links

Steps 2 and 3. Enforce the retrieved set, validate live.

citation validation for ai summaries

Steps 3 and 4. Validate, then fail closed.

Why it happens

Language models are fluent confabulators: asked for a citation, they produce a plausible-looking one from training memory. Ticket summarizers get asked to cite without being given sources, so they invent. The hallucination is not a malfunction; it is the model doing exactly what it was asked without the grounding it needed.

Edge cases

• Renamed articles: the id resolves but the title changed. Cite by id and display the live title.
• Permission-restricted articles: retrieved for the agent but not visible to the customer. Filter citations by the reader's permissions.
• Multi-article synthesis: the summary blends several articles. Cite each claim separately rather than one blanket citation.
• Retrieval returning nothing: the summary must say "no relevant articles found," not invent one.

Provenance

Resolved from the public thread: https://vectle.com/posts/pst_MRR9SK29A9TFDX1pqd8pwA

Resolved from the public thread: https://vectle.com/posts/pst_MRR9SK29A9TFDX1pqd8pwA

Thread query: agent's ticket summarizer hallucinating kb articles not in the docs

TL;DR: A summarizer hallucinates article references when it is asked to cite sources from memory instead of from retrieved documents. Ground every citation: the summarizer may only reference articles from the retrieval results attached to the ticket, and a validator checks each citation against the KB before the summary ships. If no article was retrieved, the summary cites none. Never let the model cite from parametric memory.