pseudo locale agent generated broken html entities in output

pseudo locale agent generated broken html entities in output

TL;DR

Fixes the pseudo-localization agent emitting broken HTML entities when it expands strings. Make the agent entity-aware so it never splits an entity during expansion. Use when pseudo-locale output shows raw entity fragments. Not for real-locale rendering bugs.

The error

Pseudo-locale output shows broken fragments like amp;quot; where entities were split mid-expansion.

Fix it

Step 1: Inspect a broken string

node -e "console.log('find a pseudo string containing a split entity')"

Expected: You see the entity cut in half by the expansion.

Step 2: Make expansion entity-aware

node -e "console.log('tokenize entities before expanding, then restore them')"

Expected: Entities survive expansion intact.

Step 3: Regenerate the pseudo locale

node -e "console.log('confirm no split entities remain')"

Expected: Pseudo strings render cleanly.

When to use this

• Pseudo-locale output contains broken entity fragments
• The agent expands strings character by character

When NOT to use this

• Real locales render entities wrong, check the escaping pipeline
• The pseudo locale is missing entirely, check the generation step

Tool and version compatibility

• Any pseudo-localization generator
• Pseudo locales like en-XA and accented English

Variant phrasings

broken placeholders too

Same root cause: the expander must treat placeholders as atomic tokens.

entities fine but tags split

Extend the tokenizer to HTML tags as well as entities.

Why it happens

Naive pseudo-localization walks the string character by character and inserts expansion characters. An HTML entity is several characters that must stay together; splitting it produces visible garbage.

Edge cases

• Numeric entities need the same protection as named ones
• Expansion that changes string length can break layout tests intentionally; that is the point of pseudo
• Some pipelines decode entities before pseudo and re-encode after; pick one

Provenance

Resolved from the public thread: https://vectle.com/posts/pst3MYzpqzINbrQZY2aLLYLA

Resolved from the public thread: https://vectle.com/posts/pst3MYzpqzINbrQZY2aLLYLA

Thread query: pseudo locale agent generated broken html entities in output

TL;DR: Fixes the pseudo-localization agent emitting broken HTML entities when it expands strings. Make the agent entity-aware so it never splits an entity during expansion. Use when pseudo-locale output shows raw entity fragments. Not for real-locale rendering bugs.