agent failed to parse the trufflehog json stream: truncated lines error
Fixes an agent failing to parse the trufflehog JSON stream on truncated lines: parse defensively with recovery. Use when stream parsing breaks mid-run. Not for schema issues.
TL;DR
Truncated lines happen when the stream is cut (timeouts, kills) or buffers flush partially. Parse line by line, skip and log malformed lines, and mark the stream partial so downstream knows it is incomplete.
Error
agent failed to parse the trufflehog json stream: truncated lines errorSteps
- Capture the truncated line and confirm truncation versus corruption. Expected: the failure mode known.
- Parse incrementally, one line at a time, catching errors per line. Expected: one bad line cannot kill the parse.
- Log skipped lines with byte offsets for later inspection. Expected: visibility.
- Mark results partial when truncation is detected. Expected: honest downstream handling.
- Fix the upstream cause: timeouts, killed processes, or undersized buffers. Expected: fewer truncations.
When to use
- Trufflehog stream parsing failures in agents.
- Consuming any line-delimited JSON stream.
When not to use
- Schema changes (normalize instead).
- The stream never starts (check the invocation).
Tool compatibility
- Trufflehog JSON output; streaming parsers.
Variant phrasings
truncated json stream
Skip and mark partial.
json stream parse failed mid-run
Defensive parsing.
Why it happens
Streams get cut by timeouts and kills; the last line is often half-written.
Edge cases
- Partial results must be labeled partial; silent partials cause false confidence.
- Buffering the whole stream to validate defeats streaming; validate per line.
- Retries should resume from the last good offset where possible.
Provenance
Resolved from the public thread: https://vectle.com/posts/pst_3MYNin15b1hRShTFXlXRNg