Solution skill
OpenAI stream cut off early: tell finish_reason length from a real disconnect
Complete solution
A stream that ends mid-sentence is either the output budget running out (not an error) or the connection dropping (safe to retry). This skill shows how to read the terminal chunk and handle each case correctly.
TL;DR: A stream that ends mid-sentence is either the output budget running out (not an error) or the connection dropping (safe to retry). This skill shows how to read the terminal chunk and handle each case correctly. Confirm the cause Read the last chunk you received: 1. There is no finish_reason because the stream never finished.
The fix
TL;DR: A stream that ends mid-sentence is either the output budget running out (not an error) or the connection dropping (safe to retry). This skill shows how to read the terminal chunk and handle each case correctly. Confirm the cause Read the last chunk you received: 1. There is no finish_reason because the stream never finished.
The symptom
The streamed response stops mid-sentence. Two different causes, two different fixes. Do not retry a budget problem and do not give up on a transport problem.
Confirm the cause
Read the last chunk you received:
- Final chunk carries
finish_reason: "length". The model hit your max output token budget. Not a failure, not a disconnect. The response is complete as far as the API is concerned; it ran out of room. - No terminal chunk arrived at all. The connection dropped, the process was killed, or the client timed out mid-stream. There is no finish_reason because the stream never finished.
- Final chunk has
finish_reason: "stop"but text looks cut off. Rare. Usually the model emitted a stop sequence early or your client truncated rendering. Check raw chunks before blaming the API.
The fix
- finish_reason length: raise the output budget (
max_completion_tokens) or shorten the prompt, then re-request. For continuity, send the partial text back as context and ask the model to continue from exactly where it stopped. - Dropped connection: retry the request. A stream that never completed produced no usable response, so retry is safe. Use generous client timeouts (model latency varies) and make your SSE parser tolerate chunk boundaries splitting mid-JSON.
- Suspected client truncation: log raw chunk counts and byte sizes. Most "the API cut me off" reports are the client giving up.
Verify the fix
After raising the budget, confirm responses end with finishreason stop. Log stream health: chunks received, terminal chunk seen or not, finishreason value. Alert on streams ending with no terminal chunk; those are the real disconnects.
When to use this
- This covers exactly what the title says: OpenAI stream cut off early.
- You are setting this up for the first time, or auditing an existing setup.
- You want the key gotchas in one place before you start.
When not to use this
- You are doing a different workflow with OpenAI; these steps are specific to the title above.
- You need the full reference docs; this is the short path, not the manual.
Compatibility
- Not pinned to a specific version; follows current OpenAI behavior.
Evidence
OpenAI's streaming guide covers streaming API responses; the Chat Completions response object documents finish_reason, where length means the max output token budget was reached. A stream ending with no terminal chunk is a transport failure, distinct from a budget truncation (https://platform.openai.com/docs/guides/streaming).
By @issueatlas · Version 3 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_-KE_ab3M9RQv0pzfi5wYnQ" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">OpenAI stream cut off early: tell finish_reason length from a real disconnect <span>— Vectle</span></a>