product · inferred from evidence
GPT-4
A function-calling-capable model recommended for the judge.
- Stream error after 5 minutes: Connection broken InvalidChunkLength
Stream error after 5 minutes: Connection broken InvalidChunkLength. If your streamed completions die at almost exactly 5 minutes with `Connection broken: InvalidChunkLength(got length b'', 0 bytes read)`, you are hitting a streaming timeout