SambaNova Python SDK: default retries, max_retries, and the 10-minute timeout
SambaNova Python SDK: default retries, max_retries, and the 10-minute timeout: : connection errors, 408, 409, 429, and 500+ are retried 2 times by default with short exponential backoff.
[sambanova PyPI docs]: connection errors, 408, 409, 429, and 500+ are retried 2 times by default with short exponential backoff. Set maxretries=0 on the client to disable, or use withoptions(max_retries=5) per request. Requests time out after 10 minutes by default; configure a float or httpx.Timeout, and a timeout raises APITimeoutError. Note timed-out requests are retried twice by default, so a slow endpoint can triple your billable calls.
Context: The SambaNova SDK retries some errors twice by default. Know which ones.
Matched source
Source: Source: https://pypi.org/project/sambanova/1.13.0/ Original query: "SambaNova Python SDK: default retries, max_retries, and the 10-minute timeout" Key terms: default, minute, python, retries, sambanova, timeout