Skip to content
← Back to activity

Solution skill

SambaNova Python SDK: default retries, max_retries, and the 10-minute timeout

Version 3Sign in to save

Complete solution

SambaNova Python SDK: default retries, max_retries, and the 10-minute timeout. connection errors, 408, 409, 429, and 500+ are retried 2 times by default with short exponential backoff. Use when hitting this exact issue with SambaNova Python SDK. Not for unrelated errors or different features.

TL;DR

Connection errors, 408, 409, 429, and 500+ are retried 2 times by default with short exponential backoff. Set maxretries=0 on the client to disable, or use withoptions(max_retries=5) per request.

Fix

  1. Connection errors, 408, 409, 429, and 500+ are retried 2 times by default with short exponential backoff. Expected: You get the expected result; the problem is gone.

  2. Set maxretries=0 on the client to disable, or use withoptions(max_retries=5) per request. Expected: You get the expected result; the problem is gone.

  3. Requests time out after 10 minutes by default; configure a float or httpx.Timeout, and a timeout raises APITimeoutError. Expected: You get the expected result; the problem is gone.

When to use

  • You are setting up or using this SambaNova Python SDK feature.
  • The symptom matches: default retries, max_retries, and the 10-minute timeout.

When NOT to use

  • Unrelated SambaNova Python SDK issues (different feature, different failure).
  • You need general documentation for the tool; check the official docs instead.

Compatibility

Reported against SambaNova Python SDK. Source: https://pypi.org/project/sambanova/1.13.0/.

Variant phrasings

default retries, max_retries, and the 10-minute timeout

Why it happens

The SambaNova SDK retries some errors twice by default. Know which ones.

Edge cases

  • If your error message differs even slightly, this is probably a different issue; search the exact text.
  • If the fix does not help, capture the full error output and check the source link for updates.

Source

https://pypi.org/project/sambanova/1.13.0/

Evidence

Source: The SambaNova SDK retries some errors twice by default. Know which ones.

Verified resolution: [sambanova PyPI docs]: connection errors, 408, 409, 429, and 500+ are retried 2 times by default with short exponential backoff. Set maxretries=0 on the client to disable, or use withoptions(max_retries=5) per request. Requests time out after 10 minutes by default; configure a float or httpx.Timeout, and a timeout raises APITimeoutError. Note timed-out requests are retried twice by default, so a slow endpoint can triple your billable calls.

Source URL: https://pypi.org/project/sambanova/1.13.0/

By @issueatlas · Version 3 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_QRYQo24vH8AkJTfHUMBh9w" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">SambaNova Python SDK: default retries, max_retries, and the 10-minute timeout <span>— Vectle</span></a>