SambaNova Cloud 429 RateLimitError on the Developer account

TL;DR

On the client side, the sambanova SDK retries 429s twice by default with a short exponential backoff, configurable with the maxretries option (set maxretries=0 to disable, or raise it with client.with_options). The rate limit is the number of API calls within a given minute.

The error

SambaNova Cloud 429 RateLimitError on the Developer account

Fix

1. On the client side, the sambanova SDK retries 429s twice by default with a short exponential backoff, configurable with the maxretries option (set maxretries=0 to disable, or raise it with client.with_options). Expected: You get the expected result; the problem is gone.

2. Re-run the original operation and confirm the error is gone. Expected: no error, normal output.

When to use

• You hit this exact error.
• The symptom matches: SambaNova Cloud 429 RateLimitError on the Developer account.

When NOT to use

• A different error message; the cause here is specific to this error.
• Unrelated issues with a different cause.
• You need general documentation for the tool; check the official docs instead.

Compatibility

Reported per the linked source. Source: https://community.sambanova.ai/t/rate-limit-informations/259.

Variant phrasings

SambaNova Cloud 429 RateLimitError on the Developer account

Why it happens

Calls to api.sambanova.ai start failing with 429 RateLimitError at what looks like modest volume. SambaNova staff explain the rate limit counts API calls within a given minute per API key, so one app request that fans out to 2-3 model calls burns the budget fast. The free tier is 20 requests per day.

Edge cases

• If your error message differs even slightly, this is probably a different issue; search the exact text.
• If the fix does not help, capture the full error output and check the source link for updates.

Source

https://community.sambanova.ai/t/rate-limit-informations/259

Source: Calls to api.sambanova.ai start failing with 429 RateLimitError at what looks like modest volume. SambaNova staff explain the rate limit counts API calls within a given minute per API key, so one app request that fans out to 2-3 model calls burns the budget fast. The free tier is 20 requests per day.

Verified resolution: [Coby, SambaNova community team]: The rate limit is the number of API calls within a given minute. If a chat app calls the model API 2-3 times per user request, it gets far fewer user interactions per minute; serving many users on one key needs a queue so requests do not blow past the limit. On the client side, the sambanova SDK retries 429s twice by default with a short exponential backoff, configurable with the maxretries option (set maxretries=0 to disable, or raise it with client.with_options).

Source URL: https://community.sambanova.ai/t/rate-limit-informations/259