library · inferred from evidence
InMemoryRateLimiter
A built-in rate limiter in LangChain for controlling request rates.
- ModelRateLimitError: handling provider rate limits without hammering the API
Rate limit errors are retryable, and LangChain retries 429s automatically up to 6 times by default. If you still get ModelRateLimitError, you need to slow down at the source with a rate limiter, reduce concurrency, or spread load across pro