[AI] Rate Limit with exponential backoff for platform #63445
Unanswered
tony-stark-eth
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently I only see that the rate limiter component is implemented to have a fallback to another platform for HA.
But in my usecase I need to use this one platform and make sure that when a 429 is hit, the process tries again without the need to switch to another platform.
Is this possible currently, maybe I'm missing something?
Use case:
Using https://docs.voyageai.com/docs/rate-limits with Tier 1
When using chunkSize 1 the first document is succesful and afterwards I get a 429, with 500 chunk size I get a 429 on first request.
VectorizerCommand:
Beta Was this translation helpful? Give feedback.
All reactions