Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

New ChatGenerator fallback component for quota limits/API errors #9786

Copy link
Copy link
@sjrl

Description

@sjrl
Issue body actions

Is your feature request related to a problem? Please describe.
Some clients have reported pipelines failing in production due to provider quota limits (for example, AWS throttling errors).

Describe the solution you'd like
Introduce a new component that accepts a list of ChatGenerators. If one fails (e.g., quota exceeded), it falls back to the next available generator in the list.

Additional context
We should consider how the fallback strategy or strategies should be implemented and perhaps consider allowing a custom function to be passed in to allow for custom fallback strategies.

Metadata

Metadata

Assignees

Labels

P1High priority, add to the next sprintHigh priority, add to the next sprint

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    Morty Proxy This is a proxified and sanitized view of the page, visit original site.