Skip to content

Refactor processors code to share common logic #1083

@mathetake

Description

@mathetake

As you see in #1022, currently adding a new processor involves "a lot" of copy paste of the existing infra. chat_completions, embeddings, and messages processors are all sharing majority of request flow handling which is compatible with the control plane's configuration.

We need to make it much more easier since we are looking to add support more processors both for passthrough and translations.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions