Skip to content

feat(server): compose proxy applications from typed configuration - #2467

Open
Pouyanpi wants to merge 1 commit into
pouyanpi/litellm-responses-dialect-2from
pouyanpi/proxy-declarative-composition-a
Open

Pouyanpi wants to merge 1 commit into
pouyanpi/litellm-responses-dialect-2from
pouyanpi/proxy-declarative-composition-a

Conversation

@Pouyanpi

@Pouyanpi Pouyanpi commented Oct 15, 2026 •

Copy link
Copy Markdown
Collaborator

Description

Select provider instances, operations, dialects and Rails configs through typed Python configuration, reusing the existing application assembly. No runtime policy generation.

Stack: #2466 → #2467 → #2468. Package separation follows separately; API-docs prototype excluded.

PR Base
#2467: typed composition #2466
#2468: YAML/launcher #2467

@github-actions github-actions Bot added size: L status: needs triage New issues that have not yet been reviewed or categorized. labels Oct 15, 2026
@Pouyanpi Pouyanpi self-assigned this Oct 15, 2026
@Pouyanpi
Pouyanpi force-pushed the pouyanpi/proxy-declarative-composition-a branch from bbc2247 to 9668baa Compare October 20, 2026 08:12
@codecov

codecov Bot commented Oct 20, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 98.31933% with 2 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
...moguardrails/server/experimental/_configuration.py 97.75% 2 Missing ⚠️

📢 Thoughts on this report? Let us know!

@Pouyanpi
Pouyanpi added this pull request to stack #2477 October 20, 2026 12:19
@Pouyanpi
Pouyanpi force-pushed the pouyanpi/proxy-declarative-composition-a branch from 9668baa to 70b7a83 Compare October 20, 2026 12:31
@Pouyanpi
Pouyanpi force-pushed the pouyanpi/proxy-declarative-composition-a branch from 70b7a83 to 2e85af3 Compare October 20, 2026 13:54
@Pouyanpi
Pouyanpi marked this pull request as ready for review October 20, 2026 13:59
@Pouyanpi
Pouyanpi force-pushed the pouyanpi/proxy-declarative-composition-a branch from 2e85af3 to fccc743 Compare October 20, 2026 15:41
@Pouyanpi
Pouyanpi force-pushed the pouyanpi/proxy-declarative-composition-a branch from fccc743 to bf49ad9 Compare October 20, 2026 17:06
Resolve explicit provider, operation, and dialect selections into existing endpoint bindings and reuse the application assembly. Keep native dialect selection provider-relative and preserve direct Python integrations without adding another factory selection API.

Use one shared Rails catalogue with fixed IDs per provider or an application-level dynamic resolver. Fixed providers bypass the callback; missing dynamic callbacks and unknown references fail closed. Preserve existing direct-call selection semantics and runtime ownership.

Validate nested ConfigEntry data without introducing a second entry type. Add configuration/schema, real-Rails buffered and streaming, passthrough, isolation, and direct-API regressions plus Python examples.

Validation: 169 focused tests and pre-commit passed. The complete experimental-server suite passed 1753 tests with one independently reproduced pre-existing core queue-cleanup failure; lifecycle fixes remain separate prerequisites.
Signed-off-by: Pouyanpi <13303554+Pouyanpi@users.noreply.github.com>
@Pouyanpi
Pouyanpi force-pushed the pouyanpi/proxy-declarative-composition-a branch from bf49ad9 to d370ff5 Compare October 20, 2026 19:56

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size: L status: needs triage New issues that have not yet been reviewed or categorized. temp: guardrails-proxy

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant