Skip to content

[RFE] API endpoint for get Providers/Models #2937

Description

@aljesusg

Is your feature request related to a problem? Please describe.

Client applications integrating with Lightspeed currently lack a programmatic way to retrieve the list of supported providers and models. Because standard queries require specifying a provider and a model, applications are forced to rely on hardcoded lists. This creates unnecessary maintenance overhead and introduces a high risk of failure whenever Lightspeed adds, renames, or deprecates models.

Describe the solution you'd like
Implement a discovery endpoint (e.g., GET /providers or GET /models) that returns a structured payload containing all currently active providers and their associated models available within Lightspeed. This would allow client applications to dynamically fetch, display, and validate available options at runtime before initiating a query.

Additional context

Providing a discovery endpoint for supported models is a standard practice for API gateways and LLM routing services. Adding this feature will enable more robust, dynamic integrations and significantly reduce the likelihood of client-side configuration errors.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    lifecycle/rottenDenotes an issue or PR that has aged beyond stale and will be auto-closed.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions