Generic OpenAPI endpoint and key support
There’s a wide selection of LLM providers that users might already subscribe to that they might prefer over the built in options for various reasons. Among them are openrouter, featherless, ArlAI, Mistral, or self hosting.
Log in to comment and vote
Comments12
Sapphire Lynx
I would love to be able to use this with self-hosted models.
From a business perspective: it seems like it would be very valuable to enterprises that want to license this for on-prem use.
Purple Apple
It would be really nice to just be able to add Models through their openrouter key (e.g.
google/gemini-2.5-flash-preview-05-20)
Apricot Koala
same here, looking for this feature
Scarlet Serval
we need this!!!!!
Red Pineapple
Openrouter for anthropic would be nice
Beige Rain
This!!! I was about to create a new feature suggestion for exactly this. Along with personal API key, add support for endpoint too.. this will open up giant provider base.
Azure Mustard
Agreed, this would be extremely useful!
Given the wide range of providers hosting different models (each with different pricing, sustained TPS, time to first token, privacy policies, etc.), often meeting the requirements of a specific use-case requires using many different providers.
Red Handle
Even just being able to add the link to an Ollama server would be amazing.
Sapphire Wind
Please openrouter for GPT 4.5
Blue Raindrop
OpenRouter support for models like GPT 4-5 would be so much better