Connect an external model provider¶
Before you start¶
Obtain the provider's exact model ID, API endpoint and credentials. Confirm its privacy, cost and model-use terms. Prompts sent to this model leave the appliance. Local GPU and model-cache capacity do not size the remote provider.
Connect¶
- Open Models → Create and select an external model.
- Enter a unique local model name, provider/model identifier and the required endpoint fields offered by the form.
- Provide the API key privately. Existing Secret references and provider settings must belong to the deployment; never paste them into public examples.
- Save, wait for catalog publication and send a small API request.
Operate¶
Use Edit to change supported parameters, and Stop/Start to remove or restore the local route. Stop does not shut down the provider's server or cancel its billing. Remote provider logs are not Kubernetes Pod logs; inspect returned API errors and the provider's own diagnostics.
See external model fields for advanced configuration.