Create a managed ML model (instance admin)
Register a new instance-wide managed model. Reserved to Sys Admin / Admin roles.
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
Human-friendly display name.
Unique technical identifier used for routing.
Underlying LiteLLM provider routing string (e.g. hosted_vllm/my-model, openai/gpt-4o-mini). Distinct from technical_name — never assume they match.
Model type (e.g. Large Language Model, Embedding Model).
Optional explicit UUID; auto-generated when omitted.
Model serving endpoint URL. Omit for models with no custom endpoint.
Maximum context length in tokens. Omit if not applicable/known.
Whether the model is active.
Whether this is the default generation model.
Whether the model can be used as a parser.
Whether this is the default reranker.
Use vLLM guided_choice for constrained decoding.
Response
Unique ID for this model.
Display name.
Instance-wide unique technical name used for routing.
Model type.
Whether the model is active instance-wide.
Whether this is the platform default generation model.
Whether the model can be used as a parser.
Whether this is the default reranker.
Use vLLM guided_choice for constrained decoding.
Health of the model as of the last periodic gateway healthcheck. Read from cache — reading this endpoint never triggers a check.
Underlying LiteLLM provider routing string (e.g. hosted_vllm/my-model).
Model serving endpoint URL.
Maximum context length in tokens.
Deployment type (Self-Hosted or External).
Start messages template name.