List managed ML models (instance admin) - LightOn Documentation

List managed ML models (instance admin)

curl --request GET \
  --url https://paradigm.lighton.ai/api/v3/instance/ml-models \
  --header 'Authorization: Bearer <token>'

const options = {method: 'GET', headers: {Authorization: 'Bearer <token>'}};

fetch('https://paradigm.lighton.ai/api/v3/instance/ml-models', options)
  .then(res => res.json())
  .then(res => console.log(res))
  .catch(err => console.error(err));

[
  {
    "id": "d612ede5-16b6-4d7b-b01b-5afb873b26bb",
    "name": "alfred-ft5",
    "technical_name": "alfred-ft5",
    "litellm_model": "hosted_vllm/alfred-ft5",
    "model_type": "Large Language Model",
    "endpoint": "http://models-gra11-afe6f177.lighton.ai:30424/v1/",
    "max_model_len": 32768,
    "deployment_type": "Self-Hosted",
    "enabled": true,
    "is_default": false,
    "is_parser": false,
    "is_default_reranker": false,
    "use_vllm_guided_choice": true,
    "start_messages_template": null,
    "health": {
      "status": "healthy",
      "is_healthy": true,
      "last_checked_at": "2026-08-12T09:31:44.512000Z"
    }
  }
]

GET

/

api

/

v3

/

instance

/

ml-models

List managed ML models (instance admin)

curl --request GET \
  --url https://paradigm.lighton.ai/api/v3/instance/ml-models \
  --header 'Authorization: Bearer <token>'

const options = {method: 'GET', headers: {Authorization: 'Bearer <token>'}};

fetch('https://paradigm.lighton.ai/api/v3/instance/ml-models', options)
  .then(res => res.json())
  .then(res => console.log(res))
  .catch(err => console.error(err));

[
  {
    "id": "d612ede5-16b6-4d7b-b01b-5afb873b26bb",
    "name": "alfred-ft5",
    "technical_name": "alfred-ft5",
    "litellm_model": "hosted_vllm/alfred-ft5",
    "model_type": "Large Language Model",
    "endpoint": "http://models-gra11-afe6f177.lighton.ai:30424/v1/",
    "max_model_len": 32768,
    "deployment_type": "Self-Hosted",
    "enabled": true,
    "is_default": false,
    "is_parser": false,
    "is_default_reranker": false,
    "use_vllm_guided_choice": true,
    "start_messages_template": null,
    "health": {
      "status": "healthy",
      "is_healthy": true,
      "last_checked_at": "2026-08-12T09:31:44.512000Z"
    }
  }
]

Authorizations

Authorization

string

header

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Response

id

string<uuid>

required

Unique ID for this model.

name

string

required

Display name.

technical_name

string

required

Instance-wide unique technical name used for routing.

model_type

string

required

Model type.

enabled

boolean

required

Whether the model is active instance-wide.

is_default

boolean

required

Whether this is the platform default generation model.

is_parser

boolean

required

Whether the model can be used as a parser.

is_default_reranker

boolean

required

Whether this is the default reranker.

use_vllm_guided_choice

boolean

required

Use vLLM guided_choice for constrained decoding.

health

object

required

Health of the model as of the last periodic gateway healthcheck. Read from cache — reading this endpoint never triggers a check.

Show child attributes

litellm_model

string | null

Underlying LiteLLM provider routing string (e.g. hosted_vllm/my-model).

endpoint

string | null

Model serving endpoint URL.

max_model_len

integer | null

Maximum context length in tokens.

deployment_type

string | null

Deployment type (Self-Hosted or External).

start_messages_template

string | null

Start messages template name.