Skip to main content

Models

/models is the catalog of routable model groups and (for admins) the place to wire providers.

Concepts: Models and routing.

Tabs

TabWhoWhat you do
Model catalogEveryoneSearch groups, open the detail drawer (providers, pricing, context window, capabilities, deprecation, fallbacks, usage)
Access groupsEveryoneRead-only list of model bundles
Provider credentialsAdminCreate or delete credentials (AES-256-GCM or akv: vault refs)
Add deploymentAdminWizard: group + credential + provider model + weight + pricing
PricingAdminCompare org vs catalog pricing; reload catalog
HealthAdminDeployment health board
Fallback chainsAdminOrdered fallback chains across model groups

Stat cards: model groups, active deployments, connected providers, fallback chains.

First-boot bootstrap

If OPENAI_API_KEY is set and no credentials exist, the first portal sign-in creates an openai-default credential and starter deployments. If that key was empty or stale, delete the credential here and add a new one.

Role restrictions

Non-admins only see the catalog and access groups. Mutations require a writable platform admin.