← All templates
ai / SETUP GUIDE

LiteLLM

LiteLLM is a lightweight OpenAI API-compatible proxy for managing multiple LLM providers with a single endpoint.

Before you start

  • litellm: upstream requests root; adapt initialization to Hakopod non-root containers

Configuration that needs your attention

This migration candidate preserves supported service, storage and credential declarations. Resolve every prerequisite before deployment.

Candidate credential references

This draft lists possible credential bindings. Some providers are alternatives. Finalize the required bindings after resolving the migration prerequisites; do not create every listed provider account.

  • anthropic-api-key
  • azure-api-key
  • cohere-api-key
  • database-url
  • infinity-api-key
  • infisical-token
  • novita-api-key
  • openai-api-key
  • or-api-key
  • postgres-password
  • replicate-api-key
  • replicate-api-token
  • ui-password

Complete the prerequisites

This migration is not enabled for deployment. Resolve the prerequisites listed above and validate startup, networking and persistent storage before using it.

Read the upstream setup documentation ↗

View migration status and native candidate ↗