Provider Configuration

This skill helps you configure LLM providers for Letta, supporting both:

• Self-hosted setup - Environment variables for Docker/local deployments

• BYOK via API - Programmatic provider management for Cloud and self-hosted

Quick Start

Add Provider via API

python scripts/setup_provider.py --type openai --api-key sk-...

Generate .env File for Docker

python scripts/generate_env.py --providers openai,anthropic,ollama

Validate Provider Credentials

python scripts/validate_provider.py --provider-id provider-xxx

Common Workflows

Workflow 1: Add OpenAI BYOK Provider

Using the setup script

python scripts/setup_provider.py
--type openai
--name "My OpenAI"
--api-key sk-your-key-here

Or via REST API directly

curl -X POST http://localhost:8283/v1/providers
-H "Content-Type: application/json"
-d '{ "name": "My OpenAI", "provider_type": "openai", "api_key": "sk-your-key-here" }'

Workflow 2: Configure Self-Hosted Server

Generate environment file

python scripts/generate_env.py --providers openai,anthropic,ollama --output .env

Use with Docker

docker run -p 8283:8283 --env-file .env letta/letta:latest

Workflow 3: Validate and Refresh Provider

Check credentials

python scripts/validate_provider.py --provider-id provider-abc123

Refresh available models

curl -X PATCH http://localhost:8283/v1/providers/provider-abc123/refresh

Reference Documentation

Common Providers

For detailed OpenAI, Anthropic, Azure OpenAI, and Google AI configuration: Read references/common_providers.md

Self-Hosted Providers

For Ollama, vLLM, LM Studio, and other local providers: Read references/self_hosted_providers.md

All Provider Types

For comprehensive reference covering all 20+ supported providers: Read references/all_providers.md

Environment Variables

For Docker setup and multi-provider configuration: Read references/environment_variables.md

Scripts

setup_provider.py

Add providers programmatically via REST API.

Required flags:

• --type

• Provider type (openai, anthropic, azure, etc.)

• --api-key

• API key for the provider

Optional flags:

• --name

• Display name (defaults to provider type)

• --base-url

• Custom endpoint URL

• --api-version

• API version (for Azure)

• --region

• Region (for Bedrock)

• --access-key

• Access key (for AWS)

• --server

• Letta server URL (default: http://localhost:8283)

validate_provider.py

Check if provider credentials are valid and list available models.

Required flags:

• --provider-id
• Provider ID to validate

Optional flags:

• --server
• Letta server URL (default: http://localhost:8283)

generate_env.py

Generate .env file for Docker deployments.

Required flags:

• --providers
• Comma-separated list of providers (openai,anthropic,ollama)

Optional flags:

• --output

• Output file path (default: .env)

• --ollama-url

• Ollama endpoint URL (default: http://host.docker.internal:11434)

Provider Types

Supported provider types:

• openai

• OpenAI (GPT models)

• anthropic

• Anthropic (Claude models)

• azure

• Azure OpenAI

• google_ai

• Google AI (Gemini)

• google_vertex

• Google Vertex AI

• ollama

• Ollama (local models)

• groq

• Groq

• deepseek

• DeepSeek

• xai

• xAI (Grok)

• zai

• Z.ai

• together

• Together AI

• mistral

• Mistral AI

• cerebras

• Cerebras

• bedrock

• AWS Bedrock

• vllm

• vLLM

• sglang

• SGLang

• hugging_face

• Hugging Face

• lmstudio_openai

• LM Studio (OpenAI compatible)

• minimax

• MiniMax

• chatgpt_oauth

• ChatGPT OAuth

For detailed configuration of each provider, see the reference files.

Notes

• All API-created providers are automatically BYOK (bring your own key)

• Provider IDs are prefixed with provider-

• After creating a provider, models are auto-discovered

• Use PATCH /v1/providers/{provider_id}/refresh to rescan models

• Environment variables are only for self-hosted deployments

• Letta Cloud uses BYOK providers exclusively (no env vars)