AI Gateway

​

Declare a gateway

[[projects.aiGateways]]
name = "primary-ai"
environment = "production"
allowedModels = ["korve/fast", "korve/balanced"]
monthlyBudgetUsd = 25
timeoutMs = 30000
maxRetries = 1
redactPrompts = true

korve manifest plan -f korve.toml
korve manifest apply -f korve.toml

​

Complete from a deployed server

import { createKorve } from "@korve-dev/sdk";

const result = await createKorve()
  .ai("primary-ai")
  .complete({
    model: "korve/fast",
    messages: [{ role: "user", content: "Summarize this support ticket." }],
    maxTokens: 600,
  });

POST /v1/runtime/ai/primary-ai/chat/completions
Authorization: Bearer $KORVE_RUNTIME_TOKEN
Content-Type: application/json

​

Security, privacy, and spend

• Requests for models outside the gateway allowlist fail before inference.
• The hard monthly gateway budget stops new requests with 429 when exhausted.
• Prompt bodies are excluded from audit events by default. With redactPrompts = false, audit storage still retains only a redacted, bounded preview—not a complete prompt.
• Gateway key secrets are shown once; listings return metadata only. Revoke a key immediately if its one-time value may have escaped.
• Errors are provider-neutral and never include upstream response bodies, identifiers, or credentials.
• Deleting a gateway permanently revokes all of its gateway keys.