Are you an LLM? Read llms.txt for a summary of the docs, or llms-full.txt for the full context.
Skip to content

Lazu vs Portkey

Portkey AI Gateway is a TypeScript gateway that routes to a very large number of models with retries, fallbacks, load balancing and guardrails configured per request. Keys, budgets, RBAC and observability belong to Portkey's hosted platform. Lazu is a Go gateway that carries its accounts, ledger and console with it. Facts were checked on 2 November 2026.

Where Portkey stands

The open-source repository's last release is v1.15.2 from January 2026 and its last commit is from May 2026; a 2.0.0 branch exists but was not merged. Palo Alto Networks completed its acquisition of Portkey on 29 May 2026. The gateway still runs, but anyone choosing it today is choosing a codebase whose future is decided elsewhere.

Who each is for

Portkey is for application developers who call many models and want retries, fallbacks, weighted load balancing and guardrails expressed as a config object on each request, and who are willing to use the hosted platform for everything about keys, budgets and logs beyond a local console.

Lazu is for teams, labs and companies that hand keys to people and agents and want the account layer to live on their own server: budgets reserved before the call, a usage record per request that the key's owner can read, a catalog with prices, and a console for the operator.

Side by side

Portkey GatewayLazu
RuntimeTypeScript; npx, Docker, Node, Cloudflare WorkersGo gateway and worker, React console, Vocs docs; one Docker Compose stack
ConfigurationPer-request config object or header: retries, fallbacks, load balancing, guardrailsUpstreams, prices, users and announcements in the console
AccountsVirtual keys in the hosted platform; the open-source gateway documents no key storeUsers, teams and projects, member budgets, API keys
BudgetCost and token limits that expire the key, with alerts and resets, on the hosted Enterprise plan and select Pro customersPrepaid balance; per-key caps, project and spend budgets; reserved before the call, settled from the provider's counters, released on failure
Usage recordsLocal console shows local logs; logging, tracing and retention are hosted-plan features (3 days on Dev, 30 on Pro)One record per request with usage, measurement source and billing lines, readable by the key that sent it; agent sessions; reconciliation script
RoutingFallbacks with error triggers, up to five retries with backoff, weighted and conditional routingChannel selection by priority and weight per model, health window, retry on the same model; public route-health page
ProtocolsOpenAI signature across providersOpenAI, Anthropic Messages and Gemini natively; translates only when lossless
Extensionplugins/ of guardrail integrationsGo and web extension points compiled into the build
Paid tierDev (free), Pro, Enterprise: caching, prompt management, observability, budgets, PII redaction, RBAC, SSO, private deploymentsNone
LicenceMIT; repository quiet since May 2026AGPL-3.0-or-later

Money

In Portkey, a budget is a hosted-platform feature: a cost or token limit on a provider integration that expires the key when reached, with alert thresholds and weekly or monthly resets, available on Enterprise and to some Pro customers. The open-source gateway on its own has no budgets. In Lazu, budgets are part of the self-hosted product: an estimate is reserved from a prepaid balance before the upstream call, the charge is settled from the usage the provider reports, each dimension is recorded as provider-measured, locally estimated or unavailable, and a failed request with no billable output refunds its reservation (billing contract).

Protocols

Portkey's README describes a familiar OpenAI signature across its providers. Lazu accepts OpenAI, Anthropic Messages and Gemini requests natively and converts only along edges verified lossless; a request that needs a feature the upstream cannot carry is refused with a 400 naming the feature before any upstream call (design note).

What Portkey has that Lazu does not

  • Coverage of well over a thousand models and modalities.
  • Routing expressed per request, including conditional routing and configurable fallback triggers.
  • A set of guardrail plugins from third-party vendors.
  • Deployment on Cloudflare Workers.

When to choose which

  • You are an application developer, you want routing policy in the request itself, and you are fine with the hosted platform for keys, budgets and logs: Portkey, with the caveat above about the repository.
  • You need the account layer on your own server, with budgets, a balance and a usage record the key's owner can read: Lazu.

See also Lazu vs LiteLLM and the overview of other gateways.