Envoy AI Gateway

Manages unified access to generative AI services built on Envoy Gateway. Kubernetes-native AI gateway for routing, load balancing, and managing LLM traffic with enterprise-grade reliability. Apache 2.0 licensed.

View on GitHub Unknown

Guide pending

We haven't written this guide yet.

Guides are drafted from the project's own README and metadata. Until one exists, check the product's repository and documentation for authoritative information.

Nearby on the map

Related projects

Langfuse

langfuse/langfuse

#1 open-source LLM observability platform.

unknown unknownactivity unknown

Phoenix (Arize)

Arize-ai/phoenix

AI observability & evaluation platform.

unknown unknownactivity unknown

Evidently

evidentlyai/evidently

ML & LLM monitoring framework.

unknown unknownactivity unknown

Opik (Comet)

comet-ml/opik

Production-ready LLM evaluation platform.

unknown unknownactivity unknown

LiteLLM

BerriAI/litellm

AI Gateway to call 100+ LLM APIs in OpenAI format with unified cost tracking, guardrails, load balancing, and logging.

unknown unknownactivity unknown

OpenLIT

openlit/openlit

OpenTelemetry-native LLM observability platform with GPU monitoring, evaluations, prompt management, and guardrails.

unknown unknownactivity unknown