Skip to main content

Gateway

Adaline Gateway is a single SDK to interact with 300+ LLMs. It runs entirely locally — no proxy, no data leaves your environment.

Installation

Quick Start

Key Features

  • Unified interface — One API for OpenAI, Anthropic, Google, Azure, Bedrock, Groq, Together AI, Open Router, Vertex, XAI, and custom providers
  • Fully local — No proxy server, no data leaves your environment
  • Streaming — First-class async generator support for streaming responses
  • Embeddings — Generate embeddings across providers with a single interface
  • Tool calls — Execute tool calls returned by LLMs
  • Plugins — Pluggable cache, HTTP client, logger, and queue backends
  • Batching & retries — Built-in configurable queues with automatic retry and exponential backoff
  • OpenTelemetry — Native telemetry integration
  • Isomorphic — Works in Node.js and browsers (with dangerouslyAllowBrowser)

Packages

API Reference

Gateway Class

Core class for chat completions, streaming, embeddings, and tool calls.

Types

Config, messages, tools, and response types.

Examples

Practical examples for common use cases.