Gateway
Adaline Gateway is a single SDK to interact with 300+ LLMs. It runs entirely locally — no proxy, no data leaves your environment.Installation
Quick Start
Key Features
- Unified interface — One API for OpenAI, Anthropic, Google, Azure, Bedrock, Groq, Together AI, Open Router, Vertex, XAI, and custom providers
- Fully local — No proxy server, no data leaves your environment
- Streaming — First-class async generator support for streaming responses
- Embeddings — Generate embeddings across providers with a single interface
- Tool calls — Execute tool calls returned by LLMs
- Plugins — Pluggable cache, HTTP client, logger, and queue backends
- Batching & retries — Built-in configurable queues with automatic retry and exponential backoff
- OpenTelemetry — Native telemetry integration
- Isomorphic — Works in Node.js and browsers (with
dangerouslyAllowBrowser)
Packages
API Reference
Gateway Class
Core class for chat completions, streaming, embeddings, and tool calls.
Types
Config, messages, tools, and response types.
Examples
Practical examples for common use cases.