Route LLM traffic by cost, quality, and control.
AccessAgent Router sits between your application and LLM providers. It can send requests to OpenAI, OpenRouter, other hosted providers, or local model servers while tracking tokens, spend, latency, and savings.
Different from generic AI gateways
The market already has strong gateways. AccessAgent Router should win on a narrower promise: Bun-native simplicity, local-model cost reduction, and a dashboard that makes savings obvious.
OpenAI-compatible proxy
Point existing SDKs at the router by changing the base URL and API key. Start with chat completions, streaming, model aliases, and provider fallbacks.
Local model offload
Route safe, simple, or repetitive requests to Ollama, vLLM, or another OpenAI-compatible local endpoint before paying for hosted models.
Cost-aware routing rules
Choose providers by app, API key, model alias, prompt size, task type, budget, provider health, and fallback policy.
Usage and savings dashboard
Track tokens, estimated cost, avoided spend, latency, error rates, provider mix, and local-vs-hosted routing over time.
Bun-native TypeScript stack
A lightweight gateway built for fast startup, simple self-hosting, and one TypeScript codebase across the proxy, dashboard, adapters, and config.
Open source plus hosted service
Self-host the core for control, or use the AccessAgent hosted service for teams, auth, encrypted keys, alerts, audit logs, and managed operations.
Gen1 MVP
The first version should prove the cost-control loop before chasing every provider and every advanced routing feature.
- OpenAI-compatible /v1/chat/completions proxy
- OpenAI and OpenRouter provider adapters
- Ollama and OpenAI-compatible local model support
- Rule-based routing and fallback chains
- Request logs with token, cost, latency, status, and route decisions
- Dashboard for spend, usage, provider mix, errors, and estimated savings
Self-host it or use the managed service.
The open-source core should be useful on its own. The hosted AccessAgent service adds team management, encrypted provider keys, alerts, audit logs, billing, and operational convenience.