Routerly
Routerly — One gateway. Any AI model. Total control. Self-hosted LLM router with intelligent routing, cost tracking, and budget enforcement.
What it is
The only LLM gateway that uses AI to decide which AI to use. Drop Routerly between your app and your LLM providers. Intelligent routing, cost tracking, budget enforcement — zero code changes. Open source · Built with TypeScript · Runs on Docker · AGPL-3.0 licensed · Supports OpenAI, Anthropic, Gemini, Mistral, Ollama, Cohere, xAI Pick your install method and you're ready to go. # Works everywhere. Installs everything. You're welcome. 🔥 Works on macOS, Windows & Linux. The one-liner installs Node.js and everything else for you. See how Routerly routes your AI requests to the best model — automatically. Today, your app talks directly to a single AI provider — OpenAI, Anthropic, or whichever you chose first. That means you're locked in: if their API goes down, you go down. If their prices change, your bill changes. If you want to try a different model, you rewrite code. Routerly sits in the middle. You point your app — or any AI tool like Cursor, Open WebUI, or LangChain — at localhost:3000 instead of the provider's URL. From that moment, Routerly takes over: it picks the best available model for each request, enforces your budget, tracks every token spent, and automatically reroutes if a provider fails. Your code doesn't change. Your team doesn't need to know. You just get full control.
What to verify before adopting
- Confirm current pricing, usage limits, supported regions, and contract terms on the official website.
- Test integrations, export paths, access controls, and failure recovery with low-risk data first.
- Review privacy, data retention, security, and compliance requirements for your market.
- Keep a migration or rollback plan before making the product part of a critical workflow.