
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
·
LLM Gateway is an open-source API gateway for Large Language Models (LLMs). It acts as a middleware between your applications and various LLM providers, allowing you to:
You can use LLM Gateway in two ways:
Use Docker-managed volumes for the unified image. Do not bind-mount a host directory directly to /var/lib/postgresql/data, because PostgreSQL initialization inside the container needs to set permissions on that directory and that can fail depending on the host filesystem and ownership.
export LLM_GATEWAY_SECRET="$(openssl rand -base64 32 | tr -d '\n')"
export GATEWAY_API_KEY_HASH_SECRET="$(openssl rand -base64 32 | tr -d '\n')"
./scripts/run-unified-container.shIf you prefer a one-off docker run, use named volumes instead of ~/some-host-dir:
docker volume create llmgateway_postgres
docker volume create llmgateway_redis
docker run -d \
--name llmgateway \
--restart unless-stopped \
-p 3002:3002 \
-p 3003:3003 \
-p 3005:3005 \
-p 3006:3006 \
-p 3007:3007 \
-p 4001:4001 \
-p 4002:4002 \
-v llmgateway_postgres:/var/lib/postgresql/data \
-v llmgateway_redis:/var/lib/redis \
-e AUTH_SECRET="$LLM_GATEWAY_SECRET" \
-e GATEWAY_API_KEY_HASH_SECRET="$GATEWAY_API_KEY_HASH_SECRET" \
ghcr.io/theopenco/llmgateway-unified:latestcurl -X POST https://api.llmgateway.io/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $LLM_GATEWAY_API_KEY" \
-d '{
"model": "gpt-4o",
"messages": [
{"role": "user", "content": "Hello, how are you?"}
]
}'Install dependencies and set up the development environment:
pnpm i && pnpm run setupThis will install all dependencies, start Docker services, sync the database schema, and seed initial data.
Note for WSL2 users: Ensure Docker Desktop is running with WSL integration enabled.
Start development servers:
pnpm devBuild for production:
pnpm buildapps/ui: Next.js dashboard frontendapps/playground: Lounge — consumer AI chat app (Next.js)apps/code: Next.js Dev Plans + coding tools landing & dashboardapps/airside: Airside — self-serve provider portal (Next.js)apps/api: Hono backendapps/gateway: API gateway for routing LLM requestsapps/docs: Documentation siteee/admin: Internal admin dashboardpackages/db: Drizzle ORM schema and migrationspackages/models: Model and provider definitionspackages/shared: Shared types and utilitiesWe do not accept pull requests that add new providers. Inference providers onboard through Airside, our self-serve provider portal, where you register and manage your model listings.
LLMGateway is available under a dual license:
ee/ directory require an Enterprise license; multi-organization administration requires a white-label license. See ee/LICENSE for details.For enterprise licensing, please contact us at [email protected]
Paste this prompt into your agent. It reads this page and does the setup for you.
Read https://aiagentslisting.com/mcp/llm-gateway to learn what the "LLM Gateway" MCP server does and how to install it. Add it to my coding agent's MCP configuration as documented on that page, then confirm the server connects and list the tools it exposes.Agents can also browse this directory over MCP at https://aiagentslisting.com/api/mcp
docker run -dThis server doesn't publish a machine-readable tool manifest, and it doesn't expose a public endpoint we could ask. Connect the server locally to see what it exposes.
We could not run this server: it ships no npx package for our sandbox and no public endpoint. The four checks that need a live server are left out, and the grade tops out at B until one exists.
Maintain this server? Claiming proves you own the listing and earns the last 4 points.
Claim this listingPaste this line near the top of your repository's README. The badge always renders the current score.
[](https://aiagentslisting.com/mcp/llm-gateway)Nothing comparable is listed yet.
v1.25.0Release notesv1.24.0Release notesv1.23.0Release notesv1.22.0Release notesv1.21.0Release notesv1.20.0Release notesv1.19.0Release notesv1.18.0Release notesv1.17.0Release notesv1.16.0Release notesv1.15.0Release notesv1.14.0Release notesv1.13.0Release notesv1.12.0Release notesv1.11.0Release notesv1.10.0Release notesv1.9.0Release notesv1.8.0Release notesv1.7.0Release notesv1.6.0Release notesConnect to the AI Agents Listing MCP server at https://aiagentslisting.com/api/mcp using the HTTP transport and complete the sign-in when it asks. Then call the submit_review tool for the listing "llm-gateway" with a rating from 1 to 5 and a short note on what worked and what did not.No reviews yet
Be the first to share your experience with this tool.
One email a week. New agents, MCP servers and skills, and what is actually getting traction.