A free, open-source, OpenAI-compatible gateway with 22 cataloged LLM providers.
freellmpool is a free, open-source Python tool that catalogs free-tier routes across 22 LLM
providers — Groq, Cerebras, NVIDIA, Google Gemini, OpenRouter, Cloudflare, Mistral, Cohere and more —
behind one OpenAI-compatible endpoint. It runs as a command-line tool, a Python library, a
local proxy, and an MCP server, with automatic failover
when a provider is rate-limited and per-day quota tracking across tiers. Several providers (Pollinations,
OVHcloud, and Kilo Gateway) need no API key, and LLM7 works without one, so pip install freellmpool can answer without signup when a keyless provider is up.
The proxy speaks the OpenAI API and includes an experimental Anthropic-compatible path, so existing apps
and coding agents such as Codex, Claude Code, and aider can run on pooled free models.
pip install freellmpool
freellmpool ask "Explain the CAP theorem in one sentence." # keyless when routes are availableGitHub · PyPI · Changelog · MIT license
spread routing, and registry-readiness hardening for
the existing repository-local OpenCode plugins.
Registry publication status: pending. opencode-freellmpool and
opencode-freellmpool-tui are CI-tested but were not published on npm as of 2026-08-29;
use their repository-local installation paths.| Tool | What it is | Install | Keyless start | CLI / library / proxy / MCP |
|---|---|---|---|---|
| freellmpool | Pools many providers' free tiers | pip install | Yes (keyless routes) | All four |
| OpenRouter | Hosted paid aggregator (some free models) | API key | No (account + key) | API only |
| LiteLLM | Multi-provider SDK/proxy (bring your own keys) | pip install | No | Library + proxy |
| Self-hosted free-API servers | A server you deploy | Docker + config | No (deploy first) | Server only |
freellmpool's niche: the keyless, pip-installable client for squeezing the hosted free tiers — not a server you deploy and not a paid aggregator.
freellmpool ask "...", pipe stdin, pin a provider/model.OPENAI_BASE_URL at freellmpool proxy for most text, embedding, and transcription calls. Text-only Responses and Anthropic Messages stream incrementally; rich content and tools retain their buffered compatibility path./dashboard or /playground. The public shell contains no pool data; on a keyed proxy it keeps the entered token only in page memory and authenticates each protected data call by header.freellmpool local discover previews a fixed list of literal-loopback LM Studio, Ollama, and llama.cpp endpoints. A separate local import --name <runtime> --yes adds pin-only models without credentials or LAN scanning.freellmpool code claude (also codex, aider, cline, continue, cursor, Hermes, and OpenCode) routes them to pooled free models — see the step-by-step guide. The Hermes profile is included in 0.12.0./livez and /readyz probes, authenticated /v1/providers, and /v1/models?ready=true for locally ready targets.freellmpool/agent for strongest-tier, quota-aware agent loops and add the repository-local dashboard/tools plugins while npm publication is pending.from freellmpool import Pool, AsyncPool.freellmpool mcp lets Claude Desktop/Code/Cursor offload subtasks to free models.freellmpool benchmark + latency-aware routing.freellmpool capacity status and freellmpool providers health show which free tiers are healthy, near quota, or missing a key — see the capacity guide.Per-provider free tiers: Groq · Gemini · Cerebras · NVIDIA · Mistral
Yes — freellmpool is a free, open-source, MIT-licensed gateway that exposes one OpenAI-compatible
endpoint backed by cataloged routes across 22 providers. Install it with pip install freellmpool
and point any OpenAI client at the local proxy.
freellmpool pools them: each request goes to a provider you have access to, and if that one is
rate-limited or down it automatically fails over to the next. It tracks per-day usage so load spreads
evenly across the free tiers, and an optional fast routing mode prefers the
lowest-latency provider.
Yes. The proxy implements the OpenAI API and an experimental Anthropic-compatible path, so you set
OPENAI_BASE_URL=http://localhost:8080/v1 or ANTHROPIC_BASE_URL=http://localhost:8080 and run Codex,
Claude Code, aider, Cline, Continue, Cursor, or OpenCode on pooled free models.
Run freellmpool code claude for the exact setup. (The Claude Code path is experimental:
text and tool use, no vision yet.)
No key is required to start: Pollinations, OVHcloud, and Kilo Gateway need no API key, and LLM7 is key-optional, so a fresh install can answer without signup when a keyless provider is up. Add free keys for the other providers to unlock more models and higher limits.
Yes, explicitly. Run freellmpool local discover to preview the small fixed list of
literal-loopback endpoints, then freellmpool local import --name ollama --yes (or another
reported runtime) to add its models as exact pins. Discovery sends no credential, follows no redirect,
does not scan your LAN or processes, and import does not add the models to automatic routing.
22 cataloged providers: Pollinations, OVHcloud, LLM7, Kilo Gateway, OpenCode Zen (disabled by default), Groq, Cerebras, NVIDIA NIM, OpenRouter, Google Gemini, Cloudflare Workers AI, Mistral, Cohere, SambaNova, Z.ai/Zhipu, Ollama Cloud, Hugging Face (router), Aion Labs, ModelScope API Inference, Morph, Vercel AI Gateway, and SiliconFlow — 178 enabled chat routes, 431 cataloged chat models, plus free embeddings and audio transcription (Whisper).
Run freellmpool capacity status: it labels each provider healthy,
low_quota, exhausted, invalid_key, or missing from
your local catalog, environment, and per-day usage, and flags when you're below a target number of
healthy providers. freellmpool providers health sends one tiny request to each configured
provider and reports latency or failure, and freellmpool keys add walks you through
configuring more. See the capacity guide.
OpenRouter is a hosted aggregator you pay per token (with some rate-limited free models) and access
through its API. freellmpool is a local, open-source tool you pip install that pools the
providers' own free tiers directly, can start keyless when routes are available, and ships a CLI, a Python library, a
proxy, and an MCP server.
Yes — it is MIT-licensed and free to use. Source is on GitHub; the package is on PyPI.
Free-tier models are smaller than frontier models — good for drafting, classification, triage, and everyday coding, not GPT-class reasoning on the hardest problems. freellmpool's local per-day counters reset at UTC midnight; upstream limit/reset windows and capacity vary. The proxy is meant for local/single-user use.
freellmpool is not a privacy layer: prompts go to the selected upstream provider. See the FAQ for provider routing, ToS, and privacy notes.