shihabshahrier

Open-source projects by this author in the catalog, across all categories and statuses.

1 Projects

freelm

freelm is an LLM router that pools the official free tiers of Gemini, Groq, OpenRouter, Cerebras, Mistral, NVIDIA NIM, Cloudflare Workers AI and other providers behind one OpenAI-compatible API, using the user's own keys. It runs in-process as a Python or TypeScript library or as a local server (`freelm serve`), routing each request by measured latency and per-model quota, with classified failure handling and racing of slow providers — free-only by design.

Stars --Last Commit --