llm-router-server

Here are 2 public repositories matching this topic...

Continuum-AI-Corp / OrcaRouter-Lite

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

Updated Aug 21, 2026
Python

LLMSystems / LLM-Router-Server

Star

LLM Router Server is a high-performance routing service designed for multi-model deployment scenarios, used to uniformly manage and orchestrate multiple local Large Language Model (LLM) services, Embedding models, Re-ranking models, and other inference services.

asyncio multi-model inference-server load-balancing model-serving fastapi llm llm-serving vllm llm-router ai-infrastructure llm-router-server

Updated Mar 28, 2026
Python

Improve this page

Add a description, image, and links to the llm-router-server topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-router-server topic, visit your repo's landing page and select "manage topics."

Learn more