OMNIROUTE

OmniRoute is an AI gateway for multi-provider LLMs: an OpenAI-compatible endpoint with smart routing, load balancing, retries, and fallbacks. Add policies, rate limits, caching, and observability for reliable, cost-aware inference.

SITE/SOURCE: https://github.com/diegosouzapw/OmniRoute

Applications Home