Managed private deployment
Provision llmxy in a dedicated Learnmark-managed or customer-controlled environment with repeatable releases, encrypted configuration, backups, and rollback procedures.
Managed AI Infrastructure
llmxy
Operate one production gateway for multiple model providers with controlled routing, OpenAI-compatible APIs, usage visibility, and a managed path from deployment to day-two operations.
llmxy sits between your applications and model providers as a unified control plane. Teams keep a stable client protocol while operators configure upstream channels, models, route policies, quotas, and billing from one place.
- Operator-controlled routing. Configure upstream channels, model mappings, route policies, and weights without changing application clients.
- Gateway enforcement. Apply authentication, balance and quota checks, rate limiting, usage recording, and billing consistently at the gateway.
- Multi-provider access. Use an OpenAI-compatible protocol in front of OpenAI, Anthropic, Gemini, and translated upstream responses.
- Usage Analytics. Track token consumption, cost, and latency per model, key, and tenant with real-time dashboards.
- Two relay paths. Start with the direct FastAPI relay or add the optional Envoy path for higher-throughput traffic and asynchronous usage reporting.
The Learnmark product turns that open-source foundation into an operated gateway environment, with deployment engineering, provider onboarding, production controls, and an accountable support path.
Learnmark Product
What the managed llmxy product adds
The repository provides the gateway software. The Learnmark product adds the engineering and operational layer required to introduce it into a production platform and keep it healthy over time.
Provider and routing onboarding
Connect approved model providers, map model names, define route weights and policies, and validate failover behavior against your applications before rollout.
Production observability
Add environment-level metrics, alerting, capacity reviews, usage reconciliation, and operational runbooks around the gateway and its data services.
Upgrade and incident support
Receive coordinated upgrades, change reviews, troubleshooting, and a clear escalation path instead of operating the open-source stack alone.
Product Screenshots
The llmxy interface combines a self-service user console with an admin workspace for routing, monitoring, and billing operations.
User overview
Account balance, subscriptions, and quick-start API examples give users a clear path from signup to first request.
Models and API snippets
Expose available models with protocol tags and copy-ready curl, JavaScript, and Python request examples.
Smart routing rules
Configure weighted, fallback, and prompt-aware routes across upstream providers from the admin console.
Usage and billing logs
Filter usage by user, key, model, status, and label while tracking cost, latency, and token consumption.
An open foundation with an operated product path
Inspect and self-host the llmxy source code, or use the Learnmark product when your team needs implementation, environment ownership, controlled upgrades, and production support.