AcruxCore

AcruxCore is an open-source, self-hosted LLM gateway and observability platform built for production AI applications. Operating directly in the request path, AcruxCore executes model routing, retries, caching, virtual API keys, budget controls, and tracing in a single low-latency hop. Key Features: • AI Gateway: Unified proxy with automated routing, fallbacks, caching, and budget limits. • Prompt Management: Jinja2-style templating with version control, diffs, and release tracking. • Tool Catalog: Centralized tool registration to update agent schemas without backend redeploys. • Traces & Evals: Automatic single-span tracing, cost tracking, and dataset evaluation. • Self-Hosted & Open Source: 1-command Docker Compose deployment with Apache 2.0 backend and MIT Node.js & Python SDKs. Deploy AcruxCore to gain complete privacy, cost control, and full observability over your LLM stack.