Arize

Monitors and evaluates AI models for performance and reliability in production. Continuously improve AI agents with agent observability, evaluation, tracing, and experimentation. Arize AI monitors and evaluates AI models, providing insights into performance and issues in production. The Phoenix tool is free and open-source, while Arize AX requires a custom enterprise quote. Arize supports models from OpenAI, Cohere, Bedrock, PaLM 2, and more, across NLP, computer vision, and ranking tasks. It uses OpenTelemetry and supports frameworks like LlamaIndex and LangChain. Arize is cloud-only, though Phoenix can run locally via Docker or Jupyter. Arize uses secure, configurable access controls and complies with enterprise privacy standards.