Lightlines
By github

arize-experiment

github1.1k installs

Compare your AI models on the same examples.

What it does

Evaluates AI models on datasets and records experiments in Arize for performance comparisons.

When to use it

Use when asked to create or run experiments, compare models, analyze experiment results, or benchmark AI performance.

How to use it

Give it a model evaluation request; it collects outputs and evaluations and creates an experiment in Arize.

Uses

Good to know

  • cannot be undone: ax profiles

Latest review

What you need · 4

Requires the ax CLI, version 0.14.0 or higher; version checks are instructed only after a command fails.

Requires authenticated access to Arize through a configured profile with an API key for the relevant space.


Access · 5

This skill

ax profiles

Write

Saves or replaces Arize profile settings (irreversible)

Arize

Write

Uploads experiment runs to Arize