Lightlines
By arize-ai

arize-evaluator

arize-ai2.8k installs

Score your app's AI responses with Arize.

What it does

Creates and runs Arize evaluators that score application traces and experiment runs.

When to use it

Use for creating evaluators, scoring spans or experiments, configuring continuous monitoring, or improving evaluator prompts.

How to use it

Give it an evaluation request; it creates an evaluator and configures scoring tasks in Arize, asking for choices when needed.

Uses

Good to know

  • cannot be undone: ax profiles

Latest review

What you need · 5

Requires the ax CLI and a configured Arize profile.

Requires authenticated access to the relevant Arize space; API keys are scoped to a space.


Access · 2

This skill

ax profiles

Write

Saves or updates Arize profiles (irreversible)

Arize

Execute

Starts Arize evaluation runs

Write

Creates Arize evaluators and tasks