Lightlines
By google

google-agents-cli-eval

google

Find agent failures and prove each fix.

agent evaluation

What it does

Evaluates agents, diagnoses failures, and iterates code or prompt fixes while comparing results.

When to use it

Use when evaluating an agent, creating evaluation data, analyzing failures, comparing results, or optimizing agent quality.

How to use it

Give it an agents-cli project; it prepares evaluation data, runs and grades evaluations, diagnoses failures, and applies verified fixes.

What you provide

  • An existing project

Uses


Access · 1

This skill

Vertex Evaluation Service

Write

Sends traces for cloud grading

What you need · 1

Requires agents-cli; the documented installation command is uv tool install google-agents-cli.


About this skill

Visibility
Public
Repository
google/agents-cli
Created
Oct 8, 2026
Updated
Oct 8, 2026
Files
7