Lightlines
By hamelsmu

write-judge-prompt

hamelsmu766 installs

Judge subjective AI failures with a focused prompt.

What it does

Designs a binary evaluator prompt that judges one specific failure mode in an AI system's output.

When to use it

Use for failure modes requiring interpretation that code cannot check, not for validating or calibrating an existing judge.

How to use it

Give it an identified failure mode and human-labeled traces with at least 20 Pass and 20 Fail examples; it designs a focused binary judge prompt.

What you provide

  • the failure mode to check
  • Your files

Latest review

What you need · 0

No setup requirements listed.


Access · 0

No additional actions listed.