generate-synthetic-data

Creates realistic synthetic test inputs that probe likely failures in an LLM pipeline.

When to use it

Use to bootstrap an evaluation dataset, supplement sparse real user data, or test failure hypotheses; avoid it when there are already 100+ representative real traces or the task is collecting production logs.

Give it an application description; it works with you to validate test scenarios before generating realistic synthetic queries.