Data Science & Analytics
Evaluators
Author or refine a Phoenix evaluator — code or LLM-as-a-judge — that scores a run's output. Trigger when the user wants to create a new evaluator, improve an existing one's logic or rubric, choose labels, or decide what to measure on a dataset or experiment. Do NOT trigger on: (1) manual prompt drafting (use `playground`), (2) running or comparing experiments themselves (use `experiments`), (3) cross-trace failure diagnosis with no evaluator in scope (use `phoenix-error-analysis`).
- Publisher / source
- Arize-ai/phoenix (found on GitHub top repositories)
- Upstream record
- Arize-ai/phoenix
- Version
- Version 1
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-04
- Content fingerprint
b02c83552b50115f4f39f03d43797ac377aa5ee30eadbd03145315fe29402ea8