Data Science & Analytics
Agent Evaluation
为 Agent 建立或改进评估体系时使用——设计评估指标（Pass@k/Pass^k/成本）、搭建可重复运行的评估环境、选择确定性验证器或 LLM-as-a-Judge 及各自适用边界、编写 Rubric、做失败归因与回归任务、评估驱动的模型选型、判断统计显著性、建设可观测性与内部评估基础设施（消融、AB 测试、特性开关、提示词回归）、从 Benchmark 报告走到系统改进。
- Publisher / source
- bojieli/ai-agent-book (found on GitHub top repositories)
- Upstream record
- bojieli/ai-agent-book
- Version
- Version 1
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-03
- Content fingerprint
04712fc85be9fc5e1c5da83843c3524f2cc19042589a08bd39e686966df982f0