Data Science & Analytics

AI Eval Playbook

Answer questions about evaluating GenAI / AI tools and products using the AI Evaluation Playbook (eval.playbook.org.ai; The Agency Fund with CGD and IDinsight, 2026) — the 4-level framework (Model / Product / User / Impact), Minimum Viable Evaluations, golden datasets, LLM-as-judge, engagement funnels, guardrail metrics, level linkages. Use when Ane asks how to evaluate an AI tool, chatbot or GenAI product, "how do I know this AI is working", "what should we measure for this AI tool", "where do I start with AI evals", or an MA/partner AI tool proposal needs an evaluation appraisal. NOT for programme or MEL evaluation design (/ann, /grill-mel, indicator-designer, evidence-synthesis own that lane) and NOT for AI used by evaluators as a working tool (wiki page ai-mel-framework governs that).

Publisher / source
gasserane/personal-skills (found on skills.sh)
Upstream record
gasserane/personal-skills
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
3d168c80f8e28b737c83f1da821f16b4c4a9146d2a16d157aaa59fafb9182ca8