Quality Assurance & Testing

AI Eval CI

The AI Eval Ci skill integrates AI agent and LLM evaluations into CI/CD pipelines, automatically gating builds when output quality falls below defined thresholds. It supports frameworks such as Cobalt, Promptfoo, and Braintrust, and offers LLM-as-judge scoring and threshold assertions, all wrapped in GitHub Actions for seamless deployment. Engineers and data scientists use it to catch prompt regressions, compare models, and benchmark agents before release.

Publisher / source
TerminalSkills Library
Upstream record
TerminalSkills/skills
Version
Version 4
Published
Publication review
Approved for publication
Content fingerprint
4bb279b0c5f36618bee92341bd905a75262486b20770d493a4b202e7ec75e79e