Software Development

Evaluating Code Models

Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.

Publisher / source
KalarisLabs/research-agent-skills (found on the CSV list)
Upstream record
KalarisLabs/research-agent-skills
Version
Version 2
Published
Publication review
Approved for publication
Content fingerprint
b5031b5e3b214e690edfafe671ce517c48bb25a54056c4fc7ac8df97676fe2fd