Software Development

Run Deep Swe

Score any AI model on the DeepSWE coding-agent benchmark via the OpenRouter API. Use when the user wants an independent, reproducible coding-agent eval — "run DeepSWE", "benchmark this model on DeepSWE", "score model X on the coding benchmark", "test a model via OpenRouter on DeepSWE", or to verify vendor-reported coding scores. Covers setup, the OpenRouter wiring for mini-swe-agent, single-task / subset / full 113-task runs, and leaderboard submission.

Publisher / source
adriannoes/awesome-agentic-ai (found on the CSV list)
Upstream record
adriannoes/awesome-agentic-ai
Version
Version 2
Published
Publication review
Approved for publication
Content fingerprint
79efad17283ac49507bb869518e7dde62f126129deb94b43140bbabce3afaaec