Quality Assurance & Testing

Probing First Try Use

Find the places where an agent that has not read the docs gets an ffmpeg-skill tool wrong on the first try — having a fresh agent write calls blind from each tool's name and one line about it, running them with tests/first_try.py, reading the calls that ran as carefully as the ones that failed, teaching each miss through a help string or the shared hint, and recording it in docs/stumbles.jsonl so a test replays it. Use when asked how usable the tools are, before promoting a tool from beta to stable, after adding or renaming options, at the weekly measurement, or when a user reports that an agent "kept guessing the wrong flag".

Publisher / source
kajisho5/ffmpeg-skill (found on GitHub top repositories)
Upstream record
kajisho5/ffmpeg-skill
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
856d638b3007032a3e70f7445c94552a3522d940c1c6d7d40fbd5554eed14940