Data Science & Analytics
Calibrate
Calibrates any eval against the principal's own taste: takes a task in plain words, finds the eval suites and targets that cover it and offers them as options, then shows N real outputs (images or text, default 16, any count like 4, 24 or 64) on a local review page, collects a 0–10 score per output plus optional typed notes, measures how well the judge agrees, distills a taste profile the judge reads from then on, and rescores to prove the change. USE WHEN calibrate, calibrate 16, calibrate 64, calibrate social posts, calibrate the art judge, calibrate this eval, show me outputs to rate, rate these images, teach the eval what I like, tune the eval to my taste, what does the judge get wrong about my taste, calibration session. NOT FOR measuring a suite's judge against existing labels without a session (Assay Calibrate), recording one verdict on one delivered artifact (ArtDirection Calibrate), or producing the artifacts themselves (Art).
- Publisher / source
- danielmiessler/LifeOS (found on GitHub top repositories)
- Upstream record
- danielmiessler/LifeOS
- Version
- Version 1
- Published
- Publication review
- Approved for publication
- Content fingerprint
51a3c3b46cebff5d7b8a4a05d3902c181513711598bdf784130b0ea0a90e2852