Software Development
Preference Optimization
Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between preference-optimization methods, or when a DPO run needs hyperparameters or debugging.
- Publisher / source
- wshobson/agents (found on skills.sh, the CSV list)
- Upstream record
- wshobson/agents
- Version
- Version 3
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-03
- Content fingerprint
c5756fa59c8c99475b6fee92199ea17f060ba3895d5ff5ab2b544ed4ac996fe8