AI & Machine Learning

Fine Tuning With TRL

Fine-tune LLMs using reinforcement learning with TRL - SFT for instruction tuning, DPO for preference alignment, PPO/GRPO for reward optimization, and reward model training. Use when need RLHF, align model with preferences, or train from human feedback. Works with HuggingFace Transformers.

Publisher / source
Orchestra-Research/AI-Research-SKILLs (found on skills.sh, an awesome list)
Upstream record
Orchestra-Research/AI-Research-SKILLs
Version
Version 4
Published
Publication review
Approved for publication
Content fingerprint
d68f78ad741627ce7dcdf2ce78c73c8cf31d23db7d89555e0bdd0cd35c413811