Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between preference-optimization methods, or when a DPO run needs hyperparameters or debugging.
安装
尚未确认此技能的独立目录。下面命令会打开仓库技能选择器，请按上游说明选择技能。
skills CLI
npx skills add wshobson/agents