RLAIF-V-Dataset是OpenBMB构建的一个大规模多模态偏好数据集。该数据集是由AI生成的偏好数据集,涵盖各种任务和领域,包含44,757组高质量对比对。RLAIF-V-数据集通过一个新颖的方法,采用开源大模型来对模型响应进行去混杂处理,并提供高质量的反馈。该数据集应用在了MiniCPM-Llama3-V 2.5模型的训练中,MiniCPM-Llam...
in RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: a high-level explanation of the dataset characteristics explain motivations and summary of its content potential use cases of the ...
Sign in to your account update rlaif-v hf dataset #1755 Merged hjh0119 merged 1 commit into modelscope:main from hjh0119:fix-819 Aug 19, 2024 +2 −1 Conversation 0 Commits 1 Checks 2 Files changed 1 Conversation Copy link Collaborator hjh0119 commented Aug 19, 2024 PR type Bug ...