Issues

• typo???

  OpenLMLab/MOSS-RLHF#60 · Filter by author aiyinyuedejustin opened on Feb 6, 2025

• RecursionError: maximum recursion depth exceeded while calling a Python object

  OpenLMLab/MOSS-RLHF#59 · Filter by author wangkevin02 opened on Jan 16, 2025
  1

• 第二篇论文中奖励模型训练的问题

  OpenLMLab/MOSS-RLHF#58 · Filter by author Syaoran1 opened on Sep 27, 2024

• Issue when merging llama with diff to generate English policy model

  OpenLMLab/MOSS-RLHF#57 · Filter by author foxlf823 opened on Aug 4, 2024

• RM数据构造

  OpenLMLab/MOSS-RLHF#55 · Filter by author tcxia opened on Mar 26, 2024
  4

• Has anyone compared this training framework to TRL?

  OpenLMLab/MOSS-RLHF#54 · Filter by author StarrySeas1 opened on Mar 25, 2024
  1

• 对第二篇论文中有些不明白的地方请教解惑

  OpenLMLab/MOSS-RLHF#53 · Filter by author Obr00007576 opened on Mar 13, 2024

• 论文中提到在PPO流程中可以固定其他模型，先训练reward model直到value loss为0，请问这边具体是怎么进行训练的呢？

  OpenLMLab/MOSS-RLHF#52 · Filter by author HCHCXY opened on Mar 7, 2024
  1

• Part2中meta dataset的生成

  OpenLMLab/MOSS-RLHF#51 · Filter by author yata0 opened on Feb 28, 2024
  1

• 训练集量级咨询

  OpenLMLab/MOSS-RLHF#50 · Filter by author Macvh opened on Feb 27, 2024
  1

• PPOSFTDataset bug report和相关问题咨询

  OpenLMLab/MOSS-RLHF#49 · Filter by author DZ9 opened on Feb 5, 2024
  1

• 关于rm中lm loss计算的疑问

  OpenLMLab/MOSS-RLHF#48 · Filter by author DZ9 opened on Feb 5, 2024
  1

• 论文中rm对比学习训练方法疑问

  OpenLMLab/MOSS-RLHF#45 · Filter by author yhhh777 opened on Jan 24, 2024
  4

• Issues with using the released hh dataset.

  OpenLMLab/MOSS-RLHF#44 · Filter by author jltchiu opened on Jan 23, 2024
  2

• 关于rm模型训练策略与损失函数

  OpenLMLab/MOSS-RLHF#43 · Filter by author tonylin52 opened on Jan 16, 2024
  12

• Clarification on MetaRM-optimization Implementation

  OpenLMLab/MOSS-RLHF#42 · Filter by author Benjamin-eecs opened on Jan 15, 2024
  2

• 请问目前支持基座模型使用Mistral-7b吗

  OpenLMLab/MOSS-RLHF#39 · Filter by author YijuGuo opened on Jan 11, 2024
  1

• 自有的底座模型，自有的SFT权重，重新训练RM，可行么

  OpenLMLab/MOSS-RLHF#38 · Filter by author camposs1979 opened on Dec 11, 2023
  1

• Why are you not releasing your reward model for english?

  OpenLMLab/MOSS-RLHF#37 · Filter by author AmanSinghal927 opened on Dec 7, 2023
  1

• Inference with SFT and Policy EN models

  OpenLMLab/MOSS-RLHF#36 · Filter by author henrypapadatos opened on Nov 10, 2023
  1

• 请问下代码里的kl散度问题

  OpenLMLab/MOSS-RLHF#35 · Filter by author rigorosyangffff opened on Nov 4, 2023
  2

• 合并权重问题

  OpenLMLab/MOSS-RLHF#34 · Filter by author red-tie opened on Oct 7, 2023
  7

• 关于reward model的权重合并问题

  OpenLMLab/MOSS-RLHF#33 · Filter by author HuipengXu opened on Oct 5, 2023
  1

• 资源占用问题

  OpenLMLab/MOSS-RLHF#32 · Filter by author Ming-Di opened on Sep 18, 2023
  3

• 关于reward model的部分的part 2有计划时间节点吗

  OpenLMLab/MOSS-RLHF#31 · Filter by author SpongebBob opened on Sep 14, 2023
  13