Skip to content

Questions about future plans about the reward model #2017

Closed

Description

@Haskely

Dear team,

I've read the guides/developers and reward/instructor , I have some questions regarding the training process of the reward model, and I hope you can help me with it.

  1. reward/instructor#dataset mentioned that Once open-asisstant dataset are available it will be added here.. Has the task of supporting OPEN-ASSISTANT's own dataset been scheduled? How long will it take to complete it?
  2. Is the process of training the reward model currently done manually? Will it be integrated into the data loop for automatic execution in the future?( The idea here is that the reward model will automatically perform an initial ranking of the data, and then user feedback will be used as further training data for it.)

Thank you for your time and assistance.

Activity

  1. locked and limited conversation to collaborators on Jun 9, 2023
  2. converted this issue into a discussion #3343 on Jun 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions