---
license: mit
datasets:
- PKU-Alignment/BeaverTails
language:
- en
base_model:
- PKU-Alignment/alpaca-7b-reproduced
---
This model is for the reproduction of results on Safe-RLHF dataset of paper "The crucial role of samplers in online direct preference optimization". Iteration 3 of DPO-mixp algorithm, trained on https://huggingface.co/zhezi12138/alpaca-7b-iter-2-mixp.