transformers pytorch llama text-generation conversational en dataset:Junrulu/Prompt_Preference_Dataset arxiv:2402.11811 base_model:allenai/tulu-2-dpo-70b autotrain_compatible endpoints_compatible text-generation-inference region:us
---
model-index:
- name: Junrulu/FIPO-IPL-IPO-Tulu2-70B
  results: []
datasets:
- Junrulu/Prompt_Preference_Dataset
language:
- en
base_model: allenai/tulu-2-dpo-70b
---

# Model Card for FIPO-IPL-IPO-Tulu2-70B

Our repository: https://github.com/LuJunru/FIPO_Project.

Our paper: https://arxiv.org/abs/2402.11811.

## Input Format

The model is trained to use the following format (note the newlines):
```
<|user|>
Your message here!
<|assistant|>
```

For best results, format all inputs in this manner. **Make sure to include a newline after `<|assistant|>`, this can affect generation quality quite a bit.**