transformers pytorch mistral text-generation not-for-all-audiences conversational en dataset:NobodyExistsOnTheInternet/ToxicDPOqa license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us
---
license: apache-2.0
datasets:
- NobodyExistsOnTheInternet/ToxicDPOqa
language:
- en
tags:
- not-for-all-audiences
---

# nueral-toxic-dpo

[neural-chat-7b-v3-3](https://huggingface.co/Intel/neural-chat-7b-v3-3) DPO'd on 1 epoch ToxicDPOqa by [NEOTI](https://huggingface.co/NobodyExistsOnTheInternet).


My first trials with Axolotl.