
DPO Finetuned paulml/OGNO-7B using jondurbin/truthy-dpo-v0.1

paulml/OGNO-7B is a mistral 7b variant afaik and this repo is an experimental repo, so might not be useable in prod

Thx for the great data sources.
{"language": ["en"], "license": "apache-2.0", "library_name": "transformers", "tags": ["merge", "dpo", "text-generation-inference"], "datasets": ["jondurbin/truthy-dpo-v0.1"], "pipeline_tag": "text-generation"}
transformers pytorch mistral text-generation merge dpo text-generation-inference en dataset:jondurbin/truthy-dpo-v0.1 license:apache-2.0 autotrain_compatible endpoints_compatible region:us