
# Model Card for felladrin-tinymistral-248m-v4-dpo

SFT model trained with orca DPO


## Model Details

### Model Description

Experimental.

ChatML format.
{"license": "apache-2.0", "library_name": "transformers", "tags": ["DPO", "reasoning", "mistral"], "datasets": ["argilla/distilabel-intel-orca-dpo-pairs"], "pipeline_tag": "text-generation"}
transformers safetensors mistral text-generation DPO reasoning conversational dataset:argilla/distilabel-intel-orca-dpo-pairs license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us