# DPOpenHermes 11B

This is a mergekit merge of DPOpenHermes-7B from seperate versions of it.

```
slices:
  - sources:
    - model: openaccess-ai-collective/DPOpenHermes-7B
      revision: dpo-v0
      layer_range: [0, 24]
  - sources:
    - model: openaccess-ai-collective/DPOpenHermes-7B
      layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16
```
{"language": ["en"], "license": "apache-2.0", "library_name": "transformers", "datasets": ["teknium/openhermes", "argilla/ultrafeedback-binarized-preferences", "Intel/orca_dpo_pairs"]}
transformers safetensors mistral text-generation conversational en dataset:teknium/openhermes dataset:argilla/ultrafeedback-binarized-preferences dataset:Intel/orca_dpo_pairs license:apache-2.0 autotrain_compatible endpoints_compatible text-generation-inference region:us