RichardErkhov/mergekit-community_-_Qwen2-1.5B-RHSD-awq

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Qwen2-1.5B-RHSD - AWQ

• Model creator: https://huggingface.co/mergekit-community/
• Original model: https://huggingface.co/mergekit-community/Qwen2-1.5B-RHSD/

Original model description:

base_model:

• Replete-AI/Replete-Coder-Qwen2-1.5b
• trollek/Qwen2-1.5B-Instruct-Abliterated
• cognitivecomputations/dolphin-2.9.3-qwen2-1.5b
• macadeliccc/Samantha-Qwen2-1.5B
• M4-ai/Hercules-5.0-Qwen2-1.5B library_name: transformers tags:
• mergekit
• merge

---

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using trollek/Qwen2-1.5B-Instruct-Abliterated as a base.

Models Merged

The following models were included in the merge:

• Replete-AI/Replete-Coder-Qwen2-1.5b
• cognitivecomputations/dolphin-2.9.3-qwen2-1.5b
• macadeliccc/Samantha-Qwen2-1.5B
• M4-ai/Hercules-5.0-Qwen2-1.5B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Replete-AI/Replete-Coder-Qwen2-1.5b
  - model: M4-ai/Hercules-5.0-Qwen2-1.5B
  - model: macadeliccc/Samantha-Qwen2-1.5B
  - model: cognitivecomputations/dolphin-2.9.3-qwen2-1.5b
merge_method: model_stock
base_model: trollek/Qwen2-1.5B-Instruct-Abliterated
architecture: qwen2
dtype: bfloat16