Nous Hermes 2 - Mistral 7B - DPO - AWQ

Model Description

This repo contains the AWQ quantized version of the Nous Hermes 2 - Mistral 7B - DPO model. It was quantized with AutoAWQ using the following settings:

{"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"}

Downloads last month: 11

Safetensors

Model size

1.2B params

Tensor type

I32

FP16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for heyholetsgo/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Base model

mistralai/Mistral-7B-v0.1

Finetuned

NousResearch/Nous-Hermes-2-Mistral-7B-DPO

Quantized

(10)

this model

Dataset used to train heyholetsgo/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Evaluation results

Metadata error: specify a dataset to view leaderboard