
# Venus 120B v1.0 - GGUF
- Model creator: [nsfwthrowitaway69](https://huggingface.co/nsfwthrowitaway69)
- Original model: [Venus 120B v1.0](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.0)

## Description

GGUF quants for [nsfwthrowitaway69's Venus 120B v1.0](https://huggingface.co/nsfwthrowitaway69/Venus-120b-v1.0).

## Provided quants

| Name | Quant method | Size |
| ---- | ---- | ---- |
| Venus-120b-v1.0.Q2_K.gguf | Q2_K | 50.71 GB|
| Venus-120b-v1.0.Q3_K_S.gguf | Q3_K_S | 51.81 GB|
| Venus-120b-v1.0.Q3_K_M.gguf | Q3_K_M | 57.64 GB|
| Venus-120b-v1.0.Q3_K_L.gguf | Q3_K_L | 63.01 GB|
| Venus-120b-v1.0.Q4_K_S.gguf | Q4_K_S | 67.88 GB|
| Venus-120b-v1.0.Q4_K_M.gguf | Q4_K_M | 72.14 GB|
| Venus-120b-v1.0.Q5_K_S.gguf | Q5_K_S | 82.76 GB|
| Venus-120b-v1.0.Q5_K_M.gguf | Q5_K_M | 85.02 GB|
| Venus-120b-v1.0.Q6_K.gguf | Q6_K | 98.70 GB|
| Venus-120b-v1.0.Q8_0.gguf | Q8_0 | 127.84 GB|

## All of the files are split and require joining

**Note:** HF does not support uploading files larger than 50GB. Therefore the quants have been uploaded as split files.

## Q2_K - Q6_K
Download the two parts of your preferred quant. For `Q6_K` that would be:
* `Venus-120b-v1.0.Q6_K.gguf-split-a`
* `Venus-120b-v1.0.Q6_K.gguf-split-b`

## Q8_0
Download the three parts of the `Q8_0` quant:
* `Venus-120b-v1.0.Q8_0.gguf-split-a`
* `Venus-120b-v1.0.Q8_0.gguf-split-b`
* `Venus-120b-v1.0.Q8_0.gguf-split-c`

## To join the files, do the following:

### Linux and macOS:
```bash
cat Venus-120b-v1.0.Q6_K.gguf-split-* > Venus-120b-v1.0.Q6_K.gguf && rm Venus-120b-v1.0.Q6_K.gguf-split-*
```

**Note:** Replace `Q6_K` with the quant you downloaded

### Windows command line:

#### Q2_K - Q6_K

```
COPY /B Venus-120b-v1.0.Q6_K.gguf-split-a + Venus-120b-v1.0.Q6_K.gguf-split-b Venus-120b-v1.0.Q6_K.gguf
del Venus-120b-v1.0.Q6_K.gguf-split-a Venus-120b-v1.0.Q6_K.gguf-split-b
```

**Note:** Replace `Q6_K` with the quant you downloaded

#### Q8_K

```
COPY /B Venus-120b-v1.0.Q8_0.gguf-split-a + Venus-120b-v1.0.Q8_0.gguf-split-b + Venus-120b-v1.0.Q8_0.gguf-split-c Venus-120b-v1.0.Q8_0.gguf
del Venus-120b-v1.0.Q8_0.gguf-split-a Venus-120b-v1.0.Q8_0.gguf-split-b Venus-120b-v1.0.Q8_0.gguf-split-c
```

{"language": ["en"], "license": "llama2", "tags": ["not-for-all-audiences"], "model_name": "Venus 120B", "base_model": "nsfwthrowitaway69/Venus-120b-v1.0", "inference": false, "model_creator": "nsfwthrowitaway69", "model_type": "llama", "pipeline_tag": "conversational", "quantized_by": "3-3"}
transformers llama not-for-all-audiences conversational en base_model:nsfwthrowitaway69/Venus-120b-v1.0 license:llama2 text-generation-inference region:us