|
--- |
|
library_name: transformers |
|
language: |
|
- en |
|
- fr |
|
- it |
|
- pt |
|
- hi |
|
- es |
|
- th |
|
- de |
|
base_model: |
|
- meta-llama/Llama-3.1-70B |
|
tags: |
|
- facebook |
|
- meta |
|
- pytorch |
|
- llama |
|
- llama-3 |
|
- Llama-3.3-70B-Instruct |
|
- llama-cpp |
|
- gguf |
|
- Q3_K_S |
|
- meta-llama |
|
- code |
|
- math |
|
- chat |
|
- roleplay |
|
- text-generation |
|
- safetensors |
|
- nlp |
|
- code |
|
license: llama3.3 |
|
pipeline_tag: text-generation |
|
--- |
|
# roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_S-GGUF |
|
|
|
**Repo:** `roleplaiapp/Llama-3.3-70B-Instruct-Q3_K_S-GGUF` |
|
**Original Model:** `Llama-3.3-70B-Instruct` |
|
**Organization:** `meta-llama` |
|
**Quantized File:** `llama-3.3-70b-instruct-q3_k_s.gguf` |
|
**Quantization:** `GGUF` |
|
**Quantization Method:** `Q3_K_S` |
|
**Use Imatrix:** `False` |
|
**Imatrix Quant Method:** `IQ4_NL` |
|
**Split Model:** `True` |
|
|
|
## Overview |
|
This is an GGUF Q3_K_S quantized version of [Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct). |
|
|
|
## Quantization By |
|
I often have idle A100 GPUs while building/testing and training the RP app, so I put them to use quantizing models. |
|
|
|
I hope the community finds these quantizations useful. |
|
|
|
Andrew Webby @ [RolePlai](https://roleplai.app/) |
|
|
