metadata
license: llama3
language:
- de
- en
library_name: transformers
Llama3_DiscoLeo_Instruct_8B_v0.1_4bit_awq_glc
This model is a 4 bit quantization of DiscoResearch/Llama3_DiscoLeo_Instruct_8B_v0.1
created using AutoAWQ with a custom bilingual calibration dataset and quant_config = {"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"}.
Copy of original model card:
...