--- license: llama2 --- Will add a 4bit quantized upload once https://github.com/huggingface/transformers/pull/26037 gets merged.