unsloth
/

llama-2-7b-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

llama-2-7b-bnb-4bit / README.md

danielhanchen's picture

Update README.md

16cfa6e about 1 year ago

|

129 Bytes

metadata

license: llama2

Will add a 4bit quantized upload once https://github.com/huggingface/transformers/pull/26037 gets merged.