fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation

intel-autoround

text-generation-inference

4-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

File size: 135 Bytes

b4769e7

version https://git-lfs.github.com/spec/v1
oid sha256:9a58df5cb7815c4b5cae8523bf17889058fd1076966788701b955480be2d80d7
size 4987324192