fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation

intel-autoround

text-generation-inference

4-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

File size: 135 Bytes

b4769e7

version https://git-lfs.github.com/spec/v1
oid sha256:9cde646aa6918032aa7b57db027c3bed91909458035f38062bed6071dbb7b9fd
size 2842493440