PrunaAI
/

01-ai-Yi-6B-AWQ-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

01-ai-Yi-6B-AWQ-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461

507bb38 verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.28 kB

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
config.json

916 Bytes

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
generation_config.json

153 Bytes

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
model.safetensors

3.93 GB
LFS

9e0d70b56c55c37772f5ed0351a87f3aa6e4d0cdf943e541f5e57f5f8a2e95dc 7 months ago
smash_config.json

1 kB

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
special_tokens_map.json

573 Bytes

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
tokenizer.json

3.6 MB

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
tokenizer.model

1.03 MB
LFS

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago
tokenizer_config.json

40.8 kB

0f6554356edce7548ba73beebac504e9a92708ba6d5289f4ed114cc84d19c461 7 months ago