Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
chayanbhansali
/
quantized-mistral
like
0
Text Generation
Transformers
Safetensors
mistral
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
arxiv:
1910.09700
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
df48ee8
quantized-mistral
/
generation_config.json
chayanbhansali
Upload MistralForCausalLM
df48ee8
verified
about 2 months ago
raw
Copy download link
history
blame
Safe
111 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"transformers_version"
:
"4.46.3"
}