
# Viet-Mistral/Vistral-7B-Chat-mlx-4bit
This model was converted to MLX format from [`Viet-Mistral/Vistral-7B-Chat`]().
Refer to the [original model card](https://huggingface.co/Viet-Mistral/Vistral-7B-Chat) for more details on the model.
## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("Viet-Mistral/Vistral-7B-Chat-mlx-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```

{"language": ["vi"], "license": "afl-3.0", "library_name": "transformers", "tags": ["LLMs", "NLP", "Vietnamese", "Large Language Models", "mlx"], "extra_gated_prompt": "You agree not to use the model for experiments that could harm human subjects.", "extra_gated_fields": {"Name": "text", "Email": "text", "Affiliation": "text", "Country": "text", "I agree to the LICENSE of this model": "checkbox"}}
transformers safetensors mistral text-generation LLMs NLP Vietnamese Large Language Models mlx conversational vi license:afl-3.0 autotrain_compatible endpoints_compatible text-generation-inference region:us