README.md

---
base_model: llava-hf/llava-1.5-7b-hf
language:
- en
library_name: transformers
pipeline_tag: image-text-to-text
license: llama2
tags:
- multimodal
- llava
- vision
- unsloth
- mlx
---

# shashikanth-a/llava-1.5-7b-hf-4bit
This model was converted to MLX format from [`unsloth/llava-1.5-7b-hf`]() using mlx-vlm version **0.1.3**.
Refer to the [original model card](https://huggingface.co/unsloth/llava-1.5-7b-hf) for more details on the model.
## Use with mlx

```bash
pip install -U mlx-vlm
```

```bash
python -m mlx_vlm.generate --model shashikanth-a/llava-1.5-7b-hf-4bit --max-tokens 100 --temp 0.0
```