
# mlx-community/sqlcoder-70b-alpha-4bit-mlx
This model was converted to MLX format from [`defog/sqlcoder-70b-alpha`]().
Refer to the [original model card](https://huggingface.co/defog/sqlcoder-70b-alpha) for more details on the model.
## Use with mlx

```bash
pip install mlx-lm
```

```python
from mlx_lm import load, generate

model, tokenizer = load("mlx-community/sqlcoder-70b-alpha-4bit-mlx")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```

{"license": "cc-by-sa-4.0", "library_name": "transformers", "tags": ["mlx"], "pipeline_tag": "text-generation"}
transformers llama text-generation mlx license:cc-by-sa-4.0 autotrain_compatible endpoints_compatible text-generation-inference region:us