mlx yayi license:other region:us
---
license: other
license_name: yayi
license_link: https://huggingface.co/wenge-research/yayi2-30b
tags:
- mlx
---

Run it using the MlX framework. For more details, click [here](https://github.com/mzbac/mlx-examples/tree/yayi/llms/yayi2).
```
python yayi.py --model-path <path_to_mlx_model> --prompt "### Human: 你好\n### Assistant:"
```
Prompt template: 
```
### Human: {prompt}
### Assistant:
```