
Run it using the MlX framework. For more details, click [here](https://github.com/mzbac/mlx-examples/tree/yayi/llms/yayi2).
```
python yayi.py --model-path <path_to_mlx_model> --prompt "### Human: 你好\n### Assistant:"
```
Prompt template: 
```
### Human: {prompt}
### Assistant:
```
{"license": "other", "tags": ["mlx"], "license_name": "yayi", "license_link": "https://huggingface.co/wenge-research/yayi2-30b"}
mlx yayi license:other region:us