
Llama.cpp compatible version of an original [30B model](https://huggingface.co/IlyaGusev/saiga_30b_lora).

* Download `ggml-model-q4_1.bin`.
* Download [interact_llamacpp.py](https://raw.githubusercontent.com/IlyaGusev/rulm/master/self_instruct/src/interact_llamacpp.py)

How to run:
```
sudo apt-get install git-lfs
pip install llama-cpp-python fire

python3 interact_llamacpp.py ggml-model-q4_1.bin
```

System requirements:
* 32GB RAM
* CPU with 4 cores

{"language": ["ru"], "datasets": ["IlyaGusev/ru_turbo_alpaca", "IlyaGusev/ru_turbo_saiga", "IlyaGusev/ru_sharegpt_cleaned"], "inference": false, "pipeline_tag": "conversational"}
conversational ru dataset:IlyaGusev/ru_turbo_alpaca dataset:IlyaGusev/ru_turbo_saiga dataset:IlyaGusev/ru_sharegpt_cleaned region:us
TAGS
#conversational #ru #dataset-IlyaGusev/ru_turbo_alpaca #dataset-IlyaGusev/ru_turbo_saiga #dataset-IlyaGusev/ru_sharegpt_cleaned #region-us 


URL compatible version of an original 30B model.

* Download 'ggml-model-q4_1.bin'.
* Download interact_llamacpp.py

How to run:


System requirements:
* 32GB RAM
* CPU with 4 cores

TAGS
#conversational #ru #dataset-IlyaGusev/ru_turbo_alpaca #dataset-IlyaGusev/ru_turbo_saiga #dataset-IlyaGusev/ru_sharegpt_cleaned #region-us 

TAGS
#conversational #ru #dataset-IlyaGusev/ru_turbo_alpaca #dataset-IlyaGusev/ru_turbo_saiga #dataset-IlyaGusev/ru_sharegpt_cleaned #region-us 
