To run this model, please clone: https://github.com/ggerganov/llama.cpp and  install using Make (see instruction in Github)

Then, download the model and place it in the models folder and run:

Linux:
./main -m models/baize_lora_13b_q4.bin -n -1 -t 4 --ignore-eos --temp 0.4 --interactive-first --repeat_penalty 1.2 --instruct --color

Windows:
main.exe -m models/baize_lora_13b_q4.bin -n -1 -t 4 --ignore-eos --temp 0.4 --interactive-first --repeat_penalty 1.2 --instruct --color

It should look something like this:
![sample_screenshot.png](https://s3.amazonaws.com/moonup/production/uploads/633c786f475fefe61c589b84/DRWAnwOxoNwU6ABM5xcPz.png)
{}
transformers llama text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

To run this model, please clone: URL and  install using Make (see instruction in Github)

Then, download the model and place it in the models folder and run:

Linux:
./main -m models/baize_lora_13b_q4.bin -n -1 -t 4 --ignore-eos --temp 0.4 --interactive-first --repeat_penalty 1.2 --instruct --color

Windows:
URL -m models/baize_lora_13b_q4.bin -n -1 -t 4 --ignore-eos --temp 0.4 --interactive-first --repeat_penalty 1.2 --instruct --color

It should look something like this:
!sample_screenshot.png
TAGS
#transformers #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

TAGS
#transformers #llama #text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
