## 1. Model description
This is the GGUF 4-bit version of [ZoyLLM-7B-SlimOrca](https://huggingface.co/tlphams/zoyllm-7b-slimorca), which is created for running with llama.cpp

## 2. Benchmark performance
- Benchmark dataset: [rag_instruct_benchmark_tester](https://huggingface.co/datasets/llmware/rag_instruct_benchmark_tester)
- Result file: rag_benchmark_result.json
{"license": "cc-by-nc-sa-4.0"}
gguf license:cc-by-nc-sa-4.0 region:us