
This repository includes some of our favorite **bonchon** ('side dishes' in Korean).

We currently include in this repository several of our favorite GGUF files from TheBloke, including four of our favorite 7B chat models, in Q4_K_M GGUF files.

This repository is Public, but intended primarily for use in conjunction with other llmware models, datasets and libraries.  

Please note specific licensing information and reference for files included in the repository:

1.  **HuggingFaceH4/Zephyr-7B-GGUF** - MIT License - [original repository link](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) 
2.  **Teknium/OpenHermes-2.5-Mistral-7B-GGUF** - Apache 2.0 License - [original repository link](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)
3.  **Llama2-Chat-7B-GGUF** - [Llama2 License](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf/blob/main/LICENSE.txt) - [original repository link](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf)
4.  **Starling-7B-GGUF** - CC-BY-NC-4.0 License - Non-Commercial - [original repository link](https://huggingface.co/berkeley-nest/Starling-LM-7B-alpha)
5.  **EleutherAI/Llema-7B-GGUF** - Apache 2.0 License - [original repository link](https://huggingface.co/EleutherAI/llemma_7b)

Please also see [TheBloke](https://huggingface.co/TheBloke) for more information on GGUF.

{"license": "apache-2.0"}
transformers gguf llama license:apache-2.0 endpoints_compatible text-generation-inference region:us