fuzzy-mittenz's picture
Update README.md
c4ed079 verified
---
license: mit
language:
- en
base_model: meditsolutions/MedIT-Mesh-3B-Instruct
tags:
- llama-cpp
- gguf-my-repo
---
# IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF Model for swar/edge use Multi check Quant training for the most Ideal and coherent model
This model was converted to GGUF format from [`meditsolutions/MedIT-Mesh-3B-Instruct`](https://huggingface.co/meditsolutions/MedIT-Mesh-3B-Instruct) using llama.cpp
Refer to the [original model card](https://huggingface.co/meditsolutions/MedIT-Mesh-3B-Instruct) for more details on the model.
## Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
```bash
brew install llama.cpp
```
Invoke the llama.cpp server or the CLI.
### CLI:
```bash
llama-cli --hf-repo IntelligentEstate/MedIT-Mesh-3B-Instruct-Q8_0-GGUF --hf-file medit-mesh-3b-instruct-q8_0.gguf -p "The meaning to life and the universe is"
```