This is a quantized GGUF version of Microsoft Phi-2 to 4_0, 8_0 bits and the converted 16 FP model.

(link to the original model : https://huggingface.co/microsoft/phi-2)

*Disclamer* : make sure to have the latest version of llama.cpp after commit b9e74f9bca5fdf7d0a22ed25e7a9626335fdfa48
{"language": ["en"], "license": "mit", "tags": ["nlp", "code"], "inference": false, "license_name": "microsoft-research-license", "license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE", "pipeline_tag": "text-generation"}
gguf nlp code text-generation en license:mit has_space region:us