
# Phi-2 Orange GGUF
![Phi-2 Orange](https://huggingface.co/rhysjones/phi-2-orange/resolve/main/phi-2-orange.jpg)

Original model: [Phi-2 Orange](https://huggingface.co/rhysjones/phi-2-orange)
Model creator: [Rhys Jones](https://huggingface.co/rhysjones)

This repo contains GGUF format model files for Rhys Jones' Phi-2 Orange.

### What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Converted using llama.cpp revision [de473f5](https://github.com/ggerganov/llama.cpp/commit/de473f5f8e19ba5e659cdf5af65fb9251dce16c5), the last compatible version before Microsoft's [incompatible modeling changes](https://huggingface.co/microsoft/phi-2/commit/cb2f4533604d8b67de604e7df03bfe6f3ca22869) were [introduced to llama.cpp](https://github.com/ggerganov/llama.cpp/commit/15ebe59210e7fd9817ff67f51fa1a5ee2d004294).


### Prompt template: ChatML
```
<|im_start|>system
{{system_message}}<|im_end|>
<im_start|>user
{{prompt}}<|im_end|>
<|im_start|>assistant

```

---

## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!

![cnvrs.ai](https://pbs.twimg.com/profile_images/1744049151241797632/0mIP-P9e_400x400.jpg)

[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
- create & save **Characters** with custom system prompts & temperature settings
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
- make it your own with custom **Theme colors**
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date

---

## Original Model Evaluations:

Evaluations done using mlabonne's [Colab notebook llm-autoeval](https://github.com/mlabonne/llm-autoeval).
Also check out the alternative leaderboard, YALL: [Yet_Another_LLM_Leaderboard](https://huggingface.co/spaces/mlabonne/Yet_Another_LLM_Leaderboard)

|                             Model                              |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|[phi-2-orange](https://huggingface.co/rhysjones/phi-2-orange)|  **33.37**|  71.33|      49.87|   **37.3**|  **47.97**|
|[phi-2-dpo](https://huggingface.co/lxuechen/phi-2-dpo)|  30.39|  **71.68**|     **50.75**|    34.9|  46.93|
|[dolphin-2_6-phi-2](https://huggingface.co/cognitivecomputations/dolphin-2_6-phi-2)|  33.12|  69.85|     47.39|    37.2|  46.89|
|[phi-2](https://huggingface.co/microsoft/phi-2)|  27.98|   70.8|     44.43|   35.21|  44.61|

{"language": ["en"], "license": "mit", "tags": ["phi-msft"], "datasets": ["Open-Orca/SlimOrca-Dedup", "migtissera/Synthia-v1.3", "LDJnr/Verified-Camel", "LDJnr/Pure-Dove", "LDJnr/Capybara", "meta-math/MetaMathQA", "Intel/orca_dpo_pairs", "argilla/ultrafeedback-binarized-preferences-cleaned"], "model_name": "Phi-2 Orange", "base_model": "rhysjones/phi-2-orange", "inference": false, "model_creator": "rhysjones", "model_type": "phi-msft", "pipeline_tag": "text-generation", "prompt_template": "<|im_start|>system\n{system_message}<|im_end|>\n<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n", "quantized_by": "brittlewis12"}
gguf phi-msft text-generation en dataset:Open-Orca/SlimOrca-Dedup dataset:migtissera/Synthia-v1.3 dataset:LDJnr/Verified-Camel dataset:LDJnr/Pure-Dove dataset:LDJnr/Capybara dataset:meta-math/MetaMathQA dataset:Intel/orca_dpo_pairs dataset:argilla/ultrafeedback-binarized-preferences-cleaned base_model:rhysjones/phi-2-orange license:mit region:us