
# LM-cocktail phi-2 v1


This is a 50%-50% model of the phi2 alpca gpt4 and phi2 ultrachat200K models.

https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1

https://huggingface.co/venkycs/phi-2-ultrachat200k



# Code

The LM-cocktail is novel technique for merging multiple models https://arxiv.org/abs/2311.13534

Code is backed up by this repo https://github.com/FlagOpen/FlagEmbedding.git

Merging scripts available under the [./scripts](./scripts) folder

{"-license": "other", "-license_name": "microsoft-research-license", "-license_link": "https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE"}
transformers safetensors phi-msft text-generation custom_code arxiv:2311.13534 autotrain_compatible endpoints_compatible region:us