LM-cocktail phi-2 v1

This is a 50%-50% model of the phi2 alpca gpt4 and phi2 ultrachat200K models.

https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1

https://huggingface.co/venkycs/phi-2-ultrachat200k

Code

The LM-cocktail is novel technique for merging multiple models https://arxiv.org/abs/2311.13534

Code is backed up by this repo https://github.com/FlagOpen/FlagEmbedding.git

Merging scripts available under the ./scripts folder

Downloads last month
5
Safetensors
Model size
2.78B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Yhyu13/LMCocktail-phi-2-v1

Quantizations
3 models