File size: 609 Bytes
8b4ef05 f021684 8b4ef05 f021684 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
-license: other
-license_name: microsoft-research-license
-license_link: https://huggingface.co/microsoft/phi-2/resolve/main/LICENSE
---
# LM-cocktail phi-2 v1
This is a 50%-50% model of the phi2 alpca gpt4 and phi2 ultrachat200K models.
https://huggingface.co/Yhyu13/phi-2-sft-alpaca_gpt4_en-ep1
https://huggingface.co/venkycs/phi-2-ultrachat200k
# Code
The LM-cocktail is novel technique for merging multiple models https://arxiv.org/abs/2311.13534
Code is backed up by this repo https://github.com/FlagOpen/FlagEmbedding.git
Merging scripts available under the [./scripts](./scripts) folder
|