MistSwallow-7b-v0.1
MistSwallow-7b-v0.1 is a merge of the following models using mergekit:
🧩 Configuration
` ``yaml models:
- model: mistralai/Mistral-7B-v0.1
no parameters necessary for base model
- model: tokyotech-llm/Swallow-MS-7b-v0.1 parameters: density: 0.5 weight: 0.5 merge_method: ties base_model: mistralai/Mistral-7B-v0.1 parameters: normalize: true dtype: bfloat16
`` `
- Downloads last month
- 0