--- license: cc-by-sa-4.0 base_model: - chargoddard/piano-medley-7b - senseable/WestLake-7B-v2 tags: - mergekit - merge --- # merged This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the task_anysize merge method using [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) as a base. ### Models Merged The following models were included in the merge: * [chargoddard/piano-medley-7b](https://huggingface.co/chargoddard/piano-medley-7b) ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: model: path: senseable/WestLake-7B-v2 dtype: bfloat16 merge_method: task_anysize slices: - sources: - layer_range: [0, 32] model: model: path: chargoddard/piano-medley-7b parameters: weight: 0.55 - layer_range: [0, 32] model: model: path: senseable/WestLake-7B-v2 ```