--- license: cc-by-nc-4.0 library_name: transformers tags: - mergekit - merge - alpaca - mistral --- # IceBlendedLatteRP-7b This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using G:\FModels\Mistroll-7B-v2.2 as a base. ### Models Merged The following models were included in the merge: * G:\FModels\IceCaffeLatteRP-7b ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: G:\FModels\Mistroll-7B-v2.2 dtype: bfloat16 merge_method: task_arithmetic slices: - sources: - layer_range: [0, 32] model: G:\FModels\Mistroll-7B-v2.2 - layer_range: [0, 32] model: G:\FModels\IceCaffeLatteRP-7b parameters: weight: 1.00 ```