--- base_model: ["Sao10K/Fimbulvetr-11B-v2"] library_name: transformers tags: - mergekit - merge --- # UnFimbulvetr-20B ![](UnFimbulator.png "A Waifu that is disappointed in me with this cursed merge. ControlNet Image Source is from the original Fimbulvetr-11B-v2.") *Waifu to catch your attention* This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). NOTE: *Only tested this just for a bit. YMMV.* ## Next Day Tests... Downloaded the GGUF model that someone quantized... And... nope. No. **Do not use model.** ## Merge Details ### Merge Method This model was merged using the passthrough merge method. ### Models Merged The following models were included in the merge: * Sao10K/Fimbulvetr-11B-v2 ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - model: FimbMagic layer_range: [0, 13] - sources: - model: FimbMagic layer_range: [8, 13] - sources: - model: FimbMagic layer_range: [12, 36] - sources: - model: FimbMagic layer_range: [12, 36] - sources: - model: FimbMagic layer_range: [36, 48] - sources: - model: FimbMagic layer_range: [36, 48] merge_method: passthrough dtype: bfloat16 ``` ### Additional Notes Fimbulvetr 11B is still a very good model. This model is for extreme trailblazers who wants to test stuff! Eval results? Don't bother. Last one before I sleep: *I'm so sorry Sao10K...*