grimjim/kuno-kunoichi-v1-DPO-v2-SLERP-7B

Text Generation • Updated May 10 • 81 • 3

Note I liked both versions, so this was literally a compromise merge.

grimjim/kukulemon-7B

Text Generation • Updated Mar 21 • 85 • 10

Note Successful merge of kunoichi models with a roleplay model.

grimjim/kukulemon-spiked-9B

Text Generation • Updated Apr 27 • 20 • 3

Note Somewhat successful frankenmerge. No fine-tune healing applied.

grimjim/kukulemon-32K-7B

Text Generation • Updated Apr 27 • 20 • 1

Note Brought in 32k context from Mistral v0.2.

grimjim/kunoichi-lemon-royale-7B

Text Generation • Updated Mar 29 • 82 • 2

Note Attempt to improve model intelligence by adding a high benchmark model to the formula.

grimjim/kunoichi-lemon-royale-v2-32K-7B

Text Generation • Updated May 13 • 50 • 5

Note Brought in 32k context from Mistral v0.2.

grimjim/Mistral-7B-Instruct-demi-merge-v0.2-7B

Text Generation • Updated Mar 26 • 83 • 1

Note Blended base and instruct for Mistral v0.2 for use in future merges.

grimjim/fireblossom-32K-7B

Text Generation • Updated Apr 15 • 19 • 2

Note Partial success at infusing more creativity.

grimjim/zephyr-beta-wizardLM-2-merge-7B

Text Generation • Updated Apr 17 • 56 • 1

Note Merge attempt to harness the capabilities of the contributing models.

grimjim/Mistral-Starling-merge-trial1-7B

Text Generation • Updated Mar 29 • 77

Note A test. Feel free to skip.

grimjim/Mistral-Starling-merge-trial3-7B

Text Generation • Updated Mar 29 • 74

Note A more successful test than trial1.

grimjim/zephyr-wizard-kuno-royale-BF16-merge-7B

Text Generation • Updated May 15 • 45 • 1

Note An attempt to improve model intelligence by merging in a higher benchmarked model.

grimjim/llama-3-experiment-v1-9B

Text Generation • Updated Apr 30 • 20 • 4

Note Benchmarks were for the most part unaffected by the addition of early middle layers; no fine-tuning was needed to heal damage the model.

grimjim/madwind-wizard-7B

Text Generation • Updated May 18 • 20 • 4

Note Model intelligence was slightly damaged by the merge, but creativity is high.

grimjim/llama-3-merge-pp-instruct-8B

Text Generation • Updated Jun 19 • 82

Note Merged back into Instruct to see what would happen.

grimjim/llama-3-merge-virt-req-8B

Text Generation • Updated May 8 • 85 • 2

Note A requested merge.

grimjim/kukuspice-7B

Text Generation • Updated May 10 • 13

Note Experiment. Limited success.

grimjim/cuckoo-starling-32k-7B

Text Generation • Updated May 23 • 19 • 2

Note Fairly creative model.

grimjim/rogue-enchantress-32k-7B

Text Generation • Updated May 22 • 23 • 8

Note Highly creative model, albeit a bit damaged. Could probably be repaired with a bit of fine-tuning.

grimjim/Mistral-7B-Instruct-demi-merge-v0.3-7B

Text Generation • Updated May 24 • 11

Note Merge of base and instruct versions of Mistral v0.3. Unremarkable, unfortunately.

grimjim/kunoichi-lemon-royale-v3-32K-7B

Text Generation • Updated May 29 • 50 • 4

Note Creativity was enhanced at some cost to format adherence.

grimjim/koboldai-erebus-extended-32k-7B

Text Generation • Updated May 30 • 22 • 4

Note Attempt to merge in 32k context from Mistral v0.2.

grimjim/koboldai-holodeck-extended-32k-7B

Text Generation • Updated Aug 26 • 11 • 2

Note Attempt to merge in 32k context from Mistral v0.2.

grimjim/kukulemon-v3-soul_mix-32k-7B

Text Generation • Updated Jun 1 • 19 • 4

Note Enhanced creativity with only minor harm to the ability to follow format.

grimjim/Llama-3-Luminurse-v0.1-OAS-8B

Text Generation • Updated Jun 19 • 19 • 3

Note The contribution of the biomedical model appears to have improved the intelligence of the resulting merge.

grimjim/Llama-3-Oasis-v1-OAS-8B

Text Generation • Updated Jun 19 • 93 • 4

Note A merger of 3 models, all of which were effectively decensored by having refusal pathways ablated away.

grimjim/Llama-3-Steerpike-v1-OAS-8B

Text Generation • Updated Jun 19 • 16 • 1

Note Imperfect model, but interesting.

grimjim/Llama-3-Luminurse-v0.2-OAS-8B

Text Generation • Updated Jun 19 • 154 • 6

Note Further refinement of the Luminurse merge formula by incorporating another model specifically trained for consistency in following format when generating output.

grimjim/llama-3-Nephilim-v1-8B

Text Generation • Updated Jul 25 • 75 • 1

Note The contribution of an offensive/defensive cybersecurity model (does that make it cyberwarfare model?) dramatically increased the creativity of the base model despite the low contributing weight.

grimjim/llama-3-Nephilim-v2-8B

Text Generation • Updated Sep 19 • 25 • 1

Note Added contributions from two SOTA preference optimization models as well as a highly-trained roleplay model and a biomedical model.

grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge

Text Generation • Updated Sep 17 • 4.86k • 2

Note Merge of two PO models.

grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge

Text Generation • Updated Sep 18 • 2.52k • 2

Note Merge of two PO models.

grimjim/llama-3-Nephilim-v2.1-8B

Text Generation • Updated Sep 19 • 23 • 1

Note A modest variation from v2.

grimjim/llama-3-Nephilim-v3-8B

Text Generation • Updated Sep 3 • 303 • 12

Note This merge is one of the most coherent that I've produced.

grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter

Text Generation • Updated Sep 18 • 3.13k • 29

Note It turns out a LoRA extracted from Llama 3 can successfully be applied to Llama 3.1. It works well, apparently.

grimjim/Llama-Nephilim-Metamorphosis-v1-8B

Text Generation • Updated Oct 14 • 15 • 1

Note Proof that a Llama 3 model can be merged onto a Llama 3.1 using low weighting. It's not the best model as is, but is interesting due to its implications regarding what can be accomplished via merger.