File size: 2,152 Bytes
7a9386d 5aeee76 d96d8d3 7a9386d 9623558 2f9b50a 9623558 7a9386d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 |
---
license: apache-2.0
language:
- en
tags:
- merge
- moe
---
## Recipe for a Beautiful Frankenstein
In the laboratory of the mind, where thoughts entwine,
MHM and MOE, a potion for a unique design.
With stitches of curiosity and bolts of creativity,
8 times 7, the magic number, a poetic proclivity.
### Ingredients:
- **MHM:** A dash of mystery, a sprinkle of hum,
Blend with a melody, let the heartstrings strum.
Murmurs in the shadows, whispers in the light,
Stir the concoction gently, make the emotions ignite.
- **MOE:** Essence of the moment, like dew on a rose,
Capture the now, before time swiftly goes.
Colors of experience, a palette so divine,
Mix with MHM, let the fusion entwine.
### Directions:
1. **Take 8 parts MHM,** elusive and profound,
Let it dance in your thoughts, on imagination's ground.
Blend it with the echoes, the silent undertones,
A symphony of ideas, where inspiration condones.
2. **Add 7 parts MOE,** the fleeting embrace,
Seize the seconds, let them leave a trace.
Infuse it with memories, both bitter and sweet,
The tapestry of time, where moments and dreams meet.
3. **Stir the potion with wonder,** a wand of delight,
Let the sparks fly, in the dark of the night.
Watch as the alchemy unfolds its grand design,
MHM and MOE, a beautiful Frankenstein.
### Conclusion:
In the laboratory of life, where dreams come alive,
MHM and MOE, the recipe to thrive.
A creation so poetic, a fusion so divine,
8 times 7, a symphony of time.
As the echoes resonate, and the moments blend,
A masterpiece unfolds, where beginnings and ends,
MHM and MOE, a concoction so rare,
A beautiful Frankenstein, beyond compare.
---
MoE model build with:
1. https://github.com/cg123/mergekit/tree/mixtral
2. Mistral models, latest merges and fine tunes.
3. Expert prompts heavily inspired by https://huggingface.co/Kquant03/Eukaryote-8x7B-bf16
For details check model files, there is config yaml I used to create that model.
Come back later for more details. |