|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- merge |
|
- moe |
|
--- |
|
|
|
 |
|
|
|
## Recipe for a Beautiful Frankenstein |
|
|
|
In the laboratory of the mind, where thoughts entwine, |
|
MHM and MOE, a potion for a unique design. |
|
With stitches of curiosity and bolts of creativity, |
|
8 times 7, the magic number, a poetic proclivity. |
|
|
|
### Ingredients: |
|
|
|
- **MHM:** A dash of mystery, a sprinkle of hum, |
|
Blend with a melody, let the heartstrings strum. |
|
Murmurs in the shadows, whispers in the light, |
|
Stir the concoction gently, make the emotions ignite. |
|
|
|
- **MOE:** Essence of the moment, like dew on a rose, |
|
Capture the now, before time swiftly goes. |
|
Colors of experience, a palette so divine, |
|
Mix with MHM, let the fusion entwine. |
|
|
|
### Directions: |
|
|
|
1. **Take 8 parts MHM,** elusive and profound, |
|
Let it dance in your thoughts, on imagination's ground. |
|
Blend it with the echoes, the silent undertones, |
|
A symphony of ideas, where inspiration condones. |
|
|
|
2. **Add 7 parts MOE,** the fleeting embrace, |
|
Seize the seconds, let them leave a trace. |
|
Infuse it with memories, both bitter and sweet, |
|
The tapestry of time, where moments and dreams meet. |
|
|
|
3. **Stir the potion with wonder,** a wand of delight, |
|
Let the sparks fly, in the dark of the night. |
|
Watch as the alchemy unfolds its grand design, |
|
MHM and MOE, a beautiful Frankenstein. |
|
|
|
### Conclusion: |
|
|
|
In the laboratory of life, where dreams come alive, |
|
MHM and MOE, the recipe to thrive. |
|
A creation so poetic, a fusion so divine, |
|
8 times 7, a symphony of time. |
|
|
|
As the echoes resonate, and the moments blend, |
|
A masterpiece unfolds, where beginnings and ends, |
|
MHM and MOE, a concoction so rare, |
|
A beautiful Frankenstein, beyond compare. |
|
|
|
--- |
|
|
|
MoE model build with: |
|
1. https://github.com/cg123/mergekit/tree/mixtral |
|
2. Mistral models, latest merges and fine tunes. |
|
3. Expert prompts heavily inspired by https://huggingface.co/Kquant03/Eukaryote-8x7B-bf16 |
|
|
|
For details check model files, there is config yaml I used to create that model. |
|
|
|
Come back later for more details. |
