language:
- en
09/03/24 - Just rambling on about my future plans
I don't even know what to do man. So many ideas, so little money and time.
I'm practically waiting on my paycheck so I can continue training.
Current Plans
14B-Glacier-Finetune - Sure a Full Finetune would be good but that would be expensive. A LoRA maybe? The goal is to smoothen out the tensors and repair brain damage that happens after frankenmerge.
Typhon-Mixtral Finetune - I have compiled a nice dataset to further fine-tune on this merge of mine, to hopefully improve results. Unsure if I should further DPO this one too? On non-gpt4 data of course unlike current DPO pairs.
11B-Fimbulvetr-v3 - I have ideas. Unsure if it would make it that much better or if it will be a side-grade.
Claude-3 Output-based Instruct Dataset - Cool Idea maybe? It'll introduce atleast a different '-ism' compared to GPT-4 ones out there which are generic. Claude is somewhat more human-like. I do have access so this is not as big of an issue. I just need more time.
Yi Tunes - Yeah this is on the backburner for a while. I'll think on it. I've struggled with Yi-tunes in the past. Most of mine are privated.
Ignoring that, man having gauze packed into a wound hurts like hell without painkillers. My bad, old patients of mine back when I was a nursing student. You all made it look not that bad.
Anyway, here's something I've been listening to this past week. Some random music for someone who read this entire thing haha.
Hello
Initial Ramble:
Someone questioned my model naming scheme. Good question. Here's how I chose my model names.
Stheno --> 13B L2 Merge Serie ---> It all Began Here --> stolen from discord, someone's idea
Medusa --> 7B L2 Merges ---> DOA
Euryale --> 70B L2 Merge Series --> Gorgon Sisters Continuation
Zephyrus --> L1 Merge --> Sounded Cool tbh
WinterGoddess --> L2 70B Merge + Tune --> Training Run Name: (Autumn Royal, Winter something I forgot.) Decided to brainstorm some fun names. Yeah. Dont know where the Goddess part came from, but I was writing some ERP between a guy and a goddess, and the test model helped critique it, so yeah.
Why obsession over the theme of Winter? I do not know where to begin. I was sick, delirious during training break, and my brain got obsessed with the theme of winter. I stuck my head in the freezer once. I ate ice. I'm silly like that.
Fimbulvetr --> Final Winter. Represents the end of it all. My peak Solar model imo.
Frostwind --> Initally wanted something to do with Mistral + Solar, had Claude suggest Frostwind as a name. Initial plan was to train Mistral, but solar came out so I took that name instead.
Solstice --> Solar, Sun, Peak, or (Orgasm, you know?) since it was a Lewd/NSFW Instruct Dataset
Sensualize --> Had GPT4 generate me a name that is for an NSFW model. Yeah.
Older Model Names:
Nyaa --> Meow. Trained on cat assistant vibes.
Winterreise --> As above, training run for another model was named Sonata. sounded cool as fuck when i asked a model to merge Winter + Sonata.
Nyakura --> I was obsessed with cats during that time.
Venomia --> Trained over toxic datasets.
Ana -> 7B Mistral Merge + Tune --> Medusa revived, you know, that FGO Ana.
Lila --> RP with a character, obsessed with her while testing Euryale 1.5 (WinterGoddess)
Solus --> RP with a character, obsessed with her while testing Euryale 1.5 (WinterGoddess)... yeah.
Next question. What's the worst cases I've seen so far?
A traumatic arrest, a few cardiac arrests, accidents here and there. Most shifts are okay though. Some shifts are just tough but it is what it is.