Now it's really, really official!
Can you talk about the sauce for this one?
I also see your weights are FP16, is there any inconvenience in your part when working with BF16 models? Just curious.
Can you talk about the sauce for this one?
Opus Data, a bunch more RP data, prompt adherence instructions, Health, Psychology, Anatomy, Biology data. Some private generated synthetic data. About 200k examples for 1 epoch over 0.72 and merged back over 0.72 in slerp to rebalance. (in L3 Instruct- format)
I also see your weights are FP16, is there any inconvenience in your part when working with BF16 models? Just curious.
No just what i decided to leave them in as i forgot to adjust my slerp config back to bfloat16 as i typically do.
@Lewdiculous Some stuff has been updated/changed (the name and preset links), this is the final variant of poppy_porpoise i will be working on.
Poppy!!!? :')
I wonder which animal is next...
Information updated. Thanks for the heads up!
Poppy!!!? :')
I wonder which animal is next...
Information updated. Thanks for the heads up!
Won't be for a little while before however, but i appreciate the work you do as always! I'm going back into break time mode, since I've run out of ideas atm. But I'm sure I'll get bored of taking a break quickly and be back with some new meme.
Puppy Porpoise 2.0 the Electric Boogaloo™.
I'll see you then. Keep up and good rest.