Any chance we can get a new version based on Mixtral 8x22?
#8
by
compwizsac
- opened
Laser-dolphin-mixtral-2x7b-dpo has been my go to model for a while now. IMO, there's nothing better in the same size range.
I'm also extremely curious how much better a version based on the 22b Mixtral MOE would be.
Any chance you'll be creating a revised version based on the new 8x22b Mixtral model?
I did not have any plans for it but that sounds like a fun idea. I’ll definitely mess around with it