How is the performance of this relative to Orochi?
Just wondering if this is significantly better than orochi, or if it is about the same. I wouldn't be that surprised if orochi more or less maxes out what we are capable of doing with Mixtral as a base, but I'd like to hear from the community.
From my personal hand testing, and some help ive had from another member of the community, My impression was that It was overall better than orochi, with some of its own weird quirks. Your mileage may vary depending on your use case. But it seems to still lack behind mixtral-instruct in some ways which seems to be the struggle the community is dealing with right now (Not being able to get an overall better model than mixtral-instruct). Every fine tune, or mixture seems to keep taking something away from mixtral-instruct that it already was nearly perfect at