cognitivecomputations

/

dolphin-2.6-mixtral-8x7b

like 181

Dataset

What exactly is the difference between 2.5 and 2.6?

Removal of Synthia-v1.3 and Pure-Dove datasets, and the addition of Capybara and some Samantha data. In addition, according to his twitter post, the gate layer was frozen for fine-tuning this time.