mmnga
/

Mixtral-Fusion-4x7B-Instruct-v0.1

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

Mixtral-Fusion-4x7B-Instruct-v0.1 / notebook

2 contributors

History: 3 commits

mmnga's picture

Fixed merge method to slerp. Suggestion from @BlueNipples

051ea46 11 months ago

convert_mixtral_8x7b_to_4x7b.ipynb

338 kB

Fixed merge method to slerp. Suggestion from @BlueNipples 11 months ago