mmnga
/

Mixtral-Fusion-4x7B-Instruct-v0.1

Text Generation

Mixture of Experts

text-generation-inference

Model card Files Files and versions Community

Mixtral-Fusion-4x7B-Instruct-v0.1 / notebook /convert_mixtral_8x7b_to_4x7b.ipynb

Commit History

Fixed merge method to slerp. Suggestion from @BlueNipples

051ea46

mmnga commited on Dec 22, 2023

Update notebook/convert_mixtral_8x7b_to_4x7b.ipynb

6a95de8

mmnga commited on Dec 17, 2023

Upload convert_mixtral_8x7b_to_4x7b.ipynb

215ebc4

mmnga commited on Dec 16, 2023