HF transformers integration

#4
by ybelkada - opened

This PR introduces the transformers integration which should be on par with: https://github.com/huggingface/transformers/pull/27942 so that any user can use Mixtral-8x7B-Instruct-v0.1 with transformers>=4.36.0 using AutoModelForCausalLM interface.
The config needs a slight modification (mistral -> mixtral) and added all safetensors weights

ybelkada changed pull request title from Upload MixtralForCausalLM to HF transformers integration
pstock changed pull request status to merged

Sign up or log in to comment