Transformers
mpt
Composer
MosaicML
llm-foundry
text-generation-inference

Create config.json

#4
by marella - opened

By adding this, it will simplify the usage of this model in ctransformers:

from ctransformers import AutoModelForCausalLM

llm = AutoModelForCausalLM.from_pretrained("TheBloke/MPT-7B-Storywriter-GGML")
TheBloke changed pull request status to merged

Sign up or log in to comment