How do I set the remote code to true?
#7
by
Viincentt
- opened
I am new to Language Models and confused about what to do with the code snippet provided. Where do I run the script? Thanks!
import transformers
model = transformers.AutoModelForCausalLM.from_pretrained(
'mosaicml/mpt-7b-storywriter',
trust_remote_code=True
)
How are you running your llm?
Oobabooga, kobold, or built the environment on conda?
You'll most likely wanna add that to the server.py file or webui.py,
Not entirely sure myself, let me know if it works
EDIT: see below
EDIT: see below