Spaces:

as-cle-bert
/

bloom-multilingual-chat

Sleeping

bloom-multilingual-chat / load_model.py

Update load_model.py

2c4e93b verified about 1 month ago

No virus

342 Bytes

	from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline

	model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen1.5-1.8B-Chat")
	tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen1.5-1.8B-Chat")

	pipe = pipeline("text-generation", model=model, tokenizer=tokenizer, max_new_tokens=1024, repetition_penalty=1.2, temperature=0.4)