jwnder
/

core42_jais-30b-chat-v3-bnb-4bit

Text Generation

4-bit precision

Model card Files Files and versions Community

jwnder commited on Apr 7

Commit

c479298

•

1 Parent(s): c7d89e0

Update README.md

Files changed (1) hide show

README.md +0 -2

README.md CHANGED Viewed

@@ -27,9 +27,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_input_folder, trust_remote_code=
 model = AutoModelForCausalLM.from_pretrained(model_input_folder, trust_remote_code=True)
 inputs = tokenizer("Testing LLM!", return_tensors="pt")
-start = datetime.now()
 outputs = model.generate(**inputs)
-end = datetime.now()
 print(tokenizer.batch_decode(outputs, skip_special_tokens=True))
 ```

 model = AutoModelForCausalLM.from_pretrained(model_input_folder, trust_remote_code=True)
 inputs = tokenizer("Testing LLM!", return_tensors="pt")
 outputs = model.generate(**inputs)
 print(tokenizer.batch_decode(outputs, skip_special_tokens=True))
 ```