Mrw33554432
/

bitLinear-phi-1.5

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Mrw33554432 commited on Apr 12

Commit

a18a3b8

•

1 Parent(s): 6cfb8d6

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -49,7 +49,6 @@ torch.set_default_device("cuda")
 tokenizer = AutoTokenizer.from_pretrained("microsoft/phi-1_5", trust_remote_code=True)
 model = AutoModelForCausalLM.from_pretrained("Mrw33554432/bitLinear-phi-1.5", trust_remote_code=True)
-tokenizer.pad_token = tokenizer.eos_token
 print(model)
 # Replace Linear layers with BitLinear

 tokenizer = AutoTokenizer.from_pretrained("microsoft/phi-1_5", trust_remote_code=True)
 model = AutoModelForCausalLM.from_pretrained("Mrw33554432/bitLinear-phi-1.5", trust_remote_code=True)
 print(model)
 # Replace Linear layers with BitLinear