0xtaipoian
/

open-lilm

Text Generation

Generated from Trainer

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

0xtaipoian commited on 6 days ago

Commit

e4792ff

•

1 Parent(s): 768c5a5

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -59,7 +59,6 @@ bnb_config = BitsAndBytesConfig(
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = AutoModelForCausalLM.from_pretrained(
   model_name,
-  revision="main", #qlora-merged (qLoRA finetuned for 3 epochs) or main (full parameter finetune for 1 epoch)
   torch_dtype=torch.bfloat16,
   trust_remote_code=True,
   quantization_config=bnb_config,

 tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = AutoModelForCausalLM.from_pretrained(
   model_name,
   torch_dtype=torch.bfloat16,
   trust_remote_code=True,
   quantization_config=bnb_config,