NgaNTQ
/

VinaLLaMA_LAWQA

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

NgaNTQ commited on 15 days ago

Commit

5a5220f

•

1 Parent(s): 492b984

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -11,9 +11,9 @@ bnb_config = BitsAndBytesConfig(
     bnb_4bit_compute_dtype=torch.bfloat16
 )
-tokenizer = AutoTokenizer.from_pretrained("LuuNgoc2k2/Law-Llama-v1", add_eos_token=True, padding_side='right')
 model = AutoModelForCausalLM.from_pretrained(
-    'LuuNgoc2k2/Law-Llama-v1',
     torch_dtype=torch.bfloat16,
     quantization_config=bnb_config, # If you need
     device_map="auto",

     bnb_4bit_compute_dtype=torch.bfloat16
 )
+tokenizer = AutoTokenizer.from_pretrained("NgaNTQ/Law-Llama-v1", add_eos_token=True, padding_side='right')
 model = AutoModelForCausalLM.from_pretrained(
+    'NgaNTQ/Law-Llama-v1',
     torch_dtype=torch.bfloat16,
     quantization_config=bnb_config, # If you need
     device_map="auto",