Sandiago21
/

llama-7b-hf-prompt-answering

Text Generation

decapoda-research-7b-hf

prompt answering

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Sandiago21 commited on Jun 6, 2023

Commit

6b43e2c

•

1 Parent(s): add5578

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -103,7 +103,7 @@ from transformers import GenerationConfig, LlamaTokenizer, LlamaForCausalLM
 tokenizer = LlamaTokenizer.from_pretrained("chainyo/alpaca-lora-7b")
 model = LlamaForCausalLM.from_pretrained(
-    "chainyo/alpaca-lora-7b",
     load_in_8bit=True,
     torch_dtype=torch.float16,
     device_map="auto",

 tokenizer = LlamaTokenizer.from_pretrained("chainyo/alpaca-lora-7b")
 model = LlamaForCausalLM.from_pretrained(
+    "Sandiago21/llama-7b-hf-prompt-answering",
     load_in_8bit=True,
     torch_dtype=torch.float16,
     device_map="auto",