davidkim205
/

komt-llama2-13b-v1

Text Generation

text-generation-inference

Model card Files Files and versions Community

davidkim205 commited on Sep 27, 2023

Commit

0121054

•

1 Parent(s): 63e8784

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -43,7 +43,7 @@ Refer https://github.com/davidkim205/komt
 from transformers import AutoTokenizer, AutoModelForCausalLM
 from transformers import TextStreamer, GenerationConfig
-model_name='davidkim205/komt-llama2-7b-v1'
 model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 streamer = TextStreamer(tokenizer)

 from transformers import AutoTokenizer, AutoModelForCausalLM
 from transformers import TextStreamer, GenerationConfig
+model_name='davidkim205/komt-llama2-13b-v1'
 model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
 tokenizer = AutoTokenizer.from_pretrained(model_name)
 streamer = TextStreamer(tokenizer)