nayohan
/

llama3-8b-it-translation-tech-en-ko-1sent

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

nayohan commited on Apr 26

Commit

e476f20

•

1 Parent(s): 42241bf

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -31,7 +31,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_name)
 model = AutoModelForCausalLM.from_pretrained(
   model_name,
   device_map="auto",
-  torch_dtype=torch.float16
 )
 ```

 model = AutoModelForCausalLM.from_pretrained(
   model_name,
   device_map="auto",
+  torch_dtype=torch.bfloat16
 )
 ```