alfredplpl
/

gemma-2b-it-ja-poc

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

alfredplpl commited on Feb 27

Commit

0ef027f

•

1 Parent(s): b1ea80e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ tokenizer = AutoTokenizer.from_pretrained(
 model = AutoModelForCausalLM.from_pretrained(
 "alfredplpl/gemma-2b-it-ja-poc",
     device_map="cuda:0",
-    torch_dtype=torch.float16
 )
 # プロンプトの準備

 model = AutoModelForCausalLM.from_pretrained(
 "alfredplpl/gemma-2b-it-ja-poc",
     device_map="cuda:0",
+    torch_dtype=torch.bfloat16
 )
 # プロンプトの準備