tokyotech-llm
/

Swallow-MS-7b-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Taishi-N324 commited on Mar 11

Commit

80be236

•

1 Parent(s): cc0a0ae

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -95,6 +95,7 @@ pip install -r requirements.txt
 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
 model_name = "tokyotech-llm/Swallow-MS-7b-v0.1"
 tokenizer = AutoTokenizer.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")

 ```python
 from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
 model_name = "tokyotech-llm/Swallow-MS-7b-v0.1"
 tokenizer = AutoTokenizer.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto")