BangorAI
/

ALMA-Cymraeg-13B-0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

rhysjones commited on Nov 27, 2023

Commit

dbe0f13

·

1 Parent(s): dab5ba3

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -38,8 +38,8 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
 device = "cuda"
-model = AutoModelForCausalLM.from_pretrained("./trosi13b", torch_dtype=torch.float16, load_in_8bit=True)
-tokenizer = AutoTokenizer.from_pretrained("./trosi13b")
 prompt = """Cyfieithwch y testun Saesneg canlynol i'r Gymraeg.
 ### Saesneg:

 device = "cuda"
+model = AutoModelForCausalLM.from_pretrained("BangorAI/ALMA-Cymraeg-13B-0.1", torch_dtype=torch.float16, load_in_8bit=True)
+tokenizer = AutoTokenizer.from_pretrained("BangorAI/ALMA-Cymraeg-13B-0.1")
 prompt = """Cyfieithwch y testun Saesneg canlynol i'r Gymraeg.
 ### Saesneg: