Update README.md

README.md

@@ -15,7 +15,7 @@ _This is a Welsh version of the [ALMA](https://github.com/fe1ixxu/ALMA) LLM-base
 Mae'r model LLM yn seiliedig ar Lama-2-13B, gyda hyfforddiant parhaus ar ddata Gymreig [OSCAR-2301](https://huggingface.co/datasets/oscar-corpus/OSCAR-2301) am 3 Epoch
 ac yna hyfforddiant cywrain pellach ar ddata Cofnod y Cynulliad a ddarparir gan [TechIaith](https://huggingface.co/datasets/techiaith/cofnodycynulliad_en-cy).
 
-Mae fersiwn sydd wedi ei gywasgu i 4.0bpw er mwyn llwytho mewn cof GPU o 10GB ar gael [yma](https://huggingface.co/BangorAI/ALMA-Cymraeg-13B-0.1-4.0bpw-exl2).
+Mae fersiwn cyflymach sydd wedi ei gywasgu i 4.0bpw er mwyn llwytho mewn cof GPU o 10GB ar gael [yma](https://huggingface.co/BangorAI/ALMA-Cymraeg-13B-0.1-4.0bpw-exl2).
 
 ### Fformat Sgwrs
 
@@ -34,6 +34,32 @@ Cyfieithwch y testun Saesneg canlynol i'r Gymraeg.
 #### Esiampl
 
 ```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+device = "cuda"
+
+model = AutoModelForCausalLM.from_pretrained("./trosi13b", torch_dtype=torch.float16, load_in_8bit=True)
+tokenizer = AutoTokenizer.from_pretrained("./trosi13b")
+
+prompt = """Cyfieithwch y testun Saesneg canlynol i'r Gymraeg.
+### Saesneg:
+For the first time, GPs no longer have to physically print, sign and hand a green paper prescription form to the patient or wait for it to be taken to the pharmacy. Instead, the prescription is sent electronically from the surgery via the IT system to the patient’s chosen pharmacy - even without the patient needing to visit the surgery to pick up a repeat prescription form.
+
+### Cymraeg:
+"""
+
+model_inputs = tokenizer([prompt], return_tensors="pt").to(device)
+
+generated_ids = model.generate(**model_inputs,
+                               eos_token_id=tokenizer.eos_token_id,
+                               top_k=90,
+                               top_p=1.0,
+                               temperature=0.3,
+                               repetition_penalty=1.2,
+                               max_new_tokens=500,
+                               do_sample=True)
+print(tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0])
+
 ```
 
 ## Hawlfraint