Model save

README.md

@@ -6,14 +6,10 @@ tags:
 - generated_from_trainer
 base_model: NousResearch/Llama-2-7b-chat-hf
 datasets:
-- Thimira/sinhala-llama-2-data-format
+- generator
 model-index:
 - name: sinhala-llama-2-7b-chat-hf
   results: []
-license: llama2
-language:
-- si
-pipeline_tag: text-generation
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -21,34 +17,15 @@ should probably proofread and complete it, then remove this comment. -->
 
 # sinhala-llama-2-7b-chat-hf
 
-This model is a fine-tuned version of [NousResearch/Llama-2-7b-chat-hf](https://huggingface.co/NousResearch/Llama-2-7b-chat-hf) on the [Thimira/sinhala-llama-2-data-format](https://huggingface.co/datasets/Thimira/sinhala-llama-2-data-format) dataset.
+This model is a fine-tuned version of [NousResearch/Llama-2-7b-chat-hf](https://huggingface.co/NousResearch/Llama-2-7b-chat-hf) on the generator dataset.
 
 ## Model description
 
-This is a model for Sinhala language text generation which is fine-tuned from the base llama-2-7b-chat-hf model.
-
-Currently the capabilities of themodel are extremely limited, and requires further data and fine-tuning to be useful. Feel free to experiment with the model and provide feedback.
-
-### Usage example
-
-```python
-from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
-
-tokenizer = AutoTokenizer.from_pretrained("Thimira/sinhala-llama-2-7b-chat-hf")
-model = AutoModelForCausalLM.from_pretrained("Thimira/sinhala-llama-2-7b-chat-hf")
-
-pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, max_length=200)
-
-prompt = "ඔබට සිංහල භාෂාව තේරුම් ගත හැකිද?"
-result = pipe(f"<s>[INST] {prompt} [/INST]")
-print(result[0]['generated_text'])
-```
+More information needed
 
 ## Intended uses & limitations
 
-The Sinhala-LLaMA models are intended for assistant-like chat in the Sinhala language.
-
-To get the expected features and performance from these models the LLaMA 2 prompt format needs to be followed, including the INST and <<SYS>> tags, BOS and EOS tokens, and the whitespaces and breaklines in between.
+More information needed
 
 ## Training and evaluation data
 
@@ -60,7 +37,7 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- train_batch_size: 4
+- train_batch_size: 2
 - eval_batch_size: 8
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -75,7 +52,7 @@ The following hyperparameters were used during training:
 ### Framework versions
 
 - PEFT 0.10.0
-- Transformers 4.40.1
+- Transformers 4.40.2
 - Pytorch 2.1.0
-- Datasets 2.19.0
+- Datasets 2.19.1
 - Tokenizers 0.19.1

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e90cbcf564e54725c8dc2e088a479206b263fa9801a55263bda7df8562d0785a
+oid sha256:7264f40b51910e4c47ecce13c2530a9e7a1faeeee8d5685b6881ec52606f0bd4
 size 67126232

runs/May07_02-54-21_ip-172-16-10-61.ec2.internal/events.out.tfevents.1715050518.ip-172-16-10-61.ec2.internal.5778.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8803d1f0ef7c52df9ffc81898db97129ba6d55ff849643644116487c04635f0f
-size 106347
+oid sha256:f67ff967b4cd3037514c118e98241cd7b1caabd25ebe551f2a531e57d806d6b7
+size 106701