922CA commited on
Commit
ab3205e
1 Parent(s): a615ae5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -8
README.md CHANGED
@@ -1,26 +1,42 @@
1
  ---
2
  language:
3
  - en
4
- license: apache-2.0
5
  tags:
6
  - text-generation-inference
7
  - transformers
8
  - unsloth
9
  - llama
10
- - trl
11
  base_model: unsloth/llama-3-8b-bnb-4bit
 
 
12
  ---
 
 
 
 
13
 
14
- Testing...
 
15
 
16
- Use "\nHuman: INPUT\nAssistant:" format.
17
 
18
- # Uploaded model
19
 
20
- - **Developed by:** 922-Narra
21
- - **License:** apache-2.0
22
- - **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit
 
 
 
 
23
 
24
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
25
 
26
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
1
  ---
2
  language:
3
  - en
4
+ license: llama3
5
  tags:
6
  - text-generation-inference
7
  - transformers
8
  - unsloth
9
  - llama
10
+ - gguf
11
  base_model: unsloth/llama-3-8b-bnb-4bit
12
+ datasets:
13
+ - 922-Narra/tagaloguanaco_cleaned_03152024
14
  ---
15
+ # Llama-3-8b-tagalog-v1:
16
+ * Test model fine-tuned on [this dataset](https://huggingface.co/datasets/922-Narra/tagaloguanaco_cleaned_03152024)
17
+ * Base: LLaMA-3 8b
18
+ * [GGUFs](https://huggingface.co/922-Narra/Llama-3-8b-tagalog-v1)
19
 
20
+ ### USAGE
21
+ This is meant to be mainly a chat model.
22
 
23
+ Use "Human" and "Assistant" and prompt with Tagalog:
24
 
25
+ "\nHuman: INPUT\nAssistant:"
26
 
27
+ ### HYPERPARAMS
28
+ * Trained for 1 epochs
29
+ * rank: 32
30
+ * lora alpha: 32
31
+ * lr: 2e-4
32
+ * batch size: 2
33
+ * grad steps: 4
34
 
35
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
36
 
37
  [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
38
+
39
+ ### WARNINGS AND DISCLAIMERS
40
+ Note that there is a chance that the model may switch back to English (albeit still understand Tagalog inputs) or output clunky results.
41
+
42
+ Finally, this model is not guaranteed to output aligned or safe outputs nor is it meant for production use - use at your own risk!