Svngoku commited on
Commit
eb9e48d
1 Parent(s): 78bcd1c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -4
README.md CHANGED
@@ -1,6 +1,14 @@
1
  ---
2
  language:
3
  - en
 
 
 
 
 
 
 
 
4
  license: apache-2.0
5
  tags:
6
  - text-generation-inference
@@ -9,14 +17,42 @@ tags:
9
  - llama
10
  - trl
11
  base_model: unsloth/llama-3-8b-bnb-4bit
 
 
 
 
 
12
  ---
13
 
14
- # Uploaded model
 
 
 
 
15
 
16
  - **Developed by:** vutuka
17
  - **License:** apache-2.0
18
- - **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
  language:
3
  - en
4
+ - fr
5
+ - yo
6
+ - pt
7
+ - sw
8
+ - zu
9
+ - ar
10
+ - af
11
+ - ig
12
  license: apache-2.0
13
  tags:
14
  - text-generation-inference
 
17
  - llama
18
  - trl
19
  base_model: unsloth/llama-3-8b-bnb-4bit
20
+ fine_tuned: vutuka/llama-3-8b-african-alpaca-4bit
21
+ datasets:
22
+ - vutuka/aya_african_alpaca
23
+ metrics:
24
+ - accuracy
25
  ---
26
 
27
+ # Model Description
28
+
29
+ This model is an innovative multi-language text-generation model that expands on the capabilities of its base, incorporating knowledge and nuances from a variety of African languages. It is a step forward in making AI accessible and effective in processing and generating text in languages that have been historically underrepresented in data-driven technologies.
30
+
31
+ # Uploaded Model Details
32
 
33
  - **Developed by:** vutuka
34
  - **License:** apache-2.0
35
+ - **Base model:** unsloth/llama-3-8b-bnb-4bit
36
+ - **Fine-tuned model:** vutuka/llama-3-8b-african-alpaca-4bit
37
+ - **Dataset used for fine-tuning:** vutuka/aya_african_alpaca
38
+ - **Intended use:** The model is intended for text generation tasks where understanding and generating African languages is crucial. It can serve as a tool for researchers, developers, and linguists working on African language processing.
39
+
40
+ # Training Procedure
41
+
42
+ This llama model was trained using Unsloth's accelerated training techniques, achieving speeds up to 2x faster than conventional methods. Leveraging the capabilities of Huggingface's Transformers Reinforcement Learning (TRL) library, the model fine-tuning was optimized for both efficiency and performance.
43
+
44
+ # Performance and Metrics
45
+
46
+ The model's performance has been evaluated using accuracy as a key metric. Further details on evaluation and metrics are forthcoming as the model is put into practice and gains usage in diverse scenarios.
47
+
48
+ # How to Use
49
+
50
+ This model is compatible with Huggingface's Transformers library and can be used for various text generation tasks. Detailed instructions on how to implement and utilize this model will be provided, ensuring users can fully leverage its potential.
51
+
52
+ # Acknowledgments
53
+
54
+ We would like to acknowledge the contributors of the Unsloth project and the maintainers of the Huggingface's Transformers library for their tools that made this advancement possible. Special thanks to the community for providing the dataset and contributing to the fine-tuning process.
55
 
56
+ # Disclaimer
57
 
58
+ This model is released under the apache-2.0 license, which includes a limitation of liability. While the model has been fine-tuned to generate text in multiple African languages, users should be aware of the potential for biases inherent in any language model, and exercise caution in its application.