ajibawa-2023 commited on
Commit
d2e41f3
1 Parent(s): 66fc6cc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +61 -0
README.md CHANGED
@@ -1,3 +1,64 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ datasets:
4
+ - ajibawa-2023/Code-290k-ShareGPT
5
+ - m-a-p/Code-Feedback
6
+ language:
7
+ - en
8
+ tags:
9
+ - code
10
+ - Python
11
+ - C++
12
+ - Rust
13
+ - Ruby
14
+ - Sql
15
+ - R
16
+ - Julia
17
  ---
18
+
19
+ **Code-Jamba-v0.1**
20
+
21
+ This model is trained upon my dataset [Code-290k-ShareGPT](https://huggingface.co/datasets/ajibawa-2023/Code-290k-ShareGPT) and [Code-Feedback](https://huggingface.co/datasets/m-a-p/Code-Feedback). It is finetuned on Jamba-v0.1 .
22
+ This model is very very good in Code generation is various languages such as Python, Java, JavaScript, GO, C++, Rust, Ruby, Sql, MySql, R, Julia, Haskell, etc..
23
+ This model will also generate detailed explanation/logic behind each code.
24
+ This model uses ChatML prompt format.
25
+
26
+ **Training**
27
+
28
+ Entire dataset was trained on 2 x H100 94GB. For 3 epoch, training took 162 hours. Axolotl along with DeepSpeed codebase was used for training purpose. This was trained on Jamba-v0.1 by AI21Labs.
29
+
30
+ This is a qlora model. Links for quantized models will be updated very soon.
31
+
32
+ **GPTQ, GGUF, AWQ & Exllama**
33
+
34
+ GPTQ: TBA
35
+
36
+ GGUF: TBA
37
+
38
+ AWQ: TBA
39
+
40
+ Exllama v2: TBA
41
+
42
+
43
+ **Example Prompt:**
44
+
45
+ This model uses **ChatML** prompt format.
46
+
47
+ ```
48
+ <|im_start|>system
49
+ You are a Helpful Assistant.<|im_end|>
50
+ <|im_start|>user
51
+ {prompt}<|im_end|>
52
+ <|im_start|>assistant
53
+
54
+ ```
55
+ You can modify above Prompt as per your requirement.
56
+
57
+
58
+ I want to say special Thanks to the Open Source community for helping & guiding me to better understand the AI/Model development.
59
+
60
+ Thank you for your love & support.
61
+
62
+ **Example Output**
63
+
64
+ Coming soon!