afrideva commited on
Commit
b50aa32
1 Parent(s): 836cde9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +92 -0
README.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2
3
+ datasets:
4
+ - hiyouga/glaive-function-calling-v2-sharegpt
5
+ - NickyNicky/function-calling_chatml_gemma_v1
6
+ inference: false
7
+ language:
8
+ - en
9
+ library_name: transformers
10
+ license: apache-2.0
11
+ model:
12
+ - google/gemma-1.1-2b-it
13
+ model_creator: NickyNicky
14
+ model_name: gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2
15
+ pipeline_tag: text-generation
16
+ quantized_by: afrideva
17
+ tags:
18
+ - gguf
19
+ - ggml
20
+ - quantized
21
+ - q2_k
22
+ - q3_k_m
23
+ - q4_k_m
24
+ - q5_k_m
25
+ - q6_k
26
+ - q8_0
27
+ widget:
28
+ - text: '<bos><start_of_turn>system
29
+
30
+ You are a helpful AI assistant.<end_of_turn>
31
+
32
+ <start_of_turn>user
33
+
34
+ {question}<end_of_turn>
35
+
36
+ <start_of_turn>model
37
+
38
+ '
39
+ ---
40
+ # NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF
41
+
42
+ Quantized GGUF model files for [gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2](https://huggingface.co/NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2) from [NickyNicky](https://huggingface.co/NickyNicky)
43
+
44
+
45
+ | Name | Quant method | Size |
46
+ | ---- | ---- | ---- |
47
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.fp16.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.fp16.gguf) | fp16 | 5.02 GB |
48
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q2_k.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q2_k.gguf) | q2_k | 1.16 GB |
49
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q3_k_m.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q3_k_m.gguf) | q3_k_m | 1.38 GB |
50
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q4_k_m.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q4_k_m.gguf) | q4_k_m | 1.63 GB |
51
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q5_k_m.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q5_k_m.gguf) | q5_k_m | 1.84 GB |
52
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q6_k.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q6_k.gguf) | q6_k | 2.06 GB |
53
+ | [gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q8_0.gguf](https://huggingface.co/afrideva/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF/resolve/main/gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q8_0.gguf) | q8_0 | 2.67 GB |
54
+
55
+
56
+
57
+ ## Original Model Card:
58
+ <p align="center">
59
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/Ds-Nf-6VvLdpUx_l0Yiu_.png" alt="" style="width: 95%; max-height: 750px;">
60
+ </p>
61
+
62
+
63
+
64
+ ## Metrics.
65
+
66
+ <p align="center">
67
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/clMqtJvaKZQ3y4sCdxHNC.png" alt="" style="width: 95%; max-height: 750px;">
68
+ </p>
69
+
70
+ <p align="center">
71
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/641b435ba5f876fe30c5ae0a/jd63fRtz2fCs9AxYKTsaP.png" alt="" style="width: 95%; max-height: 750px;">
72
+ </p>
73
+
74
+
75
+ ```
76
+ interrupted execution no TrainOutput
77
+ ```
78
+
79
+ ## Take dataset.
80
+ ```
81
+ hiyouga/glaive-function-calling-v2-sharegpt
82
+ ```
83
+
84
+ ## Dataset format gemma fine tune.
85
+ ```
86
+ NickyNicky/function-calling_chatml_gemma_v1
87
+ ```
88
+
89
+ ## colab examples and Gradio.
90
+ ```
91
+ https://colab.research.google.com/drive/1an2D2C3VNs32UV9kWlXEPJjio0uJN6nW?usp=sharing
92
+ ```