afrideva commited on
Commit
276122b
1 Parent(s): 198be87

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +75 -0
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Felladrin/llama2_xs_460M_experimental_evol_instruct
3
+ datasets:
4
+ - KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
5
+ inference: false
6
+ model_creator: Felladrin
7
+ model_name: llama2_xs_460M_experimental_evol_instruct
8
+ pipeline_tag: text-generation
9
+ quantized_by: afrideva
10
+ tags:
11
+ - autotrain
12
+ - text-generation
13
+ - gguf
14
+ - ggml
15
+ - quantized
16
+ - q2_k
17
+ - q3_k_m
18
+ - q4_k_m
19
+ - q5_k_m
20
+ - q6_k
21
+ - q8_0
22
+ widget:
23
+ - text: '### Instruction:
24
+
25
+ Find me a list of some nice places to visit around the world.
26
+
27
+
28
+ ### Response:'
29
+ - text: '### Instruction:
30
+
31
+ Tell me all you know about the Earth.
32
+
33
+
34
+ ### Response:'
35
+ ---
36
+ # Felladrin/llama2_xs_460M_experimental_evol_instruct-GGUF
37
+
38
+ Quantized GGUF model files for [llama2_xs_460M_experimental_evol_instruct](https://huggingface.co/Felladrin/llama2_xs_460M_experimental_evol_instruct) from [Felladrin](https://huggingface.co/Felladrin)
39
+
40
+
41
+ | Name | Quant method | Size |
42
+ | ---- | ---- | ---- |
43
+ | [llama2_xs_460m_experimental_evol_instruct.q2_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q2_k.gguf) | q2_k | None |
44
+ | [llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q3_k_m.gguf) | q3_k_m | None |
45
+ | [llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q4_k_m.gguf) | q4_k_m | None |
46
+ | [llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q5_k_m.gguf) | q5_k_m | None |
47
+ | [llama2_xs_460m_experimental_evol_instruct.q6_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q6_k.gguf) | q6_k | None |
48
+ | [llama2_xs_460m_experimental_evol_instruct.q8_0.gguf](https://huggingface.co/afrideva/llama2_xs_460M_experimental_evol_instruct-GGUF/resolve/main/llama2_xs_460m_experimental_evol_instruct.q8_0.gguf) | q8_0 | None |
49
+
50
+
51
+
52
+ ## Original Model Card:
53
+ # ahxt's llama2_xs_460M_experimental trained on the WizardLM's Evol Instruct dataset using AutoTrain
54
+
55
+ - Base model: [ahxt/llama2_xs_460M_experimental](https://huggingface.co/ahxt/llama2_xs_460M_experimental)
56
+ - Dataset: [KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format](https://huggingface.co/datasets/KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format)
57
+ - Training: 13.5h under [these parameters](https://huggingface.co/Felladrin/llama2_xs_460M_experimental_evol_instruct/blob/cc151c5669ea37c3ef972e375c74f2d9bfd92b49/training_params.json)
58
+
59
+ ## Recommended Prompt Format
60
+
61
+ ```
62
+ ### Instruction:
63
+ <instruction>
64
+
65
+ ### Response:
66
+ ```
67
+
68
+ ## Recommended Inference Parameters
69
+
70
+ ```yml
71
+ repetition_penalty: 1.15
72
+ do_sample: true
73
+ temperature: 0.5
74
+ top_p: 0.5
75
+ ```