duyntnet commited on
Commit
f18eed0
1 Parent(s): 86e6979

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ inference: false
7
+ tags:
8
+ - transformers
9
+ - gguf
10
+ - imatrix
11
+ - Phi-SoSerious-Mini-V1
12
+ ---
13
+ Quantizations of https://huggingface.co/concedo/Phi-SoSerious-Mini-V1
14
+
15
+
16
+ # From original readme
17
+
18
+ ## Phi-SoSerious-Mini-V1
19
+ </div>
20
+
21
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63cd4b6d1c8a5d1d7d76a778/eKsJlyzm30gxwAM-doIC-.png)
22
+
23
+ ## Let's put a smile on that face!
24
+
25
+ This is a finetune of https://huggingface.co/microsoft/Phi-3-mini-4k-instruct trained on a variant of the Kobble Dataset.
26
+ Training was done in under 4 hours on a single Nvidia RTX 3090 GPU with qLora (LR 1.2e-4, rank 16, alpha 16, batch size 3, gradient acc. 3, 2048 ctx).
27
+
28
+ You can obtain the GGUF quantization of this model here: https://huggingface.co/concedo/Phi-SoSerious-Mini-V1-GGUF
29
+
30
+ ## Dataset and Objectives
31
+
32
+ The Kobble Dataset is a semi-private aggregated dataset made from multiple online sources and web scrapes, augmented with some synthetic data.
33
+ It contains content chosen and formatted specifically to work with KoboldAI software and Kobold Lite.
34
+ The objective of this model was to produce a usable version of Phi-3-mini usable for storywriting, conversations and instructions, and without excess tendency for refusal.
35
+
36
+ #### Dataset Categories:
37
+ - Instruct: Single turn instruct examples presented in the Alpaca format, with an emphasis on uncensored and unrestricted responses.
38
+ - Chat: Two participant roleplay conversation logs in a multi-turn raw chat format that KoboldAI uses.
39
+ - Story: Unstructured fiction excerpts, including literature containing various erotic and provocative content.
40
+
41
+ <!-- prompt-template start -->
42
+ ## Prompt template: Alpaca
43
+
44
+ ```
45
+ ### Instruction:
46
+ {prompt}
47
+
48
+ ### Response:
49
+ ```
50
+
51
+ <!-- prompt-template end -->