zhouliang commited on
Commit
5e5ebe7
1 Parent(s): 4ed88cb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -18,6 +18,10 @@ gguf:https://huggingface.co/TheBloke/deepsex-34b-GGUF
18
  exl2:https://huggingface.co/waldie/deepsex-34b-4bpw-h6-exl2
19
  awq:https://huggingface.co/TheBloke/deepsex-34b-AWQ
20
 
 
 
 
 
21
  Here are the steps to make this model:
22
  1. I first collected a total collection of about 4GB of various light novels, and used BERT to perform two rounds of similarity deduplication on the novels with similar plots in the data set. In addition, a portion of nsfw novels are mixed in to improve the NSFW capabilities of the model.
23
  2. Then use the YI-34B-base as the base of the model, use the setting of r=64 alpha=128 and use qlora to fine-tune 3 epochs for continuous pre-training.
@@ -62,6 +66,9 @@ Support me [here](https://ko-fi.com/mikolisa) :)
62
 
63
  **Deepsex-34b**
64
 
 
 
 
65
  *步骤*
66
  1. 我先收集了各种轻小说大约4GB的总集,通过bert对该数据集中剧情比较相似的小说进行了两轮相似度去重。另外混入了一部分nsfw小说以提高该模型的NSFW能力。
67
  2. 然后将该模型以YI-34B-base为基座,使用r=64 alpha=128 的设置使用qlora微调了3个epochs来进行持续预训练。
 
18
  exl2:https://huggingface.co/waldie/deepsex-34b-4bpw-h6-exl2
19
  awq:https://huggingface.co/TheBloke/deepsex-34b-AWQ
20
 
21
+ In fact, I plan to make a model of the "Seven Deadly Sins" series. Of course, the pre-training data used in these models are all human-produced data. I think the big model is like a mirror, reflecting the human itself. Examine yourself may become a crucial step in realizing agi.
22
+ So, It is 'lust'.
23
+ The 6b corresponding to the model is being produced, and the corresponding llama version is also being produced. The classification data of the other six deadly sins is being collected. Welcome to provide inspiration!
24
+
25
  Here are the steps to make this model:
26
  1. I first collected a total collection of about 4GB of various light novels, and used BERT to perform two rounds of similarity deduplication on the novels with similar plots in the data set. In addition, a portion of nsfw novels are mixed in to improve the NSFW capabilities of the model.
27
  2. Then use the YI-34B-base as the base of the model, use the setting of r=64 alpha=128 and use qlora to fine-tune 3 epochs for continuous pre-training.
 
66
 
67
  **Deepsex-34b**
68
 
69
+ 事实上,我有计划制作一个“七宗罪”系列模型。当然,这些模型所使用的预训练数据全部为人类产出的数据。我认为大模型就像一面镜子,倒映的是人类自身。审视自己或许会成为实现agi中至关重要的一步。
70
+ 该模型对应的6b正在制作,相应的llama版本的也在制作。其他六宗罪的分类数据正在收集中,欢迎大家提供灵感!
71
+
72
  *步骤*
73
  1. 我先收集了各种轻小说大约4GB的总集,通过bert对该数据集中剧情比较相似的小说进行了两轮相似度去重。另外混入了一部分nsfw小说以提高该模型的NSFW能力。
74
  2. 然后将该模型以YI-34B-base为基座,使用r=64 alpha=128 的设置使用qlora微调了3个epochs来进行持续预训练。