RDson commited on
Commit
2539456
·
verified ·
1 Parent(s): 0265a91

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +43 -1
README.md CHANGED
@@ -4,4 +4,46 @@ pipeline_tag: text-generation
4
  base_model: RDson/CoderO1-DeepSeekR1-14B-Preview
5
  ---
6
 
7
- GGUF files of [RDson/CoderO1-DeepSeekR1-14B-Preview](https://huggingface.co/RDson/CoderO1-DeepSeekR1-14B-Preview).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  base_model: RDson/CoderO1-DeepSeekR1-14B-Preview
5
  ---
6
 
7
+ # GGUF files of [RDson/CoderO1-DeepSeekR1-14B-Preview](https://huggingface.co/RDson/CoderO1-DeepSeekR1-14B-Preview).
8
+
9
+
10
+
11
+ # CoderO1-DeepSeekR1-14B-Preview (Not limited to coding, it is just a name)
12
+
13
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
+
15
+ This is based on the work of [FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Instruct-32B-Preview](https://huggingface.co/FuseAI/FuseO1-DeepSeekR1-Qwen2.5-Instruct-32B-Preview).
16
+
17
+ ## Merge Details
18
+ ### Merge Method
19
+
20
+ This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge method using [Qwen/Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) as a base.
21
+
22
+ ### Models Merged
23
+
24
+ The following models were included in the merge:
25
+ * [deepseek-ai/DeepSeek-R1-Distill-Qwen-14B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B)
26
+ * [arcee-ai/Virtuoso-Small-v2](https://huggingface.co/arcee-ai/Virtuoso-Small-v2)
27
+ * [Qwen/Qwen2.5-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct)
28
+
29
+ ### Configuration
30
+
31
+ The following YAML configuration was used to produce this model:
32
+
33
+ ```yaml
34
+ models:
35
+ # Pivot model
36
+ - model: Qwen/Qwen2.5-14B
37
+ # Target models
38
+ - model: Qwen/Qwen2.5-14B-Instruct
39
+ - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
40
+ - model: arcee-ai/Virtuoso-Small-v2
41
+ merge_method: sce
42
+ base_model: Qwen/Qwen2.5-14B
43
+ tokenizer:
44
+ source: union
45
+ parameters:
46
+ select_topk: 1.0
47
+ dtype: bfloat16
48
+
49
+ ```