davzoku commited on
Commit
b51db8a
1 Parent(s): 4b3b6e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -3
README.md CHANGED
@@ -1,17 +1,45 @@
1
  ---
 
 
 
 
 
 
 
2
  base_model:
3
  - davzoku/cria-llama2-7b-v1.3
4
  library_name: transformers
5
  tags:
6
  - mergekit
7
  - merge
 
8
 
9
  ---
10
- # Untitled Model (1)
11
 
12
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
13
 
14
- ## Merge Details
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  ### Merge Method
16
 
17
  This model was merged using the passthrough merge method.
 
1
  ---
2
+ inference: false
3
+ language: en
4
+ license: llama2
5
+ model_type: llama
6
+ datasets:
7
+ - mlabonne/CodeLlama-2-20k
8
+ pipeline_tag: text-generation
9
  base_model:
10
  - davzoku/cria-llama2-7b-v1.3
11
  library_name: transformers
12
  tags:
13
  - mergekit
14
  - merge
15
+ - llama-2
16
 
17
  ---
18
+ # FrankenCRIA v1.3-m.2
19
 
20
+ ## What is FrankenCRIA?
21
 
22
+ <p align="center">
23
+ <img src="https://github.com/davzoku/cria/blob/main/assets/frankencria-icon-512x512.png?raw=true" width="300" height="300" alt="FrankenCRIA Logo"> <br>
24
+ <i>This is a frankenmerge of <a href="https://huggingface.co/davzoku/cria-llama2-7b-v1.3">davzoku/cria-llama2-7b-v1.3</a>.</i>
25
+ </p>
26
+
27
+ The configuration is the same as [vilm/vinallama-12.5b-chat-DUS](https://huggingface.co/vilm/vinallama-12.5b-chat-DUS).
28
+
29
+
30
+ Please be aware that this model is highly experimental, and no further training has been conducted following the merge.
31
+ Therefore, the model performance may not meet expectations, as described in the [SOLAR paper](https://arxiv.org/abs/2312.15166)
32
+
33
+
34
+ ## 📦 FrankenCRIA Model Release
35
+
36
+ FrankenCRIA v1.3 comes with several variants.
37
+
38
+ - [davzoku/frankencria-llama2-11b-v1.3-m.1](https://huggingface.co/davzoku/frankencria-llama2-11b-v1.3-m.1): 11B FrankenMerge inspired by [Undi95/Mistral-11B-v0.1](https://huggingface.co/Undi95/Mistral-11B-v0.1)
39
+ - [davzoku/frankencria-llama2-12.5b-v1.3-m.2](https://huggingface.co/davzoku/frankencria-llama2-12.5b-v1.3-m.2): 12.5B interleaving FrankenMerge inspired by [vilm/vinallama-12.5b-chat-DUS](https://huggingface.co/vilm/vinallama-12.5b-chat-DUS)
40
+
41
+
42
+ ## 🧩 Merge Details
43
  ### Merge Method
44
 
45
  This model was merged using the passthrough merge method.