grimjim commited on
Commit
47ffbe9
1 Parent(s): 57e3dbe

Update README.md

Browse files

Added warning over broken GGUF quants.

Files changed (1) hide show
  1. README.md +57 -55
README.md CHANGED
@@ -1,55 +1,57 @@
1
- ---
2
- language:
3
- - en
4
- base_model:
5
- - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
6
- - grimjim/llama-3-aaditya-OpenBioLLM-8B
7
- library_name: transformers
8
- tags:
9
- - mergekit
10
- - merge
11
- license: llama3
12
- license_link: LICENSE
13
- pipeline_tag: text-generation
14
- ---
15
- # Llama-3-Luminurse-v0.1-OAS-8B
16
-
17
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
-
19
- Given that a biomedical model was merged with Lumimaid, the obvious resulting name was Luminurse.
20
-
21
- - [Full weights](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.1-OAS-8B)
22
- - [GGUF quants](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.1-OAS-8B-GGUF)
23
-
24
- Built with Meta Llama 3.
25
-
26
- ## Merge Details
27
- ### Merge Method
28
-
29
- This model was merged using the SLERP merge method.
30
-
31
- ### Models Merged
32
-
33
- The following models were included in the merge:
34
- * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
35
- * [grimjim/llama-3-aaditya-OpenBioLLM-8B](https://huggingface.co/grimjim/llama-3-aaditya-OpenBioLLM-8B)
36
-
37
- ### Configuration
38
-
39
- The following YAML configuration was used to produce this model:
40
-
41
- ```yaml
42
- slices:
43
- - sources:
44
- - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
45
- layer_range: [0,32]
46
- - model: grimjim/llama-3-aaditya-OpenBioLLM-8B
47
- layer_range: [0,32]
48
- merge_method: slerp
49
- base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
50
- parameters:
51
- t:
52
- - value: 0.1
53
- dtype: bfloat16
54
-
55
- ```
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ base_model:
5
+ - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
6
+ - grimjim/llama-3-aaditya-OpenBioLLM-8B
7
+ library_name: transformers
8
+ tags:
9
+ - mergekit
10
+ - merge
11
+ license: llama3
12
+ license_link: LICENSE
13
+ pipeline_tag: text-generation
14
+ ---
15
+ # Llama-3-Luminurse-v0.1-OAS-8B
16
+
17
+ This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
18
+
19
+ Given that a biomedical model was merged with Lumimaid, the obvious resulting name was Luminurse.
20
+
21
+ WARNING: There appears to be something broken with the current GGUFs despite quantization having completed without errors. This repo will be updated once working GGUFs are generated.
22
+
23
+ - [Full weights](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.1-OAS-8B)
24
+ - [GGUF quants](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.1-OAS-8B-GGUF)
25
+
26
+ Built with Meta Llama 3.
27
+
28
+ ## Merge Details
29
+ ### Merge Method
30
+
31
+ This model was merged using the SLERP merge method.
32
+
33
+ ### Models Merged
34
+
35
+ The following models were included in the merge:
36
+ * [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
37
+ * [grimjim/llama-3-aaditya-OpenBioLLM-8B](https://huggingface.co/grimjim/llama-3-aaditya-OpenBioLLM-8B)
38
+
39
+ ### Configuration
40
+
41
+ The following YAML configuration was used to produce this model:
42
+
43
+ ```yaml
44
+ slices:
45
+ - sources:
46
+ - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
47
+ layer_range: [0,32]
48
+ - model: grimjim/llama-3-aaditya-OpenBioLLM-8B
49
+ layer_range: [0,32]
50
+ merge_method: slerp
51
+ base_model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
52
+ parameters:
53
+ t:
54
+ - value: 0.1
55
+ dtype: bfloat16
56
+
57
+ ```