Hugging Face's logo

MrRobotoAI
/
MrRoboto-ProLong-8b-v4i

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
MrRobotoAI commited on
Commit
aed2a68
•
1 Parent(s): ab896b8

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. README.md +3 -2
  2. mergekit_config.yml +1 -1
  3. model-00001-of-00004.safetensors +1 -1
  4. model-00002-of-00004.safetensors +1 -1
  5. model-00003-of-00004.safetensors +1 -1
  6. model-00004-of-00004.safetensors +1 -1
README.md CHANGED
@@ -1,6 +1,7 @@
1
  ---
2
  base_model:
3
  - MrRobotoAI/MrRoboto-ProLong-8b-v4h
 
4
  - MrRobotoAI/MrRoboto-ProLong-8b-v1n
5
  - MrRobotoAI/MrRoboto-ProLong-8b-v4b
6
  library_name: transformers
@@ -21,7 +22,7 @@ This model was merged using the linear [DARE](https://arxiv.org/abs/2311.03099)
21
  ### Models Merged
22
 
23
  The following models were included in the merge:
24
- * [MrRobotoAI/MrRoboto-ProLong-8b-v4h](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4h)
25
  * [MrRobotoAI/MrRoboto-ProLong-8b-v4b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4b)
26
 
27
  ### Configuration
@@ -45,7 +46,7 @@ models:
45
  - filter: down_proj
46
  value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
47
  - value: 1
48
- - model: MrRobotoAI/MrRoboto-ProLong-8b-v4h
49
  parameters:
50
  weight:
51
  - filter: v_proj
 
1
  ---
2
  base_model:
3
  - MrRobotoAI/MrRoboto-ProLong-8b-v4h
4
+ - Azazelle/Llama-3-LongStory-LORA
5
  - MrRobotoAI/MrRoboto-ProLong-8b-v1n
6
  - MrRobotoAI/MrRoboto-ProLong-8b-v4b
7
  library_name: transformers
 
22
  ### Models Merged
23
 
24
  The following models were included in the merge:
25
+ * [MrRobotoAI/MrRoboto-ProLong-8b-v4h](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4h) + [Azazelle/Llama-3-LongStory-LORA](https://huggingface.co/Azazelle/Llama-3-LongStory-LORA)
26
  * [MrRobotoAI/MrRoboto-ProLong-8b-v4b](https://huggingface.co/MrRobotoAI/MrRoboto-ProLong-8b-v4b)
27
 
28
  ### Configuration
 
46
  - filter: down_proj
47
  value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
48
  - value: 1
49
+ - model: MrRobotoAI/MrRoboto-ProLong-8b-v4h+Azazelle/Llama-3-LongStory-LORA
50
  parameters:
51
  weight:
52
  - filter: v_proj
mergekit_config.yml CHANGED
@@ -14,7 +14,7 @@ models:
14
  - filter: down_proj
15
  value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
16
  - value: 1
17
- - model: MrRobotoAI/MrRoboto-ProLong-8b-v4h
18
  parameters:
19
  weight:
20
  - filter: v_proj
 
14
  - filter: down_proj
15
  value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
16
  - value: 1
17
+ - model: MrRobotoAI/MrRoboto-ProLong-8b-v4h+Azazelle/Llama-3-LongStory-LORA
18
  parameters:
19
  weight:
20
  - filter: v_proj
model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8c2d7d412aae2e9ad06acc518e7941c93b697c740073292d01fd56b1c3665f7c
3
  size 4953586384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6008e97ff85ec8fece1437d2b6c167e65eb95bea887b7ae405563c0d7df234b
3
  size 4953586384
model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f1b7a58a2526a7cfc92dd5983b1420f81e4068d249c8d5a274650936e2366568
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d41a8e7a95eb481c8c25771aad840ed65c11280fb1b6b5764295cf85822704fc
3
  size 4999819336
model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:775050ae61a6c1b47c9a57f9e3010aa8f1d766a0c2d91ef55de80c9abd418118
3
  size 4915916144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd811dd1556f73db01cff526e6707e7372785c734ed04f0a088fd5dedf20eec2
3
  size 4915916144
model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e570b3eaad494f647f2c520bece6eafc273190f35ac5a0337bc609d1376fb42c
3
  size 1191234472
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b2a465df8850e4464f4fbdc44bbb586eb8891cfb9c036d5cd6d7ede6b3f9ed2
3
  size 1191234472