BlueNipples commited on
Commit
e9927aa
1 Parent(s): f2a1cf6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -13
README.md CHANGED
@@ -1,25 +1,18 @@
1
  ---
2
  base_model: []
3
  tags:
4
- - mergekit
5
- - merge
6
-
7
  ---
8
- # Apocrypha-7b
9
 
10
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
11
 
12
- ## Merge Details
13
- ### Merge Method
14
 
15
- This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using ./Mistral-7B-v0.1 as a base.
16
 
17
- ### Models Merged
18
 
19
- The following models were included in the merge:
20
- * ./mental-mistral-7b
21
- * ./Fett-uccine-7B
22
- * ./Hermes-Trismegistus-7B
23
 
24
  ### Configuration
25
 
@@ -40,3 +33,13 @@ merge_method: task_arithmetic
40
  base_model: ./Mistral-7B-v0.1
41
  dtype: bfloat16
42
  ```
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  base_model: []
3
  tags:
4
+ - conversation
 
 
5
  ---
 
6
 
7
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64bb1109aaccfd28b023bcec/4UliqjJuW0cn9KlrqfJLL.png)
8
 
9
+ ### Design
 
10
 
11
+ This mistral 7b model is a task arithmetic merge of Epiculous/Fett-uccine-7B (theory of mind and gnosis datasets), GRMenon/mental-mistral-7b-instruct-autotrain (mental health counseling conversations dataset), and teknium/Hermes-Trismegistus-Mistral-7B (open-hermes + occult datasets)
12
 
13
+ The design intention is to create a pseudo-philosophical, pseudo-spiritual, pseudo counseling chatbob model for sounding ideas off. Like a mirror really. This obviously does not constitute medical advice, and if you are in need seek professional help. The name Apocrypha-7B comes from the fact that it's fake - this isn't a guide or a guru. It's at best, if the model works, a sounding board. But I think such things might still be helpful for organising ones own thoughts.
14
 
15
+ I will throw a GGUF or two inside a subfolder here.
 
 
 
16
 
17
  ### Configuration
18
 
 
33
  base_model: ./Mistral-7B-v0.1
34
  dtype: bfloat16
35
  ```
36
+
37
+ Resources used:
38
+
39
+ https://huggingface.co/teknium/Hermes-Trismegistus-Mistral-7B
40
+
41
+ https://huggingface.co/GRMenon/mental-mistral-7b-instruct-autotrain
42
+
43
+ https://huggingface.co/Epiculous/Fett-uccine-7B/tree/main
44
+
45
+ https://github.com/cg123/mergekit/tree/main