Text Generation
Transformers
PyTorch
English
llama
Merge
slerp
text-generation-inference
baebee commited on
Commit
6561746
1 Parent(s): de5d5cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -1
README.md CHANGED
@@ -12,4 +12,43 @@ language:
12
  tags:
13
  - merge
14
  - slerp
15
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  tags:
13
  - merge
14
  - slerp
15
+ ---
16
+ # Dorflan
17
+
18
+ ## Model Details
19
+ Dorflan is an experimental merged model created from the following three foundation models:
20
+
21
+ - stabilityai/StableBeluga-7B
22
+ - ehartford/dolphin-llama2-7b
23
+ - AIDC-ai-business/Marcoroni-7B
24
+
25
+ Dorflan was created by merging the weights and architectures of these three models using a custom merging technique. No further fine-tuning was performed after the merge.
26
+
27
+ ## Intended Use
28
+ As an experimental model, Dorflan is intended for testing and research purposes only. It should not be used for production systems or to generate content for public use.
29
+
30
+ ## Training Data
31
+ Dorflan inherits training data from its three foundation models:
32
+
33
+ - StableBeluga-7B: COT, Niv2, t0, & FLAN2021
34
+ - dolphin-llama2-7b: Dolphin
35
+ - Marcoroni-7B: OpenOrca
36
+
37
+ ## Limitations
38
+ As an untested merged model, Dorflan has unknown capabilities and limitations. Potential issues include:
39
+
40
+ - Instability due to merged architectures
41
+ - Compounded bias and issues from all three foundation models
42
+ - Decreased performance on some tasks compared to the foundation models
43
+
44
+ Extensive testing is required to characterize Dorflan's capabilities and limitations.
45
+
46
+ ## Ethical Considerations
47
+ - Dorflan may exhibit harmful biases inherited from its training data
48
+ - Output may be unreliable or manipulated due to instability
49
+ - Experimental nature increases potential for misuse
50
+
51
+ Use this model ethically and do not deploy it for sensitive applications.
52
+
53
+ ## Contact Information
54
+ Please report issues or concerns with this model to the creator for further investigation.