kriss commited on
Commit
b8a65f6
1 Parent(s): b873af7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +37 -0
README.md CHANGED
@@ -1,3 +1,40 @@
1
  ---
2
  license: cc-by-sa-4.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-sa-4.0
3
  ---
4
+
5
+ <div style="width: 800px; margin: auto;">
6
+
7
+ <h2>Model Description</h2>
8
+ <p>“Luna AI Llama2 Uncensored” is a state-of-the-art language model fine-tuned on over 400,000 instructions. This model was fine-tuned by Tap, the creator of Luna AI. The result is an enhanced Llama2 7b model that rivals ChatGPT in performance across a variety of tasks.</p>
9
+ <p>This model stands out for its long responses, low hallucination rate, and absence of censorship mechanisms. The fine-tuning process was performed on an 8x a100 80GB machine.</p>
10
+
11
+ <h2>Model Training</h2>
12
+ <p>The model was trained almost entirely on synthetic outputs. This includes data from diverse sources such as Orca, GPT4-LLM, and a custom unreleased dataset. The total volume of data encompassed over 400,000 high quality instructions.</p>
13
+ <p>Huge shoutout and acknowledgement is deserved for all the dataset creators who generously share their datasets openly.</p>
14
+
15
+ <h2>Prompt Format</h2>
16
+ <p>The model follows the Alpaca prompt format:</p>
17
+
18
+
19
+ <h2>Future Plans</h2>
20
+ <p>The model is currently being uploaded in FP16 format, and there are plans to convert the model to GGML and GPTQ 4bit quantizations.</p>
21
+
22
+ <h2>Benchmark Results</h2>
23
+ <pre>
24
+ | Task |Version| Metric |Value | |Stderr|
25
+ |-------------|------:|--------|-----:|---|-----:|
26
+ |TO be announced
27
+ </pre>
28
+
29
+ <h2>Ethical considerations</h2>
30
+ <p>The data used to train the model is collected from various sources, mostly from the Web. As such, it contains offensive, harmful and biased content. We thus expect the model to exhibit such biases from the training data.</p>
31
+
32
+ <h2>Human life</h2>
33
+ <p>The model is not intended to inform decisions about matters central to human life, and should not be used in such a way.</p>
34
+
35
+ <h2>Risks and harms</h2>
36
+ <p>Risks and harms of large language models include the generation of harmful, offensive or biased content. These models are often prone to generating incorrect information, sometimes referred to as hallucinations. We do not expect our model to be an exception in this regard.</p>
37
+
38
+ </div>
39
+
40
+