Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
tags:
|
5 |
+
- llama-2
|
6 |
+
- open-instruct
|
7 |
+
- lora
|
8 |
+
datasets:
|
9 |
+
- ehartford/WizardLM_alpaca_evol_instruct_70k_unfiltered
|
10 |
+
---
|
11 |
+
- **Training in progress. Best Model Checkpoint: 0.**
|
12 |
+
|
13 |
+
- Trained on the [`meta-llama/Llama-2-7b-hf`](https://huggingface.co/meta-llama/Llama-2-7b-hf) base model. Does not use any inputs afaik, its all combined into the main `<|user|>` instruction.
|
14 |
+
|
15 |
+
- Trained on 50K instructions, used 4,974 instructions for evaluation.
|
16 |
+
|
17 |
+
- 0.24836028248556738% trainable parameters. All parameters; `6,755,192,832`. Trainable parameters; `16,777,216`.
|
18 |
+
|
19 |
+
# Prompt:
|
20 |
+
These are outputs from koboldcpp using default settings (tokens to generate increased to 256) on a ggjtv3 q5_1 version of the model.
|
21 |
+
|
22 |
+
This is a modified version of the KoboldGPT scenario.
|
23 |
+
|
24 |
+
```
|
25 |
+
Memory
|
26 |
+
|
27 |
+
<|user|>
|
28 |
+
[The following is a chat message log between you and an extremely intelligent and knowledgeable AI system named KoboldGPT. KoboldGPT is a state-of-the-art Artificial General Intelligence. You may ask any question, or request any task, and KoboldGPT will always oblige accurately and truthfully.]
|
29 |
+
|
30 |
+
You: What are german shepherds?
|
31 |
+
KoboldGPT: The German Shepherd is a breed of medium to large-sized working dog that originated in Germany. In the English language, the breed's officially recognized name is German Shepherd Dog. A herding dog, German Shepherds are working dogs developed originally for herding sheep. Since that time, however, because of their strength, intelligence, trainability, and obedience, German Shepherds around the world are often the preferred breed for many types of work, including disability assistance, search-and-rescue, police and military roles and acting.
|
32 |
+
You: What is the atomic number of Calcium?
|
33 |
+
KoboldGPT: A calcium atom has 20 protons, 20 electrons and 20 neutrons. The atomic number or proton number of a chemical element is the number of protons found in the nucleus of every atom of that element. The atomic number uniquely identifies a chemical element. It is identical to the charge number of the nucleus. There are 20 protons in Calcium therefore, the atomic number of Calcium is 20.
|
34 |
+
You: How is an earthquake measured?
|
35 |
+
KoboldGPT: A seismograph is the primary earthquake measuring instrument. The seismograph produces a digital graphic recording of the ground motion caused by the seismic waves. The digital recording is called seismogram. A network of worldwide seismographs detects and measures the strength and duration of the earthquake's waves. The magnitude of an earthquake and the intensity of shaking is usually reported on the Richter scale.
|
36 |
+
<|assistant|>
|
37 |
+
```
|
38 |
+
|
39 |
+
```
|
40 |
+
Starting Prompt
|
41 |
+
|
42 |
+
KoboldGPT: Hello, I am KoboldGPT, your personal AI assistant. What would you like to know?
|
43 |
+
```
|
44 |
+
|
45 |
+
```
|
46 |
+
Questions & Responses
|
47 |
+
|
48 |
+
EMPTY
|
49 |
+
```
|
50 |
+
|
51 |
+
# Training Information:
|
52 |
+
Trained on a single 7900 XTX 24GB.
|
53 |
+
|
54 |
+
```json
|
55 |
+
EMPTY
|
56 |
+
```
|
57 |
+
|
58 |
+
```json
|
59 |
+
EMPTY
|
60 |
+
```
|