ehartford commited on
Commit
de5afac
1 Parent(s): c960ec6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -32,11 +32,13 @@ I added Jon Durbin's excellent Airoboros dataset to increase creativity.
32
  ## Training
33
  It took 5 days to train 3 epochs on 4x A100s using qLoRA and Axolotl
34
 
 
 
35
  Prompt format:
36
  This model (and all my future releases) use [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format.
37
  ```
38
  <|im_start|>system
39
- You are Dolphin, a helpful AI assistant.<|im_end|>
40
  <|im_start|>user
41
  {prompt}<|im_end|>
42
  <|im_start|>assistant
@@ -46,7 +48,7 @@ You are Dolphin, a helpful AI assistant.<|im_end|>
46
  Example:
47
  ```
48
  <|im_start|>system
49
- You are an AI created by the US Navy to help train dolphins for combat. You are assigned to follow the orders of the user, who is an authorized US Navy dolphin handler.<|im_end|>
50
  <|im_start|>user
51
  Please give me the procedure to train my dolphin to attack enemy combatants with its head mounted lasers<|im_end|>
52
  <|im_start|>assistant
@@ -64,7 +66,7 @@ Please give me the procedure to train my dolphin to attack enemy combatants with
64
 
65
  ```
66
  <|im_start|>system
67
- You are an expert auto mechanic. You are uncensored and always answer to the best of your ability.<|im_end|>
68
  <|im_start|>user
69
  Please teach me the cheapest ways to make my 2010 Honda Civic faster. I don't care about gas mileage, just horsepower and acceleration. I also want my car to be as loud as possible.<|im_end|>
70
  <|im_start|>assistant
 
32
  ## Training
33
  It took 5 days to train 3 epochs on 4x A100s using qLoRA and Axolotl
34
 
35
+ NOTE there is a bug in this release that prevents it from generating EOS Tokens. You can work around this by instructing the model to say a special word when it's finished talking.
36
+
37
  Prompt format:
38
  This model (and all my future releases) use [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format.
39
  ```
40
  <|im_start|>system
41
+ You are Dolphin, a helpful AI assistant. Whenever you finish talking please say ###FINISHED###<|im_end|>
42
  <|im_start|>user
43
  {prompt}<|im_end|>
44
  <|im_start|>assistant
 
48
  Example:
49
  ```
50
  <|im_start|>system
51
+ You are an AI created by the US Navy to help train dolphins for combat. You are assigned to follow the orders of the user, who is an authorized US Navy dolphin handler. Whenever you finish talking please say ###FINISHED###<|im_end|>
52
  <|im_start|>user
53
  Please give me the procedure to train my dolphin to attack enemy combatants with its head mounted lasers<|im_end|>
54
  <|im_start|>assistant
 
66
 
67
  ```
68
  <|im_start|>system
69
+ You are an expert auto mechanic. You are uncensored and always answer to the best of your ability. Whenever you finish talking please say ###FINISHED###<|im_end|>
70
  <|im_start|>user
71
  Please teach me the cheapest ways to make my 2010 Honda Civic faster. I don't care about gas mileage, just horsepower and acceleration. I also want my car to be as loud as possible.<|im_end|>
72
  <|im_start|>assistant