jukofyork commited on
Commit
be94751
1 Parent(s): bedecc1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -8
README.md CHANGED
@@ -16,30 +16,34 @@ This is a fixed version of [Eurus-70b-sft](https://huggingface.co/openbmb/Eurus-
16
  <s>[INST] Instruction [/INST] Model answer</s> [INST] Follow-up instruction [/INST]
17
  ```
18
 
19
- This version has had `config.json` fixed to have a context length of 16k and use RoPE base frequency of 1000000:
20
 
21
  ```
22
- > ./perplexity -m eurus:70b-sft-q8_0.gguf -f wiki.test.raw -c 4096
23
 
24
- Final estimate:
25
 
26
- > ./perplexity -m eurus:70b-sft-q8_0.gguf -f wiki.test.raw -c 16384
27
 
28
- Final estimate:
29
  ```
30
 
31
- I have tested it with multi-turn conversations for 10k+ context and it has remained perfectly coherent.
32
 
33
  It even looks to be fine for use with a context length of 32k:
34
 
35
  ```
36
- > ./perplexity -m eurus:70b-sft-q8_0.gguf -f wiki.test.raw -c 32768
37
 
38
- Final estimate:
39
  ```
40
 
41
  ---
42
 
 
 
 
 
43
  <div align="center">
44
 
45
  <img src="https://huggingface.co/openbmb/Eurus-7b-sft/resolve/main/figures/Eurus-logo.png" width="200px">
 
16
  <s>[INST] Instruction [/INST] Model answer</s> [INST] Follow-up instruction [/INST]
17
  ```
18
 
19
+ This version has the same context length (16k) and RoPE base frequency (1000000) as the `CodeLlama-70b`:
20
 
21
  ```
22
+ > ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 4096
23
 
24
+ Final estimate: <to to...>
25
 
26
+ > ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 16384
27
 
28
+ Final estimate: <to to...>
29
  ```
30
 
31
+ I have also tested it with multi-turn conversations for 10k+ context and it has remained perfectly coherent.
32
 
33
  It even looks to be fine for use with a context length of 32k:
34
 
35
  ```
36
+ > ./perplexity -m eurus:70b-nca-fixed-q8_0.gguf -f wiki.test.raw -c 32768
37
 
38
+ Final estimate: <to to...>
39
  ```
40
 
41
  ---
42
 
43
+ Also see: [Eurus-70b-nca-fixed](https://huggingface.co/jukofyork/Eurus-70b-nca-fixed)
44
+
45
+ ---
46
+
47
  <div align="center">
48
 
49
  <img src="https://huggingface.co/openbmb/Eurus-7b-sft/resolve/main/figures/Eurus-logo.png" width="200px">