Update context length

README.md

@@ -5,7 +5,7 @@ license_link: https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE
 pipeline_tag: text-generation
 ---
 
-# OrcaMaid-13b-v2-FIX-10k
+# OrcaMaid-13b-v2-FIX-32k
 
 This is the fixed version of **OrcaMaid-v2-13b**, further extended to 10240 context length via YaRN. The (now-deleted) v2 model had issues with the merged tokenizer that prevented it from stopping when necessary, and caused it to output broken ChatML tokens like `<|im_end`, etc.
 
@@ -31,7 +31,7 @@ Below is an instruction that describes a task. Write a response that appropriate
 ### Misc. information
 - BOS token is `<s>`
 - EOS token is `</s>`
-- Native context length is `10240` via YaRN (original context length was `4096`)
+- Native context length is `32768` via YaRN (original context length was `4096`)
 - Base model is Llama 2
 - Due to the inclusion of Orca-2-13b, the model is subject to the terms of the [Microsoft Research License](https://huggingface.co/microsoft/Orca-2-13b/blob/main/LICENSE)