Severian commited on
Commit
7f2bcbe
1 Parent(s): fc102d4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -35,6 +35,10 @@ Throughout this process, there are many challenges that need to be addressed and
35
  <|endoftext|>
36
  ```
37
 
 
 
 
 
38
  ```py
39
 
40
  !pip install -qqq transformers>=4.39.0 mamba-ssm causal-conv1d>=1.2.0 accelerate bitsandbytes --progress-bar off
 
35
  <|endoftext|>
36
  ```
37
 
38
+ # Inference
39
+
40
+ *※ - This code automatically appends the "<|startoftext|>" special token to any input. Appending this to all inputs is required for inference, as initial testing shows that leaving it out leads to output errors.*
41
+
42
  ```py
43
 
44
  !pip install -qqq transformers>=4.39.0 mamba-ssm causal-conv1d>=1.2.0 accelerate bitsandbytes --progress-bar off