Update README.md
Browse files
README.md
CHANGED
@@ -35,6 +35,10 @@ Throughout this process, there are many challenges that need to be addressed and
|
|
35 |
<|endoftext|>
|
36 |
```
|
37 |
|
|
|
|
|
|
|
|
|
38 |
```py
|
39 |
|
40 |
!pip install -qqq transformers>=4.39.0 mamba-ssm causal-conv1d>=1.2.0 accelerate bitsandbytes --progress-bar off
|
|
|
35 |
<|endoftext|>
|
36 |
```
|
37 |
|
38 |
+
# Inference
|
39 |
+
|
40 |
+
*※ - This code automatically appends the "<|startoftext|>" special token to any input. Appending this to all inputs is required for inference, as initial testing shows that leaving it out leads to output errors.*
|
41 |
+
|
42 |
```py
|
43 |
|
44 |
!pip install -qqq transformers>=4.39.0 mamba-ssm causal-conv1d>=1.2.0 accelerate bitsandbytes --progress-bar off
|