Update README.md
Browse files
README.md
CHANGED
@@ -14,4 +14,5 @@ Original Readme: https://huggingface.co/google/flan-t5-xxl/blob/main/README.md
|
|
14 |
Disclaimer: I don't claim any rights on this modell. All rights go to google.
|
15 |
|
16 |
How to use:
|
17 |
-
./llama-cli -m /path/to/file.gguf --prompt "your prompt" --n-gpu-layers
|
|
|
|
14 |
Disclaimer: I don't claim any rights on this modell. All rights go to google.
|
15 |
|
16 |
How to use:
|
17 |
+
./llama-cli -m /path/to/file.gguf --prompt "your prompt" --n-gpu-layers nn
|
18 |
+
nn --> numbers of layers to offload to gpu
|