dreamerdeo
commited on
Commit
•
bb4ec00
1
Parent(s):
b3af2ba
Update README.md
Browse files
README.md
CHANGED
@@ -51,7 +51,7 @@ The pre-training corpus heavily leverages the publicly available corpus, includi
|
|
51 |
[SlimPajama](https://huggingface.co/datasets/cerebras/SlimPajama-627B),
|
52 |
[SkyPile](https://huggingface.co/datasets/Skywork/SkyPile-150B),
|
53 |
[CC100](https://huggingface.co/datasets/cc100) and [MADLAD-400](https://huggingface.co/datasets/allenai/MADLAD-400).
|
54 |
-
The instruction tuning corpus are all
|
55 |
[aya_collection](https://huggingface.co/datasets/CohereForAI/aya_collection),
|
56 |
[aya_dataset](https://huggingface.co/datasets/CohereForAI/aya_dataset),
|
57 |
[OpenOrca](https://huggingface.co/datasets/Open-Orca/OpenOrca).
|
@@ -71,7 +71,7 @@ make
|
|
71 |
pip install -r requirements.txt
|
72 |
|
73 |
# generate with llama.cpp
|
74 |
-
./main -ngl
|
75 |
```
|
76 |
|
77 |
> Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
|
|
|
51 |
[SlimPajama](https://huggingface.co/datasets/cerebras/SlimPajama-627B),
|
52 |
[SkyPile](https://huggingface.co/datasets/Skywork/SkyPile-150B),
|
53 |
[CC100](https://huggingface.co/datasets/cc100) and [MADLAD-400](https://huggingface.co/datasets/allenai/MADLAD-400).
|
54 |
+
The instruction tuning corpus are all publicly available including
|
55 |
[aya_collection](https://huggingface.co/datasets/CohereForAI/aya_collection),
|
56 |
[aya_dataset](https://huggingface.co/datasets/CohereForAI/aya_dataset),
|
57 |
[OpenOrca](https://huggingface.co/datasets/Open-Orca/OpenOrca).
|
|
|
71 |
pip install -r requirements.txt
|
72 |
|
73 |
# generate with llama.cpp
|
74 |
+
./main -ngl 32 -m ggml-model-Q4_K_M.gguf -p "<|im_start|>question\nCara memanggang ikan?\n<|im_start|>answer\n" --temp 0.7 --repeat_penalty 1.1 -n 400 -e
|
75 |
```
|
76 |
|
77 |
> Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don't have GPU acceleration.
|