Update README.md
Browse files
README.md
CHANGED
@@ -2,14 +2,16 @@
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
-
Converted using ggerganov/ggml's "stablelm" conversion script and quantization code as of [commit 05f3079](https://github.com/ggerganov/ggml/tree/05f307971862b83df12fada0c42ee027ba5a82b5/examples/stablelm) (2023-04-20).
|
6 |
|
7 |
-
These conversions are based off of
|
|
|
|
|
8 |
|
9 |
**NOTE:** pythia-70m-deduped gave garbage output in my testing.
|
10 |
|
11 |
# RAM USAGE (koboldcpp):
|
12 |
-
Model | Loaded RAM
|
13 |
:--:|:--:
|
14 |
ggml-pythia-70m-deduped-q4_3.bin | 121.2 MiB
|
15 |
ggml-pythia-160m-deduped-q4_3.bin | 225.2 MiB
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
+
Converted using ggerganov/ggml's "stablelm" conversion script and quantization code as of [commit 05f3079](https://github.com/ggerganov/ggml/tree/05f307971862b83df12fada0c42ee027ba5a82b5/examples/stablelm) (2023-04-20).
|
6 |
|
7 |
+
These conversions are based off of the updated Pythia Deduped checkpoints, not the original v0 trainings.
|
8 |
+
|
9 |
+
Should be compatible with KoboldCpp. Perfect if you want to run them on low-end devices like a phone or Raspberry Pi.
|
10 |
|
11 |
**NOTE:** pythia-70m-deduped gave garbage output in my testing.
|
12 |
|
13 |
# RAM USAGE (koboldcpp):
|
14 |
+
Model | Loaded RAM
|
15 |
:--:|:--:
|
16 |
ggml-pythia-70m-deduped-q4_3.bin | 121.2 MiB
|
17 |
ggml-pythia-160m-deduped-q4_3.bin | 225.2 MiB
|