Update README.md
Browse files
README.md
CHANGED
@@ -1,8 +1,9 @@
|
|
1 |
---
|
2 |
license: other
|
3 |
---
|
4 |
-
description WIP
|
5 |
|
6 |
-
FP16 model of airoboros 70b 1.4.1 from .bin to . safetensors, to be used to quant on exllama2.
|
7 |
|
8 |
-
|
|
|
|
|
|
1 |
---
|
2 |
license: other
|
3 |
---
|
|
|
4 |
|
5 |
+
FP16 model of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1) from .bin to . safetensors, to be used to quant on exllama2.
|
6 |
|
7 |
+
It can also be used to load faster at FP16 using transformers.
|
8 |
+
|
9 |
+
There is a script inside bin2safetensors folder, that you can use to convert .bin files into .safetensor ones for other models.
|