Update README.md
Browse files
README.md
CHANGED
|
@@ -5,8 +5,7 @@ datasets:
|
|
| 5 |
# Platypus2-70B-instruct-4bit-gptq
|
| 6 |
|
| 7 |
Platypus2-70B-instruct-4bit-gptq is a qunatnized version of [`garage-bAInd/Platypus2-70B-instruct`](https://huggingface.co/garage-bAInd/Platypus2-70B-instruct) using GPTQ Quantnization.
|
| 8 |
-
|
| 9 |
-
This model is only 35 GIB in size in comparision with the original garage-bAInd/Platypus2-70B-instruct 127 GIB in size and can run on a single GPU
|
| 10 |
|
| 11 |
### Benchmark Metrics
|
| 12 |
|
|
|
|
| 5 |
# Platypus2-70B-instruct-4bit-gptq
|
| 6 |
|
| 7 |
Platypus2-70B-instruct-4bit-gptq is a qunatnized version of [`garage-bAInd/Platypus2-70B-instruct`](https://huggingface.co/garage-bAInd/Platypus2-70B-instruct) using GPTQ Quantnization.
|
| 8 |
+
This model is only 35 GB in size in comparision with the original garage-bAInd/Platypus2-70B-instruct 127 GB and can run on a single A6000 GPU
|
|
|
|
| 9 |
|
| 10 |
### Benchmark Metrics
|
| 11 |
|