Update README.md
Browse files
README.md
CHANGED
|
@@ -22,6 +22,8 @@ Run:
|
|
| 22 |
"checkpoint_format": "gptq"
|
| 23 |
}
|
| 24 |
```
|
|
|
|
|
|
|
| 25 |
---
|
| 26 |
inference: false
|
| 27 |
license: other
|
|
|
|
| 22 |
"checkpoint_format": "gptq"
|
| 23 |
}
|
| 24 |
```
|
| 25 |
+
TODO:
|
| 26 |
+
* Add sharding of quantized model so there is no need to manually combine safetensor files
|
| 27 |
---
|
| 28 |
inference: false
|
| 29 |
license: other
|