michaelfeil
commited on
Commit
•
0e006ee
1
Parent(s):
5aefbdc
Upload bigcode/starcoder ctranslate fp16 weights
Browse files- README.md +4 -4
- model.bin +2 -2
- vocab.json +0 -0
README.md
CHANGED
@@ -266,12 +266,12 @@ quantized version of [bigcode/starcoder](https://huggingface.co/bigcode/starcode
|
|
266 |
```bash
|
267 |
pip install hf-hub-ctranslate2>=2.0.8
|
268 |
```
|
269 |
-
Converted on 2023-05-
|
270 |
```
|
271 |
-
ct2-transformers-converter --model bigcode/starcoder --output_dir /home/michael/tmp-ct2fast-starcoder --force --copy_files merges.txt tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
|
272 |
```
|
273 |
|
274 |
-
Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.
|
275 |
- `compute_type=int8_float16` for `device="cuda"`
|
276 |
- `compute_type=int8` for `device="cpu"`
|
277 |
|
@@ -289,7 +289,7 @@ model = GeneratorCT2fromHfHub(
|
|
289 |
# tokenizer=AutoTokenizer.from_pretrained("bigcode/starcoder")
|
290 |
)
|
291 |
outputs = model.generate(
|
292 |
-
text=["
|
293 |
max_length=64
|
294 |
)
|
295 |
print(outputs)
|
|
|
266 |
```bash
|
267 |
pip install hf-hub-ctranslate2>=2.0.8
|
268 |
```
|
269 |
+
Converted on 2023-05-30 using
|
270 |
```
|
271 |
+
ct2-transformers-converter --model bigcode/starcoder --output_dir /home/michael/tmp-ct2fast-starcoder --force --copy_files merges.txt tokenizer.json README.md tokenizer_config.json vocab.json generation_config.json special_tokens_map.json .gitattributes --quantization float16 --trust_remote_code
|
272 |
```
|
273 |
|
274 |
+
Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
|
275 |
- `compute_type=int8_float16` for `device="cuda"`
|
276 |
- `compute_type=int8` for `device="cpu"`
|
277 |
|
|
|
289 |
# tokenizer=AutoTokenizer.from_pretrained("bigcode/starcoder")
|
290 |
)
|
291 |
outputs = model.generate(
|
292 |
+
text=["How do you call a fast Flan-ingo?", "User: How are you doing? Bot:"],
|
293 |
max_length=64
|
294 |
)
|
295 |
print(outputs)
|
model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4957219992c0e64cdc513ae4e2e5b31814cb49505af551672345708ed4e33621
|
3 |
+
size 31034941879
|
vocab.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|