michaelfeil commited on
Commit
0e006ee
1 Parent(s): 5aefbdc

Upload bigcode/starcoder ctranslate fp16 weights

Browse files
Files changed (3) hide show
  1. README.md +4 -4
  2. model.bin +2 -2
  3. vocab.json +0 -0
README.md CHANGED
@@ -266,12 +266,12 @@ quantized version of [bigcode/starcoder](https://huggingface.co/bigcode/starcode
266
  ```bash
267
  pip install hf-hub-ctranslate2>=2.0.8
268
  ```
269
- Converted on 2023-05-23 using
270
  ```
271
- ct2-transformers-converter --model bigcode/starcoder --output_dir /home/michael/tmp-ct2fast-starcoder --force --copy_files merges.txt tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
272
  ```
273
 
274
- Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.6](https://github.com/michaelfeil/hf-hub-ctranslate2)
275
  - `compute_type=int8_float16` for `device="cuda"`
276
  - `compute_type=int8` for `device="cpu"`
277
 
@@ -289,7 +289,7 @@ model = GeneratorCT2fromHfHub(
289
  # tokenizer=AutoTokenizer.from_pretrained("bigcode/starcoder")
290
  )
291
  outputs = model.generate(
292
- text=["def hello_world()", "User: How are you doing? Bot:"],
293
  max_length=64
294
  )
295
  print(outputs)
 
266
  ```bash
267
  pip install hf-hub-ctranslate2>=2.0.8
268
  ```
269
+ Converted on 2023-05-30 using
270
  ```
271
+ ct2-transformers-converter --model bigcode/starcoder --output_dir /home/michael/tmp-ct2fast-starcoder --force --copy_files merges.txt tokenizer.json README.md tokenizer_config.json vocab.json generation_config.json special_tokens_map.json .gitattributes --quantization float16 --trust_remote_code
272
  ```
273
 
274
+ Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
275
  - `compute_type=int8_float16` for `device="cuda"`
276
  - `compute_type=int8` for `device="cpu"`
277
 
 
289
  # tokenizer=AutoTokenizer.from_pretrained("bigcode/starcoder")
290
  )
291
  outputs = model.generate(
292
+ text=["How do you call a fast Flan-ingo?", "User: How are you doing? Bot:"],
293
  max_length=64
294
  )
295
  print(outputs)
model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e10b6e28e73c9e407636e8d3988c1f60dc9b1767f8c7aaaca18693144c3dd188
3
- size 36949870923
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4957219992c0e64cdc513ae4e2e5b31814cb49505af551672345708ed4e33621
3
+ size 31034941879
vocab.json ADDED
The diff for this file is too large to render. See raw diff