michaelfeil
commited on
Commit
•
6f8e823
1
Parent(s):
4a45e7f
Upload HuggingFaceH4/starchat-alpha ctranslate fp16 weights
Browse files- README.md +3 -3
- model.bin +2 -2
- vocab.json +0 -0
README.md
CHANGED
@@ -19,12 +19,12 @@ quantized version of [HuggingFaceH4/starchat-alpha](https://huggingface.co/Huggi
|
|
19 |
```bash
|
20 |
pip install hf-hub-ctranslate2>=2.0.8
|
21 |
```
|
22 |
-
Converted on 2023-05-
|
23 |
```
|
24 |
-
ct2-transformers-converter --model HuggingFaceH4/starchat-alpha --output_dir /home/michael/tmp-ct2fast-starchat-alpha --force --copy_files merges.txt all_results.json training_args.bin tokenizer.json README.md dialogue_template.json tokenizer_config.json eval_results.json TRAINER_README.md train_results.json generation_config.json trainer_state.json special_tokens_map.json added_tokens.json
|
25 |
```
|
26 |
|
27 |
-
Checkpoint compatible to [ctranslate2>=3.
|
28 |
- `compute_type=int8_float16` for `device="cuda"`
|
29 |
- `compute_type=int8` for `device="cpu"`
|
30 |
|
|
|
19 |
```bash
|
20 |
pip install hf-hub-ctranslate2>=2.0.8
|
21 |
```
|
22 |
+
Converted on 2023-05-30 using
|
23 |
```
|
24 |
+
ct2-transformers-converter --model HuggingFaceH4/starchat-alpha --output_dir /home/michael/tmp-ct2fast-starchat-alpha --force --copy_files merges.txt all_results.json training_args.bin tokenizer.json README.md dialogue_template.json tokenizer_config.json eval_results.json vocab.json TRAINER_README.md train_results.json generation_config.json trainer_state.json special_tokens_map.json added_tokens.json requirements.txt .gitattributes --quantization float16 --trust_remote_code
|
25 |
```
|
26 |
|
27 |
+
Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
|
28 |
- `compute_type=int8_float16` for `device="cuda"`
|
29 |
- `compute_type=int8` for `device="cpu"`
|
30 |
|
model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4d6c7c19491226a3f810bc82c35a248641435c68583708800efa749f771296d9
|
3 |
+
size 31034991031
|
vocab.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|