Transformers
English
ctranslate2
int8
float16
code
Inference Endpoints
michaelfeil commited on
Commit
6f8e823
1 Parent(s): 4a45e7f

Upload HuggingFaceH4/starchat-alpha ctranslate fp16 weights

Browse files
Files changed (3) hide show
  1. README.md +3 -3
  2. model.bin +2 -2
  3. vocab.json +0 -0
README.md CHANGED
@@ -19,12 +19,12 @@ quantized version of [HuggingFaceH4/starchat-alpha](https://huggingface.co/Huggi
19
  ```bash
20
  pip install hf-hub-ctranslate2>=2.0.8
21
  ```
22
- Converted on 2023-05-23 using
23
  ```
24
- ct2-transformers-converter --model HuggingFaceH4/starchat-alpha --output_dir /home/michael/tmp-ct2fast-starchat-alpha --force --copy_files merges.txt all_results.json training_args.bin tokenizer.json README.md dialogue_template.json tokenizer_config.json eval_results.json TRAINER_README.md train_results.json generation_config.json trainer_state.json special_tokens_map.json added_tokens.json handler.py requirements.txt .gitattributes --quantization float16
25
  ```
26
 
27
- Checkpoint compatible to [ctranslate2>=3.13.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.6](https://github.com/michaelfeil/hf-hub-ctranslate2)
28
  - `compute_type=int8_float16` for `device="cuda"`
29
  - `compute_type=int8` for `device="cpu"`
30
 
 
19
  ```bash
20
  pip install hf-hub-ctranslate2>=2.0.8
21
  ```
22
+ Converted on 2023-05-30 using
23
  ```
24
+ ct2-transformers-converter --model HuggingFaceH4/starchat-alpha --output_dir /home/michael/tmp-ct2fast-starchat-alpha --force --copy_files merges.txt all_results.json training_args.bin tokenizer.json README.md dialogue_template.json tokenizer_config.json eval_results.json vocab.json TRAINER_README.md train_results.json generation_config.json trainer_state.json special_tokens_map.json added_tokens.json requirements.txt .gitattributes --quantization float16 --trust_remote_code
25
  ```
26
 
27
+ Checkpoint compatible to [ctranslate2>=3.14.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.8](https://github.com/michaelfeil/hf-hub-ctranslate2)
28
  - `compute_type=int8_float16` for `device="cuda"`
29
  - `compute_type=int8` for `device="cpu"`
30
 
model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:51cb45ed493b6884702ab15c1580a6269dbb57571f9ddf473bbe063ec842c38d
3
- size 36949920075
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d6c7c19491226a3f810bc82c35a248641435c68583708800efa749f771296d9
3
+ size 31034991031
vocab.json ADDED
The diff for this file is too large to render. See raw diff