Transformers
English
ctranslate2
int8
float16
Inference Endpoints
michaelfeil commited on
Commit
0951346
1 Parent(s): 48bd069

Upload togethercomputer/RedPajama-INCITE-Instruct-7B-v0.1 ctranslate fp16 weights

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -42,7 +42,7 @@ pip install hf-hub-ctranslate2>=2.0.6
42
  ```
43
  Converted on 2023-05-19 using
44
  ```
45
- ct2-transformers-converter --model togethercomputer/RedPajama-INCITE-Instruct-7B-v0.1 --output_dir /home/feil_m/tmp-ct2fast-RedPajama-INCITE-Instruct-7B-v0.1 --force --copy_files tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
46
  ```
47
 
48
  Checkpoint compatible to [ctranslate2>=3.13.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.6](https://github.com/michaelfeil/hf-hub-ctranslate2)
 
42
  ```
43
  Converted on 2023-05-19 using
44
  ```
45
+ ct2-transformers-converter --model togethercomputer/RedPajama-INCITE-Instruct-7B-v0.1 --output_dir /home/michael/tmp-ct2fast-RedPajama-INCITE-Instruct-7B-v0.1 --force --copy_files tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
46
  ```
47
 
48
  Checkpoint compatible to [ctranslate2>=3.13.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.6](https://github.com/michaelfeil/hf-hub-ctranslate2)