Transformers
English
ctranslate2
int8
float16
Inference Endpoints
michaelfeil commited on
Commit
dbcb605
1 Parent(s): 7b076e7

Upload togethercomputer/RedPajama-INCITE-Chat-7B-v0.1 ctranslate fp16 weights

Browse files
Files changed (1) hide show
  1. README.md +7 -1
README.md CHANGED
@@ -32,7 +32,7 @@ pip install hf-hub-ctranslate2>=2.0.6
32
  ```
33
  Converted on 2023-05-19 using
34
  ```
35
- ct2-transformers-converter --model togethercomputer/RedPajama-INCITE-Chat-7B-v0.1 --output_dir /home/feil_m/tmp-ct2fast-RedPajama-INCITE-Chat-7B-v0.1 --force --copy_files tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
36
  ```
37
 
38
  Checkpoint compatible to [ctranslate2>=3.13.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.6](https://github.com/michaelfeil/hf-hub-ctranslate2)
@@ -63,6 +63,12 @@ This is just a quantized version. Licence conditions are intended to be idential
63
 
64
  # Original description
65
 
 
 
 
 
 
 
66
  # RedPajama-INCITE-Chat-7B-v0.1
67
 
68
  RedPajama-INCITE-Chat-7B-v0.1 was developed by Together and leaders from the open-source AI community including Ontocord.ai, ETH DS3Lab, AAI CERC, Université de Montréal, MILA - Québec AI Institute, Stanford Center for Research on Foundation Models (CRFM), Stanford Hazy Research research group and LAION.
 
32
  ```
33
  Converted on 2023-05-19 using
34
  ```
35
+ ct2-transformers-converter --model togethercomputer/RedPajama-INCITE-Chat-7B-v0.1 --output_dir /home/michael/tmp-ct2fast-RedPajama-INCITE-Chat-7B-v0.1 --force --copy_files tokenizer.json README.md tokenizer_config.json generation_config.json special_tokens_map.json .gitattributes --quantization float16
36
  ```
37
 
38
  Checkpoint compatible to [ctranslate2>=3.13.0](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2>=2.0.6](https://github.com/michaelfeil/hf-hub-ctranslate2)
 
63
 
64
  # Original description
65
 
66
+ tags:
67
+ - ctranslate2
68
+ - int8
69
+ - float16
70
+
71
+
72
  # RedPajama-INCITE-Chat-7B-v0.1
73
 
74
  RedPajama-INCITE-Chat-7B-v0.1 was developed by Together and leaders from the open-source AI community including Ontocord.ai, ETH DS3Lab, AAI CERC, Université de Montréal, MILA - Québec AI Institute, Stanford Center for Research on Foundation Models (CRFM), Stanford Hazy Research research group and LAION.