michaelfeil
/

ct2fast-dolly-v2-12b

Inference Endpoints

Model card Files Files and versions Community

michaelfeil commited on May 3, 2023

Commit

cb83031

•

1 Parent(s): 2ee7a4c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ pip install hf_hub_ctranslate2>=1.0.0 ctranslate2>=3.13.0
 Checkpoint compatible to [ctranslate2](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2](https://github.com/michaelfeil/hf-hub-ctranslate2)
 - `compute_type=int8_float16` for `device="cuda"`
-- `compute_type=int8`  for `device="cuda"`
 ```python
 from hf_hub_ctranslate2 import TranslatorCT2fromHfHub, GeneratorCT2fromHfHub

 Checkpoint compatible to [ctranslate2](https://github.com/OpenNMT/CTranslate2) and [hf-hub-ctranslate2](https://github.com/michaelfeil/hf-hub-ctranslate2)
 - `compute_type=int8_float16` for `device="cuda"`
+- `compute_type=int8`  for `device="cpu"`
 ```python
 from hf_hub_ctranslate2 import TranslatorCT2fromHfHub, GeneratorCT2fromHfHub