Text Generation
Transformers
PyTorch
TensorBoard
Safetensors
bloom
Eval Results
text-generation-inference
Inference Endpoints

Use `bloom` with pipeline ?

#178
by Kotgo - opened

is it possible to use Bloom using a pipeline ?

BigScience Workshop org

Hi @Kotgo ,
If you have enough GPU RAM and/or GPU+CPU RAM for offload yes you can use bloom using pipeline!

christopher changed discussion status to closed

Sign up or log in to comment