What gpu power do you need just to run Bloom, not fine tune?
#130
by
mishavee
- opened
What gpu power do you need just to run Bloom, not fine tune?
for just inference: 8x A100 80GB
https://github.com/huggingface/transformers-bloom-inference