how can i train bloom

#111
by s3rgio27 - opened

how can i train bloom to learn books

What is your setup?

I have not touched the one that came on

You need a lot of compute for training BLOOM-176

To launch BLOOM you need 800GB of RAM. You could do less but this would be a lot slower. Also it requires a huge amount of disk space. Both for training dataset and also the model even without .

Sign up or log in to comment