Can DeepSeek-V2 run on two nodes (each with 4 A100)?

#5
by jy395 - opened

I have two nodes on cluster. Each nodes has 4 A100 80GB GPUs. Is it possible to run the model on two nodes? Thank you!

off course it's possible.

Sign up or log in to comment