Can DeepSeek-V2 run on two nodes (each with 4 A100)?

by jy395 - opened 26 days ago

jy395

26 days ago

I have two nodes on cluster. Each nodes has 4 A100 80GB GPUs. Is it possible to run the model on two nodes? Thank you!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment