File size: 606 Bytes
032e687 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
# IP
```commandline
hostname -I
```
# Command
```commandline
# for example, 2 nodes
# on node 0
NNODES=2 NODE_RANK=0 PORT=3333 MASTER_ADDR=10.136.98.202 bash tools/dist.sh train projects/llava_sam2/configs/llava_sam2_internvl_v2_phi3_4b_llava_4ires_4vres_vchat_unfrozenSam2Dec.py 8 --deepspeed ./projects/llava_sam2/deepspeed_zero2_sam2.json
# on node 1
NNODES=2 NODE_RANK=1 PORT=3333 MASTER_ADDR=10.136.98.202 bash tools/dist.sh train projects/llava_sam2/configs/llava_sam2_internvl_v2_phi3_4b_llava_4ires_4vres_vchat_unfrozenSam2Dec.py 8 --deepspeed ./projects/llava_sam2/deepspeed_zero2_sam2.json
``` |