Text Generation
PEFT
Safetensors
Eval Results

2 gpu setup

#6
by tommykoctur - opened

Hi,

I managed to run your script, thank you for creating it!
I got 2 NVLINK-ed RTX A6000 (48GB) GPUs.
But it failed when I didn't limit to one GPU
os.environ["CUDA_VISIBLE_DEVICES"] = "0".

Do I need to do some modifications to use it with two GPUs?

Yep - set device_map to “auto”.

dfurman changed discussion status to closed

Sign up or log in to comment