Error : in _sync_params_and_buffers dist._broadcast_coalesced( RuntimeError: Invalid scalar type
#71
by
mahi22muki
- opened
File "python-3.10.0/lib/python3.10/site-packages/torch/distributed/utils.py", line 131, in _sync_params_and_buffers
dist._broadcast_coalesced(
RuntimeError: Invalid scalar type
I am trying to run my script using mpirun
I get the same error when trying to fine tune the model with the accelerate API
Any fix for this ?