Finetune 35B Model
#6
by
amitbcp
- opened
The notebook is for finetuning 8B model and not 35B.
On changing the model name, it throws an error as the device map is not correctly mapped.
Kindly provide the device mapping or if you can please update the finetuning notebook.
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! (when checking argument for argument index in method wrapper_CUDA__index_select)