hivemind / gpt-j-6B-8bit , How can i use Multiple GPU , I treid using accelerate and also using torch.nn.dataparallel() nothing works out
#11
by
MukeshSharma
- opened
Hey , Anyone who is able to use multiple GPU's during fine-tuning of the model , I am looking for the answer , I tried all the method's which I was aware , but still searching , any help is really appreciated.
Hey! I know this issue is 2 months old, but you can try this new library: https://github.com/BlackSamorez/tensor_parallel